Previous Job
Previous
Hadoop Devops Engineer
Ref No.: 17-02105
Location: New York, New York
Position Type:Contract
Pay Rate : $ 100.00 - 130.00 /Hour
Intelligent Solutions group is seeking a Hadoop DevOps Engineer   This role requires focus primarily on the operation of complex Hadoop systems managing content, optimum performance, and end user support.  This role requires strong collaboration and communication skills to interact with various IT and business groups.
 
Primary Responsibilities
Manage scalable Hadoop cluster environments.
Optimize and tune the Hadoop environments to meet performance requirements.
Utilize open source technologies to create fault-tolerant, elastic and secure high performance data pipelines
Work with big data developers and developers designing scalable supportable infrastructure.
Work with Linux server admin team in administering the server hardware and operating system
Assist with develop and maintain the system runbooks
Work directly with software developers to simplify processes, enhance services and automate application delivery
Coordinate root cause analysis (RCA) efforts to minimize future system issues
Mentor, develop and train junior staff members as needed
Provide off hours support on a rotational basis
BS Degree in Computer Science/Engineering required
This position is anticipated to require the use of one or more High Security Access (HSA) systems.  Users of these systems are subject to enhanced screening which includes both criminal and credit background checks, and/or other enhanced screening at the time of accepting the position and on an annual basis thereafter.  The enhanced screening will need to be successfully completed prior to commencing employment or assignment.
Qualifications
5+ years of IT experience
3-5 years overall experience in Linux systems
2 years developing or supporting applications in a Hadoop environment
Well versed in managing distributions of Hadoop (Hortonworks, Cloudera etc.)
Expert level knowledge of Spark, HBASE, Kafka and services interoperability
Experience with configuration management tools, deployment pipelines, and orchestration services (Jenkins)
Advanced experience of Hive, PIG, Sqoop and Flume
Knowledge in performance troubleshooting and tuning Hadoop Clusters
Good knowledge of Hadoop cluster connectivity and security
Familiar with Hadoop security knowledge and permissions schemes
Excellent customer service attitude, communication skills (written and verbal), and interpersonal skills
Experience working in cross-functional, multi-location teams
Excellent analytical and problem-solving skills

Third Party Applications Not Accepted