Previous Job
Devops and Hadoop Administrator
Ref No.: 18-19837
Location: San Diego, California
Devops and Hadoop Administrator
San Diego, CA
12 Mobnths

I. Purpose

The Devops and Hadoop Administrator is responsible for the design and administration of a Hadoop data lake to support the use of services throughout the Hadoop ecosystem. This includes system architecture to support various product implementations and strategic objectives for the organization. This position requires extensive hands-on experience managing a Linux-based distributed data processing platform.

II. Specific Duties, Activities, and Responsibilities

• Day to day operational support of our Cloudera Hadoop clusters in lab and production environments.
• Collaborate with Product Management, IT Architecture, and Engineering to review enhancements and provide design feedback.
• Make recommendations to improve process efficiency and effectiveness.
• Respond to health alerts generated by Cloudera Manager
• Respond to emergency incidents and standard support requests, working them through to completion within established SLA.
• Collaborate with multiple internal teams to resolve incidents and support requests.
• Improve tools and scripts that automate routine tasks and monitor system health.
• Work effectively with our vendor to support and diagnose complex issues, apply patches, updates, etc.

III. Position Requirements

Education or Equivalent

• BS in Computer Science or Information Systems

Experience or Equivalent

• 5+ years Linux Administration experience
• 2+ years Hadoop / Big-Data experience, Cloudera distribution preferred
• Experience supporting an enterprise distributed data processing platform, or equivalent training.

Knowledge, Skills, and Abilities Requirements

• Troubleshoot common problems with Hadoop core services (HDFS, YARN, etc.) and ecosystem projects (Spark, Hive, Impala, MapReduce, etc.)

Strong working knowledge of:
• TCP/IP networking concepts, including subnets and routing
• Security including Kerberos, SSL/TLS, AD/LDAP
• Linux (Red Hat/Centos 6/7), system commands, and administrative tools
• Python and Bash scripting
• MySQL and SQL Queries
• Good oral and written communication skills, combining attention to detail with the ability to present technical findings to a business audience
• Excellent client service skills including the ability to take ownership of escalated issues, provide clear and consistent updates, and work with various internal teams until issues are fully resolved.