Previous Job
Engr 3, Software
Ref No.: 18-34192
Location: San Diego, California
Position Type:Contract
Job Category:Engineering
Benefits:401K, Dental Insurance, Life Insurance, Medical Insurance, Vision Insurance
Position: Principal Software Engineer - Devops and Hadoop Administrator
Location: San Diego, CA
Contract Term: 12 Months
Pay Rate: $63.00/hour
Schedule: 40 Hours/Week
Screenings: Background and drug screening prior to start date
Benefits: ACA Compliant Benefits Available

  • The Devops and Hadoop Administrator is responsible for the design and administration of a Hadoop data lake to support the use of services throughout the Hadoop ecosystem.
  • This includes system architecture to support various product implementations and strategic objectives for the organization.
  • This position requires extensive hands-on experience managing a Linux-based distributed data processing platform.

• Day to day operational support of our Cloudera Hadoop clusters in lab and production environments.
• Collaborate with Product Management, IT Architecture, and Engineering to review enhancements and provide design feedback.
• Make recommendations to improve process efficiency and effectiveness.
• Respond to health alerts generated by Cloudera Manager
• Respond to emergency incidents and standard support requests, working them through to completion within established SLA.
• Collaborate with multiple internal teams to resolve incidents and support requests.
• Improve tools and scripts that automate routine tasks and monitor system health.
• Work effectively with our vendor to support and diagnose complex issues, apply patches, updates, etc.

• BS in Computer Science or Information Systems
• 5+ years Linux Administration experience
• 2+ years Hadoop / Big-Data experience, Cloudera distribution preferred
• Experience supporting an enterprise distributed data processing platform, or equivalent training.

• Troubleshoot common problems with Hadoop core services (HDFS, YARN, etc.) and ecosystem projects (Spark, Hive, Impala, MapReduce, etc.)
• TCP/IP networking concepts, including subnets and routing
• Security including Kerberos, SSL/TLS, AD/LDAP
• Linux (Red Hat/Centos 6/7), system commands, and administrative tools
• Python and Bash scripting
• MySQL and SQL Queries
• Good oral and written communication skills, combining attention to detail with the ability to present technical findings to a business audience
• Excellent client service skills including the ability to take ownership of escalated issues, provide clear and consistent updates, and work with various internal teams until issues are fully resolved.