Previous Job
Previous
Hadoop Cluster Administration
Ref No.: 18-21146
Location: Dallas, Texas
Position Type:Direct Placement
Start Date: 03/29/2018
 • Hadoop Dev Ops Engineer
Responsibilities
 -Maintain healthy cluster supporting 24x7 production operations
 -Excellent troubleshooting and problem resolution skills for operational issues in the Cluster
- Proactive health monitoring of Hadoop Clusters
- Assist end users and application developers with issues using the Hadoop Cluster
- Setup, monitor, and maintain DR backups for the Hadoop Clusters
- Day-to-day operational support with a 24x7 on-call rotation
- Support in-house tools related to the use of Big Data Platforms
- Assist with Proof of Concept projects to validate Big Data/Messaging technologies
 -Configuration Management and Automation
-  Stay current with advancements in Hadoop and the Big Data Space in general
- Team player with excellent communication and interpersonal skills
 Requirements:
 -3+ years of experience with administering enterprise production Hadoop clusters
- Deep understanding of HDFS architecture and operations
 -Experience administering cluster in HA environment
- Experience with Kerberos
 -Deep Understanding of YARN and Application Scheduling (i.e. Capacity Scheduler)
 -Understanding of Map/Reduce principles on Hadoop
- Experience supporting Hive, Impala , HBase, MongoDB
- Experience maintaining large clusters
- Demonstrated proficiency with at least one scripting language (i.e. Bash, Python, Perl)
- System Administration experience on a Linux platform
- Ability to use OS and Network metrics to identify bottlenecks
 Additional Qualifications
 Experience with the Cloudera Hadoop distribution 
 Experience working in a secured Hadoop Cluster environment (Network access restrictions, Kerberos)
 Experience with OS Package creation and deployment (.rpm, .deb) 
 Experience using Chef, Puppet or Ansible for configuration management and automation of tasks
 Experience with Sentry service 
 Understanding Networking required to build high performing cluster
 Experience with Docker