Previous Job
Previous
Hadoop Cluster Admin
Ref No.: 17-19718
Location: Portland, Oregon
Detailed Job description:
Hadoop Cluster Admin - Job duties
1. Manage Hadoop and Spark cluster environments - Cluster sizing, cluster configuration, smoke testing, service allocation, security setup, performance tuning and ongoing monitoring
2. Contribute to planning and implementation of hardware and software upgrades
3. Work with IT Operations and Information Security teams on monitoring and troubleshooting of incidents to maintain service levels
4. Report resources/services utilization and performance metrics to user communities
5. Research and provide recommendations on automating administration tasks
6. Provide guidance and setup Disaster Recovery environment
7. Provide guidance on Hadoop cluster setup on AWS/Azure cloud environment (scaling, security etc)
8. Provide support to coordinate with Vendor teams on installation, bus fixes, upgrades and escalations
9. Provide support to Data Engineering teams on deployment of Hadoop/Spark jobs (DevOps model support) and on performance tuning
10. Contribute to the evolving systems architecture to meet changing requirements for scaling, reliability, performance, manageability and cost
Experience
4+ years hands-on experience with supporting Hadoop/Spark ecosystem technologies in production
2+ years hands-on development / administration experience on Hive, Hbase and Kafka
Experienced with networking/Security infrastructure including VLAN, firewalls, Kerberos, LDAP etc
Extensive experience in administering Red Hat Enterprise Linux environment
Extensive experience in administering Horton works or Cloudera Hadoop distribution
Experience in setting up security features within Hadoop cluster
Experience in setting up Disaster Recovery environment
Experience in setting up Hadoop cluster on cloud (optional)
Familiarity with Version Control tools such as git
Familiarity with Scripting (shell, perl, ruby etc)