Previous Job
Previous
Hadoop Admin
Ref No.: 17-06074
Location: Waukegan, Illinois
Position Type:Contract
Start Date: 07/07/2017
 
Hadoop Administrator:
 
Job Summary:
 
Hadoop Administrator with relevant 4 + yrs of exp. working on implementation and support of ongoing administration of Hadoop infrastructure  with experiences on Installation, configuration, deployment, maintenance, monitoring and troubleshooting Hadoop clusters on AWS cloud or on-prem infrastructure using primarily Cloudera distribution .
 
Responsibilities/Qualifications :
 
·         Responsible fpr supporting and administration of Hadoop infrastructure.
·         Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals/Active Directory authentication authorization and testing HDFS, Hive, Pig and MapReduce access for the new users.
·         Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Cloudera Manager Enterprise, Dell Open Manage and other tools.
·         Performance tuning of Hadoop clusters and Hadoop application routines.
·         Screen Hadoop cluster job performances and capacity planning and propose hardware and software environments required for Hadoop to expand existing environments.
·         Automate the Monitor Hadoop cluster connectivity and security with good knowledge of Virtual Private cloud.
·         Manage and review Hadoop log files.
·         Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.
·         Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.
·         Must have experience with backup and recovery of configuration, metadata & application data and files with knowledge on setup of disaster recovery env with ability to restore with minimum downtime.
·         Point of Contact for Vendor escalation
·         Prior experience supporting and administering Unix/Linux platform and infrastructure.
·         Must have strong experiences in  Linux (Shell Scripting), Hadoop eco system apache software, Web Micro Services, AWS CLI, Cloudera Distribution with Strong communication and collaboration skills
·         Certification in  Cloudera/Hadoop a huge plus