Previous Job
Previous
Hadoop Administrator
Ref No.: 18-75609
Location: Pennington, New Jersey
Position Type:Full Time/Contract
Start Date: 10/11/2018
Hadoop Administrator
Pennington, NJ
Fulltime

Job Description:
•Deploying a hadoop cluster, maintaining a hadoop cluster, adding and removing nodes using cluster monitoring tools like Cloudera Manager, configuring the NameNode high availability and keeping a track of all the running hadoop jobs.
•Implementing, managing and administering the overall hadoop infrastructure.
•Deep level understanding on Hbase, zookeeper and Yarn processes.
•Takes care of the day-to-day running of Hadoop clusters
•Work closely with the database team, network team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected.
•Responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop cluster.
•Responsible for deciding the size of the hadoop cluster based on the data to be stored in HDFS.
•Ensure that the hadoop cluster is up and running all the time.
•Monitoring the cluster connectivity and performance.
•Manage and review Hadoop log files.
•Backup and recovery tasks
•Resource and security management
•Troubleshooting application errors and ensuring that they do not occur again