Previous Job
Hadoop Admin
Ref No.: 18-02254
Location: Windsor, Connecticut
Responsibilities :
• Day to Day maintenance activities including but not limited to Log monitoring and cleanup, Cluster monitoring, deployments, production support and performance tuning
• Build and administer Cloudera Hadoop cluster in multiple environments involving Kafka, Zookeeper, Spark, Yarn, Hive, HBase, Impala, MapReduce, MySQL, Oozie, Solr and Nifi services
• Build, Tune and administer Search and Index frameworks like Solr and Elastic Search
• Build, Tune and administer HBase cluster in multiple environments
• Automate daily administrative tasks to guarantee high availability of systems, applications and data
• Troubleshoot issues with applications, services and clusters in multiple environments
• Implement and administer Active-Active cluster configuration for Disaster Recovery
• Manage cluster hardening activities with security implementation to enforce data governance for the data accessed by data scientists and analysts using Sentry and LDAP integration
• Performance tune cluster services in multiple environments
• Capacity planning for cluster upgrades
• Setup Monitoring and Alerting for applications and services on the clusters using tools like Splunk.
• Automate data and log backups and archival
• Automate log analysis and setup alerting
• Build, Maintain and administer clusters to support highly available and fast real-time streaming applications
• Daily communication with Business and Technical teams to understand the needs and build, maintain and support environments that help solve the use cases
• Cluster patching activities
• Cluster upgrades when required