Previous Job
Previous
Hadoop Spark Developer
Ref No.: 17-07117
Location: Atlanta, Georgia
Start Date: 11/02/2017
Hadoop Spark Developer Job Description:
Job Description
• Translate complex functional and technical requirements into detailed design
• Proficiency in SPARK for technical development and implementation
• Load disparate data sets by leveraging various big data technology (Kafka)
• Ability to utilize Hive, Spark, Cassandra, MLlib, Typescript,NodeJS, Pyspark, Eclipse
• Contribute and adhere to the best engineering practices for source control, release management, deployment, etc.
• Participate and facilitate in production support, job scheduling/monitoring
• Perform machine learning(supervised & unsupervised), natural language, and statistical analysis methods, such as classification, collaborative filtering, association rules.
• Experience designing and developing data ingestion and processing/transformation frameworks leveraging tools such as ADF, NiFi, Sqoop, Eclipse
• Should have worked in Big data space for at least 5 years in Apache Spark, Hive and MapReduce. Experience with a variety of Big Data ETL tools, e.g. Spark, Hive, Kafka, Sqoop, MapReduce, Scala, Zookeeper, Etc
• Should have experience in Cloudera or Hortonworks and exposure to Teradata is beneficial.

Qualifications
• B.S. and M.S. in mathematics, computer science or engineering
• 5+ years of Python, Java/ Scala.
• 3+ years of demonstrated technical proficiency with SPARK, big data projects, and experience in data modeling.