Previous Job
Previous
Data Engineer - 18-00673
Ref No.: 18-00673
Location: Chevy Chase, Maryland
Position Type:Right to Hire
Start Date: 03/15/2018
Data Engineer – Big Data 

Day to Day responsibilities are below :
  • Develop ETL/ELT jobs on the Hadoop platform using Spark and other BigData technologies
  • Develop and use frameworks for data transformation
  • Create and schedule jobs with Ozzie and other job coordinators
  • Monitor and optimize transformation logic
  • Testing and documenting results
  • 3 years of hands-on experience in Hadoop Eco System (HDFS AND YARN AND MapReduce AND Oozie AND Hive)
  • 2 years of hands-on experience in Data Warehousing AND Data Marts AND Data/Dimensional Modeling AND ETL
  • 2 year of hands-on experience in Spark core AND Spark SQL
  • 5 years of hands-on programming experience in core Java
Desired Skills :
  • Experience in any one of the ETL tools such as Abinitio Talend, or Kettle
  • Hadoop OR NoSQL performance optimization and benchmarking using tools such as HiBench OR YCSB
  • Experience on continuous build and test process using tools such as Maven AND Jenkins
  • Understanding of Kafka AND Spark Streaming