Previous Job
Previous
Big Data ETL Developer
Ref No.: 17-02566
Location: New York, New York
Position Type:Full Time
Pay Rate : $ 130,000.00 - 140,000.00 /Year
Big Data ETL Developer

Position Overview
As a Big Data ETL Developer you will be designing and implementing systems that crunch and process billions of records a day and make them available in our analytics platform, helping our clients to make smarter decisions that continuously improve their ad-impression quality.
You will develop ETL processes on both home-grown and 3rd party frameworks, perform data analysis and will join a team of engineers responsible for our external reporting and data delivery systems

Specific Responsibilities
  • Developing ETL processes that process billions of records a day efficiently
  • Delivering insightful data to clients, partners and internal users in various ways by implementing robust, scalable data delivery applications and APIs.
  • Collaborating and participating in project meetings.
  • Analyzing data to test the correctness and effectiveness of ETL processes
Position Requirements:
  • At least 2 years hands-on experience of ETLs development
  • At least 2 years working in a DWH environment including schema design and data modeling
  • Hands-on development experience in python
  • Experience in one or more of the following technologies: Hadoop, Spark, Hive, Pig
  • Experience working with Reporting systems
  • Advanced SQL query writing abilities and data understanding
  • Excellent communication skills and a team player
  • Experience with GoodData CloudConnect is a plus
  • Experience with Vertica or other columnar data stores is a plus
  • Hands on experience with Spark Streaming or other live stream processing technology - a plus