Previous Job
Previous
Senior Big Data ETL Developer
Ref No.: 17-02570
Location: New York, New York
Position Type:Full Time
Pay Rate : $ 140,000.00 - 150,000.00 /Year
Senior Big Data ETL Developer
 
Position Overview
As a Senior Big Data ETL Developer you will be designing and implementing systems that crunch and process billions of records a day and make them available in the company's analytics platform, helping our clients to make smarter decisions that continuously improve their ad-impression quality.
You will develop ETL processes on both home-grown and 3rd party frameworks, perform data analysis and will join a team of engineers responsible for our external reporting and data delivery systems
This is a full-time position and located in our New York City offices.
 
Specific Responsibilities:
  • Developing ETL processes that process billions of records a day efficiently
  • Delivering insightful data to clients, partners and internal users in various ways by implementing robust, scalable data delivery applications and APIs.
  • Collaborating and participating in project meetings.
  • Analyzing data to test the correctness and effectiveness of ETL processes.
Position Requirements:
  • At least 4 years hands-on experience of ETLs development
  • At least 4 years working in a DWH environment including schema design and data modeling
  • Hands-on development experience in python
  • Experience in one or more of the following technologies: Hadoop, Spark, Hive, Pig
  • Experience working with Reporting systems
  • Advanced SQL query writing abilities and data understanding
  • Excellent communication skills and a team player
  • Experience with GoodData CloudConnect is a plus
  • Experience with Vertica or other columnar data stores is a plus
  • Hands on experience with Spark Streaming or other live stream processing technology - a plus