Previous Job
Previous
Data Engineer
Ref No.: 18-05588
Location: New York, New York
Position Type:Direct Placement
Pay Rate : $ 110,000.00 - 150,000.00 /Year
Data Engineer

Role and Responsibilities:
  • Assume ownership of the data ingestion and ETL pipeline. This means ensuring that data is being munged and ingested correctly, capturing exceptions, implementing a system to notify stakeholders when those exceptions occur, and instrumenting all elements of the pipeline stack.
  • Build tools to facilitate on-boarding our customers' data and enable our team to change and view that data. You'll be the point of contact for the operations team when there are technical requests that specifically impact our data pipeline.
  • As our platform grows, so too does the need for a high-performance ETL pipeline and a scalable framework for storing that data and making it accessible for our customers and operations team.

Requirements:
  • 3-5 years professional software development experience
  • Experience building and maintaining robust python data infrastructure
  • Outstanding coding skills and knowledge of patterns and best practices in software engineering
  • Working knowledge and opinions of latest tools for data collection, analysis, warehousing and transformation
  • Good, open communicator. Your code/scripts should not be the only thing that speaks for your work.
  • Familiarity with Docker, Postgres, AWS, and Kafka, Red shift
  • Experience with Scala/C++ is a plus