Previous Job
Previous
Data Engineer
Ref No.: 18-03073
Location: New York, New York
Position Type:Full Time
Pay Rate : $ 130,000.00 /Year
Our client is looking for a Data Engineer/Data Manager to enhance the learning experience for thousands across the five boroughs of NYC by becoming the glue that binds together hundreds of disparate data sources and third-party APIs. Imagine working for a company that has the iterative, constant improvement practices of a startup. Our data team is at the heart of how this organization operates.

Key responsibilities include:

-Building scalable and reliable data pipelines in Python by leveraging data processing technologies like AWS, Spark, Airflow, etc.;
-Writing modular, reusable code in Python to build and enhance our data framework;
-Writing complex, high performing SQL queries against Postgres, MySQL, and MSSQL databases; and
-Interfacing with third-party APIs to collect data from various sources and transform them into our central data warehouse.

A successful applicant will have the following experience and characteristics:

-Experience with data warehousing, streaming architecture, machine learning pipeline and workflow scheduling with Airflow;
-Experience with service-oriented architectures and interfacing with third-party APIs;
-A high level of comfort using Python data libraries, particularly Pandas and SQLAlchemy;
-Experience with Python web development frameworks (Flask, Django, or Pyramid);
-Experience with data analysis and visualization methods;
-Seeks a fast paced, collaborative environment with capacity to work with multiple teams to complete a variety of projects;
-Has 3-5 years of experience on a data science team
-Has a strong interest in education reform and working for a mission driven organization.