Previous Job
Sr. Python Data Engineer
Ref No.: 18-02205
Location: NY, New York
Position Type:Full Time
Pay Rate : $ 175,000.00 /Year
Sr. Python Data Engineer
Start up Environment
$150-175k base salary + equity
Our client is a New York-based startup laser-focused on improving healthcare infrastructure with revolutionary technology.  We are looking for a talented Sr. Python Data Engineer to lead our ingestion pipeline and help automate our data platform.
You'll join and work with a team of talented engineers who enjoy solving tough problems and improving the healthcare industry. We believe in supporting both personal and professional growth. That means, we pay attention to goals, celebrate milestones and highly encourage learning opportunities.
Role and Responsibilities:
1) Assume ownership of the data ingestion and ETL pipeline. This means ensuring that data is being munged and ingested correctly, capturing exceptions, implementing a system to notify stakeholders when those exceptions occur, and instrumenting all elements of the pipeline stack. You will also iterate on our current architecture to make it more efficient and fault tolerant - the goal is to have a pipeline which can ingest new data from any source with minimal reconfiguration.
2) Maintain concurrency between our services and our data warehouse, and work with our data scientist and provide engineering support for our machine-learning engine to match providers to their credentials.
3) Build tools to facilitate on-boarding our customers' data and enable our operations team to change and view that data. You'll be the point of contact for the operations team when there are technical requests that specifically impact our data pipeline.
As our platform grows, so too does the need for a high-performance ETL pipeline and a scalable framework for storing that data and making it accessible for our customers and operations team.
  • 3-5 years professional software development experience
  • Experience building and maintaining robust python data infrastructure
  • Outstanding coding skills and knowledge of patterns and best practices in software engineering
  • Working knowledge and opinions of latest tools for data collection, analysis, warehousing and transformation
  • Good, open communicator. Your code/scripts should not be the only thing that speaks for your work.
  • Familiarity with Docker, Postgres, AWS, and Kafka