Job Title: Data Engineer
Job ID: 150409
Duration: 12+ Months (W2 Only)
Location: Remote Role


Job Description:

Job Summary
We are seeking a highly skilled Azure Data Engineer with deep expertise in Azure Databricks, Azure Data Factory, and ETL automation. The ideal candidate will have extensive experience designing and optimizing large-scale data pipelines, working with PHI/PII / HIPAA-protected healthcare data, and implementing secure, compliant, and efficient data processing solutions in the cloud.

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines using Azure Databricks and Azure Data Factory.
• Build and optimize data lakes and backend architectures for large datasets.
• Collaborate with data architects, DBAs, product owners, and stakeholders to align technical solutions with business needs.
• Develop ETL automation processes in Python and Databricks, focusing on performance, scalability, and reliability.
• Ensure HIPAA compliance when working with PHI/PII by implementing data privacy and security measures (e.g., tokenization, encryption).
• Integrate data across systems, including using middleware solutions such as MuleSoft for SAP-to-Databricks processing.
• Drive data transformation and automation initiatives to support advanced analytics and reporting needs.

Required Qualifications

• 5+ years experience in Azure Databricks and ETL development.
• Strong experience with Azure Data Factory for data orchestration and automation.
• Proven expertise in ETL automation for large, complex datasets.
• Solid Python programming skills for data engineering tasks.
• Experience working with healthcare or pharma data, including PHI/PII, and ensuring compliance with HIPAA.
• Strong understanding of data lake architectures and large-scale data processing in Azure.

Preferred Skills

• Experience with MuleSoft or other middleware for system integrations.
• Familiarity with SAP data integration in a cloud environment.
• Strong problem-solving and performance optimization skills in big data environments.

What Will Set You Apart

• Demonstrated success in healthcare data engineering projects with strict compliance requirements.
• Proven track record of delivering high-performance, automated ETL solutions in Azure.