Senior Data Engineer - Azure Databricks

We are seeking an accomplished Senior Data Engineer with deep expertise in Azure Databricks, advanced data engineering, and healthcare data science . This role is critical to our mission of leveraging data to transform healthcare outcomes. The ideal candidate will have a proven ability to design and scale enterprise-grade data pipelines, optimize workflows in the cloud, and deliver predictive insights that directly impact patient care and operational efficiency.

As part of our data engineering team, you will collaborate with data scientists, analysts, and software engineers to deliver secure, high-performance solutions that adhere to healthcare standards and compliance requirements.

Key Responsibilities

• Design, build, and optimize scalable ETL / ELT pipelines in Azure for diverse healthcare data, including EHR, claims, IoT, and unstructured sources.
• Implement advanced data storage and processing solutions leveraging Azure Data Lake, Synapse Analytics, Databricks, and Azure SQL.
• Partner with data scientists to develop, deploy, and operationalize machine learning models and predictive analytics solutions supporting healthcare use cases.
• Ensure data quality, governance, security, and compliance with HIPAA, PHI / PII, and other healthcare regulations.
• Automate workflows using Azure Data Factory, Databricks jobs, and CI / CD pipelines to enhance reliability and reduce manual effort.
• Monitor, troubleshoot, and fine-tune production pipelines for scalability, cost efficiency, and high availability
• Collaborate cross-functionally to translate business needs into robust technical solutions, aligning data engineering practices with healthcare standards (FHIR, HL7).
• Contribute to the evolution of our data architecture strategy , incorporating best practices for cloud optimization, data governance, and emerging healthcare data trends.

Required Skills & Qualifications

Preferred Qualifications

Why Join Us?

At Kanini, you will have the opportunity to :