Manifest Solutions is currently seeking a Data Integration Engineer for a remote position.
- Integrate data feeds from various healthcare data providers
- Analyze incoming healthcare data, ensure that the data meets specifications
- Write new SQL based pipelines to bring patient data into our platform
- Troubleshoot existing pipelines using AWS services (EKS, Glue, S3), Databricks, Datadog
- Create tools and processes to facilitate data accessibility across products and data consumers
- Cultivate expertise on various datasets and tooling within the organization
Qualifications
2-5 years of experienceStrong ability to learn new technologiesCuriosity about datasets and what makes high quality dataGeneral understanding of ETL best practices, data qualityA strong knowledge of SQL and have worked with a data warehouse system - Databricks is a plusExperience working with Python and PySparkExperience, DBT, airflow, dagster or similar technologies a plus