Job Description :
Title : Data Engineer - EDI
Location : New York, NY (100% Remote)
Duration : 3-4 Months (C2H)
Summary :
The Senior Data Engineer designs and leads scalable data architectures and pipelines to support analytics and business intelligence. This role focuses on data optimization, workflow automation, and ensuring reliable data operations in a cloud-based environment.
Minimum Qualifications
- 8+ years of IT experience, with 5+ years in :
- Python, PySpark, and SQL for big data processing
- Data lakes (Iceberg format), ETL (Informatica), and data quality
- AWS services : S3, Glue, Redshift, Lambda, EMR, Airflow, Postgres
- BASH / Shell scripting
- Experience with healthcare data and leading data teams
- Agile development experience
- Strong problem-solving and communication skills
Responsibilities
Design and maintain scalable data pipelines and architecturesLead data projects and ensure best practicesCollaborate across teams to meet data needsEnsure data quality and system reliability in production environmentsOptimize data systems for analytics and reporting