Talent.com
Lead Data Engineer
Lead Data EngineerC The Signs • Boston, Massachusetts, United States
Lead Data Engineer

Lead Data Engineer

C The Signs • Boston, Massachusetts, United States
11 days ago
Job type
  • Full-time
Job description

We are seeking a Lead Data Engineer to architect, build, and scale our next-generation healthcare data platform. In this role, you will lead the effort to design robust pipelines, modernize data architecture, and ensure high-quality ingestion and transformation of clinical and operational data. You’ll collaborate closely with product, analytics, clinical informatics, machine learning, and engineering teams to deliver trusted, timely, and compliant insights.

This is a hands-on leadership role ideal for someone who enjoys setting technical direction while still contributing code and guiding stakeholders through complex healthcare data challenges.

Responsibilities

Architecture & Strategy

  • Lead design and evolution of our cloud-native data platform built primarily on Google Cloud Platform, including BigQuery, Cloud Storage, Pub / Sub, Cloud Run, Airflow (Cloud Composer), and Healthcare API.
  • Inform strategic decisions around multi-cloud or AWS interoperability when needed.
  • Establish data engineering best practices, coding standards, and architectural patterns.

Pipeline Development

  • Build scalable ETL / ELT pipelines using dbt for transformations and Airflow for orchestration.
  • Develop ingestion pipelines for clinical and administrative data in HL7, FHIR, DICOM, and custom formats.
  • Develop ingestion and transformation pipelines to be used for AI / ML development and model training.
  • Implement streaming and batch dataflows using Pub / Sub, Dataflow, and serverless compute.
  • Support or guide integrations with AWS-based partner systems or AWS-hosted data sources when applicable.
  • Data Modeling & Warehousing

  • Design and maintain BigQuery datasets, semantic layers, and warehouse structures.
  • Leverage industry standards such as FHIR resources for canonical healthcare models.
  • Provide guidance on data modeling and warehouse best practices across both GCP and AWS ecosystems.
  • Data Quality, Observability & Governance

  • Implement data quality frameworks, automated testing, and monitoring.
  • Ensure HIPAA compliance and proper handling of PHI / PII across all pipelines and cloud environments.
  • Drive lineage, documentation, metadata governance, and dbt docs adoption.
  • Leadership & Collaboration

  • Partner with analytics, product, clinical informatics, and security teams to deliver high-quality, trustworthy data products.
  • Provide oversight and technical direction for multi-cloud data integrations with AWS-based systems or partners.
  • Assist in the recruitment and development of junior data engineers
  • 7+ years of data engineering experience; 2–3+ years in a lead or senior technical role.
  • Deep, hands-on expertise in GCP, particularly :
  • BigQuery
  • GCP Healthcare API (FHIR and DICOM stores)
  • Cloud Storage, Pub / Sub, Cloud Run / Functions
  • Strong proficiency with :
  • dbt (Core or Cloud)
  • Airflow (Cloud Composer or self-managed)
  • Python and advanced SQL (BigQuery preferred)
  • Hands-on experience with healthcare standards :
  • FHIR (R4 / US Core), HL7 v2 / v3, DICOM, C-CDA, X12
  • Strong understanding of PHI handling, HIPAA compliance, and healthcare interoperability.
  • Preferred

  • AWS experience, especially with :
  • Redshift, Lambda, S3, Glue, Kinesis, Athena, API Gateway, Step Functions
  • Experience building or maintaining multi-cloud pipelines bridging GCP and AWS.
  • Background with Dataflow / Beam or other stream processing frameworks.
  • Experience working with EHR integrations, claims processing, HIEs, or clinical data networks.
  • Familiarity with ML-enabled data pipelines or feature engineering in healthcare contexts.
  • Why Join Us?

    Joining  C the Signs  is not just about building AI; it’s about shaping the future of healthcare. If you are a technical leader with an unshakable belief in the power of AI to save lives and the ability to make it happen at scale, this is your opportunity to create a tangible, global impact.

    Benefits :

  • Competitive salary and benefits package.
  • Flexible working arrangements (remote or hybrid options available).
  • The opportunity to work on life-changing AI technology that directly impacts patient outcomes.
  • Join a team that combines cutting-edge innovation with a mission to save lives and improve health equity.
  • Continuous learning opportunities with access to the latest tools and advancements in AI and healthcare.
  • Create a job alert for this search

    Lead Data Engineer • Boston, Massachusetts, United States

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Simplisafe • Boston, Massachusetts, United States
    Full-time
    SimpliSafe is a leading innovator in the home security industry, dedicated to making every home a safe home.With a mission to provide accessible and comprehensive security solutions, we design and ...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Ness Digital Engineering • Boston, MA, US
    Full-time
    Job Title : Lead Data Engineer / Data Architect.New York City, NY; Secondary location - Boston, MA (Onsite – 5 days / week). We are seeking an experienced Lead Data Engineer / Data Architect to spearhe...Show more
    Last updated: 30+ days ago
    Data Engineer

    Data Engineer

    Suno • Boston, Massachusetts, United States
    Full-time
    Suno is a music company for the next generation of creators.Its AI-powered platform makes it easy for anyone to create original music. Built by musicians and engineers, Suno empowers users to turn i...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer - Master Data & Cloud Solutions

    Lead Data Engineer - Master Data & Cloud Solutions

    Liberty Mutual Insurance • Boston, MA, United States
    Full-time
    A leading insurance company in Boston is seeking a Principal Data Engineer to design innovative solutions and lead master data management initiatives. You will leverage your expertise to improve cus...Show more
    Last updated: 6 days ago • Promoted
    Senior Sales Engineer

    Senior Sales Engineer

    LightPath • Wakefield, MA, United States
    Full-time
    Lightpath is one of the largest competitive local exchange carriers in the tri-state area.Weown and operate our infrastructure "from the ground up" by deploying over 20,000 route miles connecting 1...Show more
    Last updated: 30+ days ago • Promoted
    Data Security Engineer

    Data Security Engineer

    HPE • Andover, MA, United States
    Full-time
    This role has been designed as ‘’Onsite’ with an expectation that you will primarily work from an HPE office.Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people ...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Level99 Entertainment • Boston, Massachusetts, United States
    Full-time
    Level99 is a real-world gaming venue designed for adults, featuring over 50 mental and physical challenges in artistic environments. Games range from ninja warrior obstacle course style challenges t...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Topline Pro • Boston, Massachusetts, United States
    Full-time
    We’re building AI powered Shopify for service businesses.Up and running within minutes using Gen AI, our digital storefront products help pros get discovered, trusted, and booked repeatedly.CPO) wi...Show more
    Last updated: 6 days ago • Promoted
    GCP

    GCP

    Trans.eu • North Andover, MA, United States
    Full-time
    We are seeking a highly skilled professional with expertise in Google Cloud Platform (GCP), App.Engine, Data Store, Python, and BigQuery. The candidate will take ownership of an existing.This role r...Show more
    Last updated: 6 hours ago • Promoted • New!
    Data Engineer, Business Solutions

    Data Engineer, Business Solutions

    Audax Group • Boston, Massachusetts, United States
    Full-time
    Founded in 1999, Audax Group is a leading alternative investment manager with offices in Boston, New York, San Francisco, London and Hong Kong. With approximately $42 billion of assets under managem...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer

    Data Engineer

    Zapcom • Boston, Massachusetts, United States
    Full-time
    Design and deploy scalable ETL / ELT pipelines.EMRs, labs, IoT devices, data.FHIR / HL7 APIs), including Azure and Snowflake. Architect and optimize Microsoft Azure and Snowflake.MLOps) performance tun...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    The Brattle Group • Boston, Massachusetts, United States
    Full-time
    The Brattle Group, a privately held, global economics consulting firm, is looking for a.The Senior Data Engineer plays a pivotal role in shaping our data engineering practices, providing expert tec...Show more
    Last updated: 30+ days ago • Promoted
    Desktop Engineer Lead

    Desktop Engineer Lead

    TEKsystems • Andover, MA, United States
    Full-time
    Desktop Engineer Lead • •Location : • Andover, MA.Category : • Technical Support Manager / Supervisor.About the Role • We are seeking an experienced Desktop Engineer Lead to join our IT team in Andover, ...Show more
    Last updated: 13 days ago • Promoted
    Full Stack Engineer

    Full Stack Engineer

    forREAL • Danvers, MA, United States
    Full-time
    REAL is a modern platform that simplifies the leasing experience for both tenants and landlords.Tenants can browse listings, explore neighborhoods, take 3D tours, and complete the application proce...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Str • Woburn, Massachusetts, United States
    Full-time
    STR’s Intelligence division researches and develops advanced analytics and machine learning-based solutions to solve challenging problems related to national security. Our team consists of passionat...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer (Generative AI)

    Lead Data Engineer (Generative AI)

    Capital One • Boston, MA, United States
    Full-time +1
    Lead Data Engineer (Generative AI).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterati...Show more
    Last updated: 19 days ago • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Soteria Reinsurance Ltd. • Boston, MA, United States
    Full-time
    Job Description : Position Description : Builds solutions using Python.Leverages Snowflake and Amazon S3 as integral components of Cloud data storage to create efficient, scalable, and secure data pipe...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer : 24-03328 (No C2C) Local to MA candidates needed

    Data Engineer : 24-03328 (No C2C) Local to MA candidates needed

    Akraya Inc • North Reading, Massachusetts, United States
    Full-time
    Quick Apply
    Primary Skills : SQL (Expert), Data Modelling (Proficient), ETL (Expert), Python (Intermediate), AWS (Basic).Duration : 6 Months with possible extension. Location : North Reading, MA (Local candidates ...Show more
    Last updated: 30+ days ago