Talent.com
Senior Data Engineer

Senior Data Engineer

Insomniac DesignWashington, District of Columbia, United States
30+ days ago
Job type
  • Full-time
Job description

As a Senior Data Engineer, you will architect, build, and optimize scalable data platforms that empower our clients with unified, actionable insights. You will lead the design of robust data pipelines, enforce best practices in data governance and security, and mentor junior engineers. Your expertise will bridge technical execution and strategic vision, ensuring high-performance, secure, and scalable data solutions that drive business impact.

Technical Leadership & Strategy :

  • Architect and implement enterprise-grade data platforms, including data lakes, warehouses, and real-time pipelines.
  • Define and enforce data engineering standards, including ETL / ELT frameworks, data modeling, and quality controls.
  • Lead performance optimization of databases, queries, and pipelines (e.g., partitioning, indexing, cost-efficient cloud solutions).
  • Stay updated with emerging trends, evaluating and integrating new technologies.

Data Architecture & Infrastructure :

  • Design and implement scalable data architecture that ensures high availability, security, and performance.
  • Define best practices for data modeling, storage, retrieval, and governance.
  • Optimize database structures, schemas, indexing, and partitioning for efficient query performance.
  • Implement CI / CD for data pipelines and automate infrastructure using Infrastructure-as-Code (IaC) tools.
  • Data Pipelines & ETL Development :

  • Architect and develop end-to-end ETL / ELT pipelines for structured and unstructured data ingestion, processing, and transformation.
  • Automate and optimize data workflows using tools like Apache Spark, Kafka, Airflow, and dbt.
  • Monitor, troubleshoot, and optimize data pipeline performance.
  • Data Governance, Security & Compliance :

  • Implement data governance policies, including metadata management, lineage tracking, and role-based access control (RBAC).
  • Ensure compliance with data privacy regulations (e.g., GDPR, CCPA) and enforce security best practices.
  • Develop frameworks for data quality validation, anomaly detection, and integrity checks.
  • Business & Stakeholder Engagement :

  • Collaborate with stakeholders (clients, PMs) to translate business needs into technical specifications and scalable architectures.
  • Develop interactive dashboards and reporting solutions to provide actionable insights.
  • Innovation & Mentorship :

  • Lead technical discussions, workshops, and knowledge-sharing sessions within the team.
  • Mentor junior engineers, conduct code reviews, and set best practices.
  • Drive automation of data workflows, including CI / CD for pipelines and Infrastructure-as-Code (IaC) solutions.
  • Technical Skills & Experience :

  • 7+ years of experience in data engineering with a proven track record of building scalable data solutions.
  • Expertise in SQL and relational database management systems (MySQL, PostgreSQL, Oracle).
  • Proficiency in Python (or similar languages) for data processing and automation.
  • Deep understanding of cloud platforms (AWS, GCP, Azure) and cloud-native data services : AWS (Redshift, Glue, S3)Azure (Synapse, Data Factory)GCP (BigQuery, Dataflow)
  • Hands-on experience with big data tools : Apache Spark, Kafka, Airflow, dbt, Snowflake, Databricks
  • Expertise in data modeling.
  • Strong knowledge of data security, governance, and compliance frameworks.
  • Leadership & Soft Skills :

  • Proven track record of leading data projects, including migrations, warehousing, and real-time analytics.
  • Ability to lead cross-functional teams and manage client expectations.
  • Strong problem-solving skills for debugging distributed systems and resolving data anomalies.
  • Experience with Agile / Scrum methodologies, including tools like Jira, Git.
  • Excellent communication and stakeholder management skills.
  • Nice-to-Have (Bonus Skills) :

  • Certifications in cloud / data technologies (e.g., AWS Certified Data Analytics, Google Cloud Data Engineer).
  • Experience with ML pipelines (e.g., feature stores, model deployment).
  • Contributions to open-source data projects.
  • Applicant Eligibility :

    Please note, candidates who are eligible to work in the US without visa sponsorship are eligible to apply. We are not accepting applicants from recruiters or staffing agencies

    Create a job alert for this search

    Senior Data Engineer • Washington, District of Columbia, United States

    Related jobs
    • Promoted
    Senior Data Engineer - Financial Substantiation Platform •Hybrid •

    Senior Data Engineer - Financial Substantiation Platform •Hybrid •

    GEICOWashington, DC, United States
    Full-time
    At GEICO, we offer a rewarding career where your ambitions are met with endless possibilities.Every day we honor our iconic brand by offering quality coverage to millions of customers and being the...Show moreLast updated: 1 day ago
    • Promoted
    Senior Cloud Engineer

    Senior Cloud Engineer

    LeidosAlexandria, VA, US
    Full-time
    At Leidos, we’re more than a technology company—we’re a trusted partner pioneering the future of defense and intelligence. Our diverse teams of innovators unite around a common mis...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Viasat Government

    Data Engineer - Viasat Government

    ViasatGermantown, MD, United States
    Full-time
    At Viasat, we're on a mission to deliver connections with the capacity to change the world.For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries arou...Show moreLast updated: 21 days ago
    Senior Data Engineer (Databricks)

    Senior Data Engineer (Databricks)

    Infinitive IncAshburn, VA, US
    Full-time
    Quick Apply
    Candidates must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and ...Show moreLast updated: 30+ days ago
    Senior Data Engineer (Python / PySpark / AWS)

    Senior Data Engineer (Python / PySpark / AWS)

    Infinitive IncAshburn, VA, US
    Full-time
    Quick Apply
    Candidates must be local to the Washington D.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial ...Show moreLast updated: 30+ days ago
    Data Engineer (REL) 16139

    Data Engineer (REL) 16139

    QED NationalUSA, Virginia, Vienna
    Full-time
    Tysons, VA / Winchester, VA / Pensacola, FL (Hybrid).We're seeking a Data Engineer to design, develop, and optimize data pipelines and cloud-based data systems that enable seamless data collection,...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer AzureDynamics 365

    Senior Data Engineer AzureDynamics 365

    AHU Technologies IncWashington, DC, United States
    Full-time
    Client is seeking a Senior Data Engineer for managing and optimizing data services across Azure / Dynamics 365 and legacy Oracle Database environments. This role oversees Microsoft Dataverse, Azure Da...Show moreLast updated: 5 days ago
    • Promoted
    Senior Zero Trust Data Analytics Engineer

    Senior Zero Trust Data Analytics Engineer

    Govcio LLCAlexandria, VA, United States
    Full-time
    Overview : GovCIO is currently hiring a senior-level Zero Trust Data Analytics Engineer to join our team, supporting a critical program with the U. This position is located in Alexandria, VA and will...Show moreLast updated: 4 days ago
    • Promoted
    Senior Cloud Engineer Architect AWS

    Senior Cloud Engineer Architect AWS

    Leidos IncFort Belvoir, VA, United States
    Full-time
    Leidos Digital Modernization Sector is seeking an experienced.Senior Cloud Engineer Architect (AWS).The I3TS program provides enterprise-wide IT support to enable DTRA's Information Management & Te...Show moreLast updated: 7 days ago
    • Promoted
    Senior Sales Engineer

    Senior Sales Engineer

    CienaHanover, MD, United States
    Full-time
    As the global leader in high-speed connectivity, Ciena is committed to a people-first approach.Our teams enjoy a culture focused on prioritizing a flexible work environment that empowers individual...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Leidos IncSterling, VA, United States
    Full-time
    At Leidos, we deliver innovative solutions through the efforts of our diverse and talented people who are dedicated to our customers' success. We empower our teams, contribute to our communities, an...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Cloud Engineer Architect Azure

    Senior Cloud Engineer Architect Azure

    Leidos IncFort Belvoir, VA, United States
    Full-time
    Leidos Digital Modernization is seeking an experienced.Senior Cloud Engineer Architect (Azure).The I3TS program provides enterprise-wide IT support to enable DTRA's Information Management & Technol...Show moreLast updated: 7 days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    KamisProWashington, DC, United States
    Full-time
    This role centers on breaking down data silos, automating processes, and ensuring reliable data delivery to support critical business decisions. The engineer will lead initiatives to enhance data pi...Show moreLast updated: 2 days ago
    • Promoted
    Principal Data Platform Engineer

    Principal Data Platform Engineer

    Southern New Hampshire UniversityBaltimore, MD, United States
    Full-time
    Southern New Hampshire University is a team of innovators.Individuals who believe in progress with purpose.Since 1932, our people-centered strategy has defined us - and helped us grow a team that n...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior Staff Systems Engineer - EW Analyst

    Senior Staff Systems Engineer - EW Analyst

    Northrop GrummanBaltimore, Maryland, US
    Full-time
    RELOCATION ASSISTANCE : Relocation assistance may be available CLEARANCE TYPE : Secret TRAVEL : Yes, 10% of the Time Description At Northrop Grumman, our employees have incredible opportunities to...Show moreLast updated: 8 hours ago
    Senior Data Engineer (Databricks Pro Certified)

    Senior Data Engineer (Databricks Pro Certified)

    Infinitive IncAshburn, VA, US
    Full-time
    Quick Apply
    Candidates must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (Azure / Dynamics 365)

    Senior Data Engineer (Azure / Dynamics 365)

    AHU Technologies IncWashington, DC, United States
    Full-time
    Client is looking for a resource to provide high-level data engineering administration expertise to support Dynamics 365 / Azure data services, including Dataverse management, Azure Data Factory mana...Show moreLast updated: 5 days ago
    • Promoted
    Senior Staff Systems Engineer – EW Analyst

    Senior Staff Systems Engineer – EW Analyst

    Northrop GrummanRandallstown, MD, United States
    Full-time
    RELOCATION ASSISTANCE : Relocation assistance may be available.At Northrop Grumman, our employees have incredible opportunities to work on revolutionary systems that impact peoples lives around the...Show moreLast updated: 3 days ago