Talent.com
Sensitive-Data Engineer

Sensitive-Data Engineer

Equilibrium Technologies LLCChantilly, VA, US
30+ days ago
Job type
  • Full-time
Job description

Job Description

Job Description

Description :

Active Top Secret / SCI Clearance with Polygraph (REQUIRED)

Are you passionate about harnessing data to solve some of the nation’s most critical challenges? Do you thrive on innovation, collaboration, and building resilient solutions in complex environments?

Join a high-impact team at the forefront of national security, where your work directly supports mission success. We're seeking a Data Engineer with a rare mix of curiosity, craftsmanship, and commitment to excellence. In this role, you’ll design and optimize secure, scalable data pipelines while working alongside elite engineers, mission partners, and data experts to unlock actionable insights from diverse datasets.

Requirements :

  • Engineer robust, secure, and scalable data pipelines using Apache Spark , Apache Hudi , AWS EMR , and Kubernetes
  • Maintain data provenance and access controls to ensure full lineage and auditability of mission-critical datasets
  • Clean, transform, and condition data using tools such as dbt , Apache NiFi , or Pandas
  • Build and orchestrate repeatable ETL workflows using Apache Airflow , Dagster , or Prefect
  • Develop API connectors for ingesting structured and unstructured data sources
  • Collaborate with data stewards, architects, and mission teams to align on data standards , quality, and integrity
  • Provide advanced database administration for Oracle , PostgreSQL , MongoDB , Elasticsearch , and others
  • Ingest and analyze streaming data using tools like Apache Kafka , AWS Kinesis , or Apache Flink
  • Perform real-time and batch processing on large datasets in secure cloud environments (e.g., AWS GovCloud , C2S )
  • Implement and monitor data quality and validation checks using tools such as Great Expectations or Deequ
  • Work across agile teams using DevSecOps practices to build resilient full-stack solutions with Python , Java , or Scala

Required Skills

  • Experience building and maintaining data pipelines using Apache Spark , Airflow , NiFi , or dbt
  • Proficiency in Python , SQL , and one or more of : Java , Scala
  • Strong understanding of cloud services (especially AWS and GovCloud ), including S3 , EC2 , Lambda , EMR , Glue , Redshift , or Snowflake
  • Hands-on experience with streaming frameworks such as Apache Kafka , Kafka Connect , or Flink
  • Familiarity with data lakehouse formats (e.g., Apache Hudi, Delta Lake, or Iceberg)
  • Experience with NoSQL and RDBMS technologies such as MongoDB , DynamoDB , PostgreSQL , or MySQL
  • Ability to implement and maintain data validation frameworks (e.g., Great Expectations , Deequ )
  • Comfortable working in Linux / Unix environments, using bash scripting , Git, and CI / CD tools
  • Knowledge of containerization and orchestration tools like Docker and Kubernetes
  • Collaborative mindset with experience working in Agile / Scrum environments using Jira , Confluence , and Git-based workflows
  • Create a job alert for this search

    Engineer • Chantilly, VA, US

    Related jobs
    • Promoted
    Data Engineer II

    Data Engineer II

    VirtualVocationsRockville, Maryland, United States
    Full-time
    A company is looking for a Data Engineer II to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management proced...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    The Swift GroupHerndon, VA, US
    Full-time
    Our capabilities include Software Development, Engineering & IT, Data Science, Cyber Enablement, Logistics, and Training. Founded in 2019, Swift supports Civilian, Defense, and Intelligence Comm...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsAlexandria, Virginia, United States
    Full-time
    A company is looking for a Senior Data Engineer to build and evolve data platforms and pipelines.Key Responsibilities Build, maintain, and optimize data pipelines and ETL processes for data movem...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    BarbaricumFort Belvoir, VA, US
    Full-time
    Barbaricum is a rapidly growing government contractor providing leading-edge support to federal customers, with a particular focus on Defense and National Security mission sets.We leverage more tha...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (Databricks)

    Senior Data Engineer (Databricks)

    Infinitive IncAshburn, VA, US
    Full-time
    Candidates must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Capital Technology GroupWashington, DC, US
    Full-time
    Capital Technology Group provides expert consulting services software development, digital transformation, human-centered design, data analytics and visualization, and cybersecurity.Our multidiscip...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Ten Mile Square TechnologiesArlington, VA, US
    Full-time
    Ten Mile Square is a high-end technology consulting firm where we are routinely called upon to solve some of the most challenging problems in computer science and software development.We are a cadr...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CitianWashington, DC, US
    Full-time
    Citian is a fast growing, venture backed SaaS technology company based in Washington, DC.Our software solutions revolutionize how our transportation systems – roads, rail, transit, bicycle, p...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Appian CorporationMcLean, VA, US
    Full-time
    We set high standards and live up to them, ensuring that everything we do is done with care and quality.We approach every challenge with ambition and commitment, holding ourselves and each other ac...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eSimplicityColumbia, MD, US
    Full-time
    Simplicity is a modern digital services company that partners with government agencies to improve the lives and protect the well-being of all Americans, from veterans and service members to childre...Show moreLast updated: 30+ days ago
    • Promoted
    Java Big Data Engineer

    Java Big Data Engineer

    VirtualVocationsAlexandria, Virginia, United States
    Full-time
    A company is looking for a Java / Big Data Engineer.Key Responsibilities Develop and manage API services on AWS using Java, Scala, or Kotlin Implement and optimize AWS services including Pyspark, ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer (Databricks Pro Certified)

    Senior Data Engineer (Databricks Pro Certified)

    Infinitive IncAshburn, VA, US
    Full-time
    Candidates must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer III

    Data Engineer III

    VirtualVocationsAlexandria, Virginia, United States
    Full-time
    A company is looking for a Data Engineer III.Key Responsibilities Drive cloud solutions utilizing Azure DevOps and Data Bricks Lead data stewardship workgroups and champion metadata and data qua...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsAlexandria, Virginia, United States
    Full-time
    A company is looking for a Lead Data Engineer to lead the development and operationalization of data pipelines for improved health outcomes. Key Responsibilities Lead the design and implementation...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ATPCOHerndon, VA, US
    Full-time
    ATPCO is the world's primary source for air fare content, holding over 200 million fares across 160 countries.Every day, the travel industry relies on ATPCO's technology and data solutions ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer, Public Sector (security clearance required)

    Data Engineer, Public Sector (security clearance required)

    Scale AI, Inc.Washington, DC, United States
    Full-time
    As a Data Engineer for the Public Sector business unit, you will build Scale's analytical and business-intelligence infrastructure. Scale's customers process millions of tasks through our APIs, and ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Discovery Engineer

    Senior Data Discovery Engineer

    VirtualVocationsAlexandria, Virginia, United States
    Full-time
    A company is looking for a Senior Engineer - Data Discovery.Key Responsibilities Design, architect, and deploy data discovery and inventory platform Administer tools and processes to implement P...Show moreLast updated: 15 hours ago
    • Promoted
    Data Engineer - Senior - Posting #498

    Data Engineer - Senior - Posting #498

    Allen Integrated SolutionsWashington, DC, US
    Full-time
    Data Engineer : The Data Engineer shall ensure the integration and interoperability of.Develop, construct, test, and maintain GIS databases and large-scale data processing systems.Clean, prepare, an...Show moreLast updated: 30+ days ago