Talent.com
Databricks Data Engineer

Databricks Data Engineer

Leidos IncWashington, DC, United States
11 days ago
Job type
  • Full-time
Job description

Description

Leidos is seeking a Databricks Data Engineer to develop / support new / existing data pipelines, and data analytics environments in Azure cloud-based data lake. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft Azure based data analytics platform. You will support continued maintenance of ETL operations and development of new pipelines ensuring data quality and data management. The ideal candidate will bring deep expertise in Databricks, a solid foundation in advanced AI technologies, and applies critical thinking to create innovative functions and solve technical issues by cross-functional team collaboration.

Candidate must be a U.S. citizen. This role is remote for candidates located within the United States; however, the ideal candidate will be based in or willing to relocate to the Washington, DC or Indianapolis, IN area to support periodic on-site activities."

In this role, you will :

  • Design, build, and optimize scalable data solutions using Databricks and Medallion Architecture.
  • Manage ingestion routines for processing multi-terabyte datasets efficiently for multiple projects simultaneously, where each project may have multiple Databricks workspaces.
  • Integrate data from various structured and unstructured sources to enable high-quality business insights. Proficiency in data analysis techniques for deriving insights from large datasets.
  • Implement effective data management strategies to ensure data integrity, availability, and accessibility. Identify opportunities for cost optimization in data storage, processing, and analytics operations.
  • Montor and support user requests, addressing platform or performance issues, cluster stability, Spark optimization, and configuration management.
  • Collaborate with the team to enable advanced AI-driven analytics and data science workflows.
  • Integrate with various Azure services including Azure Functions, Storage Services, Data Factory, Log Analytics, and User Management for seamless data workflows. Experience with the above Azure services is a plus. Provision and manage infrastructure using Infrastructure-as-Code (IaC)
  • Apply best practices for data security, data governance, and compliance, ensuring support for federal regulations and public trust standards.
  • Proactively collaborate with technical and non-technical teams to gather requirements and translate business needs into data solutions.

For this position, you must possess :

  • BS degree in Computer Science or related field and 3+ years or Master's degree with 2+ years of experience
  • 3+ years of experience developing and designing Ingestion flows (structured, streaming, and unstructured data) using cloud platform services with data quality
  • Databricks Data Engineer certification and 2+ years of experience maintaining Databricks platform and development in Spark
  • Ability to work directly with clients and act as front line support for requests coming in from clients. Clearly document and express the solution in form of architecture and interface diagrams.
  • Proficient at Python, Spark and R are essential. .NET based development is a plus.
  • Knowledge and experience with data governance, including metadata management, enterprise data catalog, design standards, data quality governance, and data security.
  • Experience with Agile process methodology, CI / CD automation, and cloud-based developments (Azure, AWS).
  • Not required, but additional education, certifications, and / or experience are a plus : Certifications in Azure cloud, Knowledge of FinOps principles and cost management
  • If you're looking for comfort, keep scrolling. At Leidos, we outthink, outbuild, and outpace the status quo - because the mission demands it. We're not hiring followers. We're recruiting the ones who disrupt, provoke, and refuse to fail. Step 10 is ancient history. We're already at step 30 - and moving faster than anyone else dares.

    Original Posting : September 25, 2025

    For U.S. Positions : While subject to change based on business needs, Leidos reasonably anticipates that this job requisition will remain open for at least 3 days with an anticipated close date of no earlier than 3 days after the original posting date as listed above.

    Pay Range :

    Pay Range $85,150.00 - $153,925.00

    The Leidos pay range for this job level is a general guideline onlyand not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.

    #Remote

    #Featuredjob

    Create a job alert for this search

    Data Engineer • Washington, DC, United States

    Related jobs
    • Promoted
    • New!
    Senior Lead Data Engineer (Python, EMR, Databricks, AWS)

    Senior Lead Data Engineer (Python, EMR, Databricks, AWS)

    Capital OneEast Case, MD, US
    Full-time +1
    Senior Lead Data Engineer (Python, EMR, Databricks, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, ...Show moreLast updated: 16 hours ago
    • Promoted
    Senior Data Engineer (Python, Spark, Databricks, AWS)

    Senior Data Engineer (Python, Spark, Databricks, AWS)

    Capital OneArnold, MD, US
    Full-time +1
    Senior Data Engineer (Python, Spark, Databricks, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inc...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior Data Engineer (Python, SQL, AWS)

    Senior Data Engineer (Python, SQL, AWS)

    Capital OneArnold, MD, US
    Full-time +1
    Senior Data Engineer (Python, SQL, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and it...Show moreLast updated: 16 hours ago
    • Promoted
    Senior Data Engineer, (ELT / Spark / Python / AWS)

    Senior Data Engineer, (ELT / Spark / Python / AWS)

    Capital OneArnold, MD, US
    Full-time +1
    Senior Data Engineer, (ELT / Spark / Python / AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, a...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior Data Engineer ( Enterprise Platforms Technology)

    Senior Data Engineer ( Enterprise Platforms Technology)

    Capital OneArnold, MD, US
    Full-time +1
    Senior Data Engineer ( Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, i...Show moreLast updated: 16 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    Capital OneWashington, D.C., US
    Full-time +1
    Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery envi...Show moreLast updated: 16 hours ago
    • Promoted
    Lead Data Engineer (Python, SQL, AWS)

    Lead Data Engineer (Python, SQL, AWS)

    Capital OneEast Case, MD, US
    Full-time +1
    Lead Data Engineer (Python, SQL, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iter...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Distinguished Data Engineer - Card Technology

    Distinguished Data Engineer - Card Technology

    Capital OneArnold, MD, US
    Full-time +1
    Distinguished Data Engineer - Card Technology As a Distinguished Engineer at Capital One, you will be a part of a community of technical experts working to define the future of banking in the cloud...Show moreLast updated: 16 hours ago
    • Promoted
    Senior Data Engineer (Python, AWS)

    Senior Data Engineer (Python, AWS)

    Capital OneEast Case, MD, US
    Full-time +1
    Senior Data Engineer (Python, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterati...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer (Java, Python, Spark, AWS)

    Lead Data Engineer (Java, Python, Spark, AWS)

    Capital OneEast Case, MD, US
    Full-time +1
    Lead Data Engineer (Java, Python, Spark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, ...Show moreLast updated: 1 day ago
    • Promoted
    Lead, Data Engineer

    Lead, Data Engineer

    Capital OneEast Case, MD, US
    Full-time +1
    Lead, Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery env...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior Manager, Data Engineer (AWS)

    Senior Manager, Data Engineer (AWS)

    Capital OnePimmit, VA, US
    Full-time +1
    Senior Manager, Data Engineer (AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterat...Show moreLast updated: 16 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Capital OneArnold, MD, US
    Full-time +1
    Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery en...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Lead Data Engineer (Python / Spark / AWS)

    Lead Data Engineer (Python / Spark / AWS)

    Capital OneArnold, MD, US
    Full-time +1
    Lead Data Engineer (Python / Spark / AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iter...Show moreLast updated: 16 hours ago
    • Promoted
    • New!
    Senior Lead Data Engineer

    Senior Lead Data Engineer

    Capital OneArnold, MD, US
    Full-time +1
    Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delive...Show moreLast updated: 22 hours ago
    • Promoted
    • New!
    Senior Lead Data Engineer (Python, SQL, AWS)

    Senior Lead Data Engineer (Python, SQL, AWS)

    Capital OneArnold, MD, US
    Full-time +1
    Senior Lead Data Engineer (Python, SQL, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, a...Show moreLast updated: 16 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    BOOZ, ALLEN & HAMILTON, INC.Arlington, VA, US
    Full-time +1
    Ever-expanding technology like IoT, machine learning, and artifi cia l intelligence means that there's more structured and unstructured data available today than ever before.As a data engineer,...Show moreLast updated: 13 hours ago
    • Promoted
    Senior Data Engineer (Enterprise Platforms Technology)

    Senior Data Engineer (Enterprise Platforms Technology)

    Capital OneArnold, MD, US
    Full-time +1
    Senior Data Engineer (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, in...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer (Enterprise Platforms Technology)

    Lead Data Engineer (Enterprise Platforms Technology)

    Capital OneArnold, MD, US
    Full-time +1
    Lead Data Engineer (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, incl...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer (PySpark / Spark, AWS, Databricks, EMR, ETL / SQL)

    Senior Data Engineer (PySpark / Spark, AWS, Databricks, EMR, ETL / SQL)

    Capital OneEast Case, MD, US
    Full-time +1
    Senior Data Engineer (PySpark / Spark, AWS, Databricks, EMR, ETL / SQL) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, coll...Show moreLast updated: 1 day ago