Talent.com
Lead Data Engineer

Lead Data Engineer

Amida Technology SolutionsWashington, DC, US
4 days ago
Job type
  • Full-time
Job description

Job Description

Job Description

Amida Technology Solutions is a DC-based technology company focused on data interoperability, integrity, governance, and security. We create solutions that collect, reconcile, transform, and standardize data for business intelligence, advanced analytics, decision support, and user transactions. We specialize in taking data from inception to impact.

Our team is composed of creative, forward-looking thinkers who are passionate about using cutting-edge technology to improve lives and generate a positive impact on our country. We offer an entrepreneurial, high-growth environment that values fresh ideas, candid conversations, and authentic teamwork.

Amida Technology Solutions is seeking a skilled Lead Data Engineer. The successful candidate will design and develop data pipelines using Databricks, Azure Data Factory, Azure Synapse Analytics, and other platforms within Azure Cloud. This role will report to Data Engineering Manager. The ideal candidate will be motivated by the opportunity to support public agencies, nonprofit organizations, and private companies in transforming their data into actionable insights. Preference will be given to candidates able to work a hybrid schedule in our DC headquarters office.

Key Responsibilities

  • Lead the design, development, and maintenance data pipelines for Extract, Transform, Load (ETL) data on Azure platforms (focusing on Databricks)
  • Optimize data flow to ensure high-quality data integrity, consistency, and reliability
  • Monitor and troubleshoot data pipeline issues, ensuring high availability and performance
  • Collaborate with data scientists, analysts, and stakeholders to understand data requirements and translate them into technical solutions
  • Document data workflows, architecture, and technical processes
  • Implement data governance and security best practices
  • Automate data workflows to improve efficiency and reduce manual efforts
  • Lead and mentor other engineers
  • Other duties as assigned

Required Education :

  • Bachelor's degree in computer science, Information Technology, or a related field
  • Required Experience :

  • 7+ years of experience with Python and one or more programming languages such as Java, Scala or SQL
  • 3+ years of experience leading and mentoring data engineers
  • 4+ years of experience building data pipelines using Azure services (e.g., Azure Databricks, Azure Data Factory, Azure Synapse, Azure Functions)
  • 4+ years of experience developing solutions on Azure
  • 2+ years of experience working with Databricks
  • Experience with version control and software development collaboration tools such as Git and GitHub
  • Experience using resources in cloud environments such as AWS or Azure
  • Required Skills :

  • Expertise in ETL processes, data modeling, and database design.
  • Proficiency in programming languages such as Python or Java
  • Expertise in Delta Lake and other file storage formats including CSV, JSON and Parquet
  • Strong problem-solving skills and attention to detail
  • Excellent communication and collaboration abilities
  • Ability to obtain a Public Trust security clearance
  • Preferred Skills :

  • Familiarity with VA infrastructure and data sources
  • Proficiency in Cypher query language
  • Proficiency in graph data modeling concepts
  • Experience with database systems and data warehousing technologies such as MySQL, PostgreSQL, MongoDB, Amazon Redshift, Microsoft SQL Server, etc.
  • This is not a remote position. Priority will be given to candidates who can work from our Washington, D.C. or Richmond office.

    Success at Amida

    Communication is the key to success at Amida. Our people are known for their can-do attitude and their ability to work effectively with both internal and client teams. We pride ourselves on having a collegial, multidisciplinary team with diverse backgrounds and experience. Our best team members pay intense attention to detail in all aspects of their work, have great initiative, are opinionated about the best ways of doing things, and align quickly to decisions. A sense of humor is an asset at Amida.

    Full-time, regular employees at Amida enjoy a robust benefits package that includes a generous 401(k) match with immediate vesting, 4 weeks of PTO, paid parental leave, medical insurance, dental insurance, vision insurance, life AD&D insurance, and short-term disability. We also offer tuition / training assistance and team building opportunities to encourage professional growth and collaboration.

    All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other characteristic protected by law.

    Create a job alert for this search

    Lead Data Engineer • Washington, DC, US

    Related jobs
    • Promoted
    Senior Data Engineer (PySpark / Spark, AWS, Databricks, EMR, ETL / SQL)

    Senior Data Engineer (PySpark / Spark, AWS, Databricks, EMR, ETL / SQL)

    Capital OneBALTIMORE, Maryland, United States
    Full-time +1
    Senior Data Engineer (PySpark / Spark, AWS, Databricks, EMR, ETL / SQL).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, coll...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer (Python, AWS, SQL)

    Lead Data Engineer (Python, AWS, SQL)

    Capital OneBaltimore, MD, US
    Full-time +1
    Lead Data Engineer (Python, AWS, SQL).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you...Show moreLast updated: 28 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Capital OneBALTIMORE, Maryland, United States
    Full-time +1
    Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,. At Capital One, you'll be part of a big group of makers, ...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer (Enterprise Platforms Technology)

    Lead Data Engineer (Enterprise Platforms Technology)

    Capital OneWASHINGTON D.C., District of Columbia, United States
    Full-time +1
    Lead Data Engineer (Enterprise Platforms Technology).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At C...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Ab Initio Data Engineer

    Lead Ab Initio Data Engineer

    ALTA IT ServicesReston, VA, US
    Temporary
    Lead Data Engineer (Ab Initio / AWS / Data Pipelines) Location : Reston, VA (Hybrid – onsite roughly once every 1–2 months) Duration : 12-Month Contract About the Role We’re looking for a Lead Data E...Show moreLast updated: 19 days ago
    • Promoted
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingReston, VA, US
    Full-time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer (Java, Scala, Spark)

    Lead Data Engineer (Java, Scala, Spark)

    Capital OneWASHINGTON D.C., District of Columbia, United States
    Full-time +1
    Lead Data Engineer (Java, Scala, Spark).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, y...Show moreLast updated: 8 days ago
    • Promoted
    Senior Lead Data Engineer (Intelligent Foundations and Experiences)

    Senior Lead Data Engineer (Intelligent Foundations and Experiences)

    Capital OneBaltimore, MD, US
    Full-time +1
    Senior Lead Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, coll...Show moreLast updated: 28 days ago
    • Promoted
    Lead Data Engineer (Enterprise Platform Technology)

    Lead Data Engineer (Enterprise Platform Technology)

    Capital OneMCLEAN, Virginia, United States
    Full-time +1
    Lead Data Engineer (Enterprise Platform Technology).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Ca...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Lead Data Engineer (AWS, Python, SQL)

    Lead Data Engineer (AWS, Python, SQL)

    Capital OneBaltimore, MD, US
    Full-time +1
    Lead Data Engineer (AWS, Python, SQL).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iter...Show moreLast updated: 15 hours ago
    • Promoted
    Lead Data Engineer (Intelligent Foundations and Experiences)

    Lead Data Engineer (Intelligent Foundations and Experiences)

    Capital OneMCLEAN, Virginia, United States
    Full-time +1
    Lead Data Engineer (Intelligent Foundations and Experiences).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborati...Show moreLast updated: 29 days ago
    • Promoted
    Senior Lead Data Engineer (Python, EMR, Databricks, AWS)

    Senior Lead Data Engineer (Python, EMR, Databricks, AWS)

    Capital OneWashington, DC, US
    Full-time +1
    Senior Lead Data Engineer (Python, EMR, Databricks, AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, ...Show moreLast updated: 30+ days ago
    • Promoted
    ETL / Data Engineer / Data Architect

    ETL / Data Engineer / Data Architect

    Node.DigitalWashington, DC, US
    Full-time
    ETL / Data Engineer / Data Architect.Must have a active Secret Security Clearance.Node is currently seeking a motivated, career and customer-oriented Senior Data Architect to begin an exciting and chal...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer (Java, Python, Spark, AWS)

    Lead Data Engineer (Java, Python, Spark, AWS)

    Capital OneWASHINGTON D.C., District of Columbia, United States
    Full-time +1
    Lead Data Engineer (Java, Python, Spark, AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Lead Data Engineer

    Senior Lead Data Engineer

    Capital OneWashington, DC, US
    Full-time +1
    Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer (Generative AI)

    Lead Data Engineer (Generative AI)

    Capital OneBALTIMORE, Maryland, United States
    Full-time +1
    Lead Data Engineer (Generative AI).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you'll...Show moreLast updated: 8 days ago
    • Promoted
    Lead Data Engineer - Card Tech

    Lead Data Engineer - Card Tech

    Capital OneWASHINGTON D.C., District of Columbia, United States
    Full-time +1
    Lead Data Engineer - Card Tech.Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you'll be ...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer (Enterprise Platform Technology)

    Lead Data Engineer (Enterprise Platform Technology)

    Capital One National AssociationMcLean, VA, United States
    Full-time +1
    Lead Data Engineer (Enterprise Platform Technology).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclu...Show moreLast updated: 30+ days ago