Talent.com
Remote SME Data Engineer

Remote SME Data Engineer

ShuvelAshburn, VA, United States
30+ days ago
Job type
  • Full-time
  • Remote
Job description

Job Description :

Each day U.S. Customs and Border Protection (CBP) oversees the massive flow of people, capital, and products that enter and depart the United States via air, land, sea, and cyberspace. The volume and complexity of both physical and virtual border crossings require the application of solutions to promote efficient trade and travel. Further, effective solutions help CBP ensure the movement of people, capital, and products is legal, safe, and secure. CBP seeks capable, qualified, and versatile SME Data Engineers to help develop complex data analytical solutions for law enforcement personnel to assess risk of potential threats entering the country.

Responsibilities include, but are not limited to :

  • Design, develop, and maintain scalable data pipelines and architectures to support data extraction, transformation, and loading (ETL / ELT) processes. Utilize strong SQL skills to perform complex data transformations and optimize database queries, ensuring high performance and efficiency.
  • Building comprehensive datasets by aggregating data sourced from various relational databases, facilitating data analysts and data scientists in creating machine learning models, reports, and dashboards.
  • Collaborate with cross-functional teams (data analysts, data scientists, and business stakeholders) to understand business requirements and translate them into technical solutions.
  • Assist with the implementation of data migration / pipelines from on-prem to cloud / non-relational storage platforms.
  • Leverage distributed computing frameworks like Apache Spark to process large volumes of data efficiently.
  • Utilizing data analysis, problem-solving, investigative, and creative thinking skills to handle extremely large datasets, transforming them into various formats for diverse analytical products.
  • Respond to data queries / analysis requests from various groups within an organization. Create and publish regularly scheduled and / or ad hoc reports as needed.
  • Troubleshoot data-related issues, identify root causes, and implement solutions to ensure data integrity and accuracy.
  • Implement best practices for data governance, security, and quality supporting the core business applications.
  • Responsible for data engineering source code control using GitLab.

Basic Qualifications :

  • Experience with relational databases and knowledge of query tools and / or BI tools like Power BI or OBIEE and data analysis tools.
  • Extensive experience with SQL and proficiency in writing complex queries.
  • Solid understanding of data warehousing concepts and platforms such as Oracle and cloud-based solutions.
  • Strong experience in automating ETL jobs via UNIX / LINUX shell scripts and CRON jobs.
  • Demonstrate a strong practical understanding of data warehousing from a production relational database environment.
  • Strong experience using analytic functions within Oracle or similar tools within non-relational (MongoDB, Cassandra etc.) database systems.
  • Strong understanding of distributed computing principles and experience with frameworks like Apache Spark
  • Hands-on-experience with data lake architectures and technologies in a cloud environment.
  • Experience with Atlassian suite of tools such as Jira and Confluence
  • Knowledge of Continuous Integration & Continuous Development tools (CI / CD)
  • Must be able to multitask efficiently and progressively and work comfortably in an ever-changing data environment.
  • Must work well in a team environment as well as independently.
  • Excellent verbal / written communication and problem-solving skills; ability to communicate information to a variety of groups at different technical skill levels.
  • Preferred Qualifications :

  • 5+ years of experience in developing, maintaining, and optimizing complex Oracle PL / SQL packages to aggregate transactional data for consumption by data science / machine learning applications.
  • 10+ years of experience in working in data engineering, with a focus on building and optimizing data pipelines and architectures. Must have full life cycle experience in design, development, deployment, and monitoring.
  • Experience with one or more relational database systems such as Oracle, MySQL, Postgres, SQL server, with heavy emphasis on Oracle.
  • Extensive experience with cloud platforms (e.g. AWS, Google Cloud, etc) and cloud based ETL / ELT tools.
  • Experience with Amazon services such as S3, Redshift, EMR and Scala.
  • Experience with migrating on-prem legacy database objects and data to the Amazon S3 cloud environment.
  • Experience or familiarity with data science / machine learning and development experience for supervised and unsupervised learning with structure and unstructured datasets.
  • Certifications in relevant technologies (e.g. AWS Certified Big Data, Google Professional Data Engineer) are a plus.
  • Create a job alert for this search

    Data Engineer Remote • Ashburn, VA, United States

    Related jobs
    • Promoted
    • New!
    Senior Data Engineer - Financial Substantiation Platform •Hybrid •

    Senior Data Engineer - Financial Substantiation Platform •Hybrid •

    GEICOWashington, DC, United States
    Full-time
    At GEICO, we offer a rewarding career where your ambitions are met with endless possibilities.Every day we honor our iconic brand by offering quality coverage to millions of customers and being the...Show moreLast updated: 5 hours ago
    Senior Data Engineer (Databricks)

    Senior Data Engineer (Databricks)

    Infinitive IncAshburn, VA, US
    Full-time
    Quick Apply
    Candidates must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and ...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    AnalyticaWashington, DC, US
    Full-time
    Quick Apply
    Analytica is seeking a Data Engineer to support a key, long-term federal government client program and software product.The ideal candidate will be comfortable working in an agile, multi-faceted te...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer AzureDynamics 365

    Senior Data Engineer AzureDynamics 365

    AHU Technologies IncWashington, DC, United States
    Full-time
    Client is seeking a Senior Data Engineer for managing and optimizing data services across Azure / Dynamics 365 and legacy Oracle Database environments. This role oversees Microsoft Dataverse, Azure Da...Show moreLast updated: 3 days ago
    Data Engineer

    Data Engineer

    RedhorseArlington, Virginia, United States, 22201
    Full-time
    Now is a great time to join Redhorse Corporation.We are a solution-driven company delivering data insights and technology solutions to customers with missions critical to U.Were looking for thought...Show moreLast updated: 30+ days ago
    Databricks Engineer

    Databricks Engineer

    Mfinite ConsultingAdelphi, Maryland, United States
    Full-time
    Quick Apply
    We are hiring a Databricks Engineer to design, build, and operate a scalable Data & AI platform for our client, with a strong foundation in the Medallion Architecture (Bronze / Silver / Gold layers...Show moreLast updated: 3 days ago
    Cloud Engineer - SME

    Cloud Engineer - SME

    Pendulum LLCChantilly, VA, US
    Full-time
    Quick Apply
    JOB DESCRIPTION Clearance Level : .Top Secret / SCI with Full Scope Polygraph Skill Level(s) : Subject Matter Expert • use software such as Jira, Confluence, SharePoint, or similar to create...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Leidos IncSterling, VA, United States
    Full-time
    At Leidos, we deliver innovative solutions through the efforts of our diverse and talented people who are dedicated to our customers' success. We empower our teams, contribute to our communities, an...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    Infinitive IncMcLean, VA, US
    Full-time
    Quick Apply
    Infinitive is a data and AI consultancy that helps clients modernize, monetize, and operationalize their data to generate lasting value. They pride themselves on their deep industry and technology e...Show moreLast updated: 30+ days ago
    • Promoted
    Software Data Engineer

    Software Data Engineer

    MANTECHSpringfield, VA, United States
    Full-time
    Responsibilities include, but are not limited to : .Provide expert guidance on Enterprise Asset Management; Identify, recommend, and implement agreed upon leading industry practices, process methodol...Show moreLast updated: 13 days ago
    Data Engineer

    Data Engineer

    INTEGRITYOne PartnersCrystal City, VA, US
    Full-time
    Quick Apply
    INTEGRITYOne Partners Data Engineer – Mid-Level Location – Hybrid – 1-2 days per week on-site in Crystal City, VA The Role As a mid-level Data Engineer, you'll be at the forefront...Show moreLast updated: 30+ days ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    KamisProWashington, DC, United States
    Full-time
    This role centers on breaking down data silos, automating processes, and ensuring reliable data delivery to support critical business decisions. The engineer will lead initiatives to enhance data pi...Show moreLast updated: 23 hours ago
    Senior Data Engineer (Databricks Pro Certified)

    Senior Data Engineer (Databricks Pro Certified)

    Infinitive IncAshburn, VA, US
    Full-time
    Quick Apply
    Candidates must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and ...Show moreLast updated: 30+ days ago
    Data Engineer (Databricks Experience)

    Data Engineer (Databricks Experience)

    Infinitive IncMcLean, VA, US
    Full-time
    Quick Apply
    Candidates must be local to the Washington D.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (Azure / Dynamics 365)

    Senior Data Engineer (Azure / Dynamics 365)

    AHU Technologies IncWashington, DC, United States
    Full-time
    Client is looking for a resource to provide high-level data engineering administration expertise to support Dynamics 365 / Azure data services, including Dataverse management, Azure Data Factory mana...Show moreLast updated: 3 days ago
    Data Engineer

    Data Engineer

    AITHERAS, LLCArlington, VA, US
    Full-time
    Quick Apply
    Data Engineer Salary : $95,000 - $120,000 Travel : 3 days onsite, 2 days work-from-home Onsite Location : Arlington, VA Job Description Scope We are seeking a Data Engineer to support our Diversion ...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Data Platform Engineer (Azure / AWS)

    Cloud Data Platform Engineer (Azure / AWS)

    Leidos IncAlexandria, VA, United States
    Full-time
    At Leidos, we're not just delivering solutions - we're pioneering the future of defense and intelligence technology.Our diverse teams of innovators unite around a singular purpose : empowering our c...Show moreLast updated: 11 days ago
    • Promoted
    SME DevSecOps Engineer

    SME DevSecOps Engineer

    Leidos IncAlexandria, VA, United States
    Full-time
    At Leidos, we're not just delivering solutions - we're pioneering the future of defense and intelligence technology.Our diverse teams of innovators unite around a singular purpose : empowering our c...Show moreLast updated: 17 days ago