Talent.com
Remote SME Data Engineer
Remote SME Data EngineerShuvel • Ashburn, VA, United States
Remote SME Data Engineer

Remote SME Data Engineer

Shuvel • Ashburn, VA, United States
30+ days ago
Job type
  • Full-time
  • Remote
Job description

Job Description :

Each day U.S. Customs and Border Protection (CBP) oversees the massive flow of people, capital, and products that enter and depart the United States via air, land, sea, and cyberspace. The volume and complexity of both physical and virtual border crossings require the application of solutions to promote efficient trade and travel. Further, effective solutions help CBP ensure the movement of people, capital, and products is legal, safe, and secure. CBP seeks capable, qualified, and versatile SME Data Engineers to help develop complex data analytical solutions for law enforcement personnel to assess risk of potential threats entering the country.

Responsibilities include, but are not limited to :

  • Design, develop, and maintain scalable data pipelines and architectures to support data extraction, transformation, and loading (ETL / ELT) processes. Utilize strong SQL skills to perform complex data transformations and optimize database queries, ensuring high performance and efficiency.
  • Building comprehensive datasets by aggregating data sourced from various relational databases, facilitating data analysts and data scientists in creating machine learning models, reports, and dashboards.
  • Collaborate with cross-functional teams (data analysts, data scientists, and business stakeholders) to understand business requirements and translate them into technical solutions.
  • Assist with the implementation of data migration / pipelines from on-prem to cloud / non-relational storage platforms.
  • Leverage distributed computing frameworks like Apache Spark to process large volumes of data efficiently.
  • Utilizing data analysis, problem-solving, investigative, and creative thinking skills to handle extremely large datasets, transforming them into various formats for diverse analytical products.
  • Respond to data queries / analysis requests from various groups within an organization. Create and publish regularly scheduled and / or ad hoc reports as needed.
  • Troubleshoot data-related issues, identify root causes, and implement solutions to ensure data integrity and accuracy.
  • Implement best practices for data governance, security, and quality supporting the core business applications.
  • Responsible for data engineering source code control using GitLab.

Basic Qualifications :

  • Experience with relational databases and knowledge of query tools and / or BI tools like Power BI or OBIEE and data analysis tools.
  • Extensive experience with SQL and proficiency in writing complex queries.
  • Solid understanding of data warehousing concepts and platforms such as Oracle and cloud-based solutions.
  • Strong experience in automating ETL jobs via UNIX / LINUX shell scripts and CRON jobs.
  • Demonstrate a strong practical understanding of data warehousing from a production relational database environment.
  • Strong experience using analytic functions within Oracle or similar tools within non-relational (MongoDB, Cassandra etc.) database systems.
  • Strong understanding of distributed computing principles and experience with frameworks like Apache Spark
  • Hands-on-experience with data lake architectures and technologies in a cloud environment.
  • Experience with Atlassian suite of tools such as Jira and Confluence
  • Knowledge of Continuous Integration & Continuous Development tools (CI / CD)
  • Must be able to multitask efficiently and progressively and work comfortably in an ever-changing data environment.
  • Must work well in a team environment as well as independently.
  • Excellent verbal / written communication and problem-solving skills; ability to communicate information to a variety of groups at different technical skill levels.
  • Preferred Qualifications :

  • 5+ years of experience in developing, maintaining, and optimizing complex Oracle PL / SQL packages to aggregate transactional data for consumption by data science / machine learning applications.
  • 10+ years of experience in working in data engineering, with a focus on building and optimizing data pipelines and architectures. Must have full life cycle experience in design, development, deployment, and monitoring.
  • Experience with one or more relational database systems such as Oracle, MySQL, Postgres, SQL server, with heavy emphasis on Oracle.
  • Extensive experience with cloud platforms (e.g. AWS, Google Cloud, etc) and cloud based ETL / ELT tools.
  • Experience with Amazon services such as S3, Redshift, EMR and Scala.
  • Experience with migrating on-prem legacy database objects and data to the Amazon S3 cloud environment.
  • Experience or familiarity with data science / machine learning and development experience for supervised and unsupervised learning with structure and unstructured datasets.
  • Certifications in relevant technologies (e.g. AWS Certified Big Data, Google Professional Data Engineer) are a plus.
  • Create a job alert for this search

    Data Engineer Remote • Ashburn, VA, United States

    Related jobs
    Data Engineer

    Data Engineer

    Crystal Management | CMIT • Vienna, VA, United States
    Full-time
    CMiT is seeking an experienced Data Engineer to help lead the analysis, documentation, and migration of a ~2TB Oracle database environment to PostgreSQL. This role involves mapping complex data depe...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer (Databricks)

    Senior Data Engineer (Databricks)

    Infinitive Inc • Ashburn, VA, US
    Full-time
    Quick Apply
    Candidates must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and ...Show more
    Last updated: 30+ days ago
    Senior Data Engineer (Cloud Operations Resilience Engineering)

    Senior Data Engineer (Cloud Operations Resilience Engineering)

    Capital One • Pimmit, VA, US
    Full-time +1
    Senior Data Engineer (Cloud Operations Resilience Engineering) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collabora...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Forge Group, LLC • Reston, VA, USA
    Full-time
    Quick Apply
    Forge is a global solutions provider.We are a proud, certified 8a, woman-owned, service-disabled, veteran-owned small business (8a, WOSB, SDVOSB). We are known as international problem fixers who on...Show more
    Last updated: 7 days ago
    Data Engineer

    Data Engineer

    Altus Consulting Corp • Herndon, VA, USA
    Full-time
    Quick Apply
    Altus Consulting is seeking a skilled Data Engineer to join our dynamic team.You will be responsible for designing, developing, and maintaining data pipelines and infrastructure that provide reliab...Show more
    Last updated: 30+ days ago
    Lead Software Engineer (Big Data / Cloudera Platform)

    Lead Software Engineer (Big Data / Cloudera Platform)

    Lumen Solutions Group, Inc. • Reston, VA, United States
    Full-time
    Lead Software Engineer (Big Data / Cloudera Platform).Reston, VA / Washington, DC (Hybrid - 1 Day per Month Onsite).Big Data platforms, Cloudera (CDP / CDH), and AWS. The ideal candidate will be an ex...Show more
    Last updated: 3 days ago • Promoted
    Software Developer / Data Engineer

    Software Developer / Data Engineer

    BuddoBot Inc. • Chantilly, VA, United States
    Full-time
    Velocity-X, a VelocityBlack company, constructs and deploys data management and analytics solutions for the defense and intelligence communities. We're proud to boast a world-class engineering team ...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Engineer - SME

    Cloud Engineer - SME

    Pendulum LLC • Chantilly, VA, US
    Full-time
    Quick Apply
    JOB DESCRIPTION Clearance Level : .Top Secret / SCI with Full Scope Polygraph Skill Level(s) : Subject Matter Expert • use software such as Jira, Confluence, SharePoint, or similar to create...Show more
    Last updated: 30+ days ago
    Data Engineer

    Data Engineer

    Leidos Inc • Sterling, VA, United States
    Full-time
    At Leidos, we deliver innovative solutions through the efforts of our diverse and talented people who are dedicated to our customers' success. We empower our teams, contribute to our communities, an...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Leidos Inc • Chantilly, VA, United States
    Full-time
    Leidos is seeking a Data Analyst for a 200+ FTE technical development program supporting the Sponsor's Entitlement Programs as well as IdAM / ICAM, Authentication, Authorization, Attributes and Digi...Show more
    Last updated: 1 day ago • Promoted
    Senior AI Data Infra Engineer — Hybrid & Growth

    Senior AI Data Infra Engineer — Hybrid & Growth

    Adelphi • McLean, VA, United States
    Full-time
    A cutting-edge tech firm is seeking a Senior / Principal Software Engineer to develop secure data sharing middleware.The role requires expertise in software development and ML Ops.Ideal candidates wi...Show more
    Last updated: 11 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Infinitive Inc • McLean, VA, US
    Full-time
    Quick Apply
    Infinitive is a data and AI consultancy that helps clients modernize, monetize, and operationalize their data to generate lasting value. They pride themselves on their deep industry and technology e...Show more
    Last updated: 30+ days ago
    SRE - Big Data

    SRE - Big Data

    Verisign • Reston, VA, United States
    Full-time
    Verisign helps enable the security, stability, and resiliency of the internet.We are a trusted provider of internet infrastructure services for the networked world and deliver unmatched performance...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Credence • McLean, VA, US
    Full-time
    Quick Apply
    At Credence, we support our clients’ mission-critical needs, powered by technology.We provide cutting-edge solutions, including AI / ML, enterprise modernization, and advanced intelligence capabiliti...Show more
    Last updated: 30+ days ago
    Senior Data Engineer (Databricks Pro Certified)

    Senior Data Engineer (Databricks Pro Certified)

    Infinitive Inc • Ashburn, VA, US
    Full-time
    Quick Apply
    Candidates must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and ...Show more
    Last updated: 30+ days ago
    Senior Data Engineer / AWS Data Engineer / Lead Data Engineer (REMOTE)

    Senior Data Engineer / AWS Data Engineer / Lead Data Engineer (REMOTE)

    Tap Growth ai • Falls Church, Virginia, US
    Remote
    Full-time +1
    We're Hiring : Programmer Analyst Principal! 🌟.We are seeking a skilled and experienced Programmer Analyst Principal to join our dynamic team. The ideal candidate will possess extensive knowledge in...Show more
    Last updated: 29 days ago
    Data Engineer (Databricks Experience)

    Data Engineer (Databricks Experience)

    Infinitive Inc • McLean, VA, US
    Full-time
    Quick Apply
    Candidates must be local to the Washington D.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial ...Show more
    Last updated: 30+ days ago
    Databricks Platform Engineer (AWS) - (TS / SCI)

    Databricks Platform Engineer (AWS) - (TS / SCI)

    North Point Technology • Gaithersburg, MD, US
    Full-time
    This job requires an active Top Secret / SCI clearance (with CI Polygraph eligibility).Please apply only if you currently hold an active Top Secret clearance with SCI eligibility.North Point Techno...Show more
    Last updated: 30+ days ago • Promoted