Talent.com
Remote SME Data Engineer
Remote SME Data EngineerShuvel • Ashburn, VA, United States
Remote SME Data Engineer

Remote SME Data Engineer

Shuvel • Ashburn, VA, United States
30+ days ago
Job type
  • Full-time
  • Remote
Job description

Job Description :

Each day U.S. Customs and Border Protection (CBP) oversees the massive flow of people, capital, and products that enter and depart the United States via air, land, sea, and cyberspace. The volume and complexity of both physical and virtual border crossings require the application of solutions to promote efficient trade and travel. Further, effective solutions help CBP ensure the movement of people, capital, and products is legal, safe, and secure. CBP seeks capable, qualified, and versatile SME Data Engineers to help develop complex data analytical solutions for law enforcement personnel to assess risk of potential threats entering the country.

Responsibilities include, but are not limited to :

  • Design, develop, and maintain scalable data pipelines and architectures to support data extraction, transformation, and loading (ETL / ELT) processes. Utilize strong SQL skills to perform complex data transformations and optimize database queries, ensuring high performance and efficiency.
  • Building comprehensive datasets by aggregating data sourced from various relational databases, facilitating data analysts and data scientists in creating machine learning models, reports, and dashboards.
  • Collaborate with cross-functional teams (data analysts, data scientists, and business stakeholders) to understand business requirements and translate them into technical solutions.
  • Assist with the implementation of data migration / pipelines from on-prem to cloud / non-relational storage platforms.
  • Leverage distributed computing frameworks like Apache Spark to process large volumes of data efficiently.
  • Utilizing data analysis, problem-solving, investigative, and creative thinking skills to handle extremely large datasets, transforming them into various formats for diverse analytical products.
  • Respond to data queries / analysis requests from various groups within an organization. Create and publish regularly scheduled and / or ad hoc reports as needed.
  • Troubleshoot data-related issues, identify root causes, and implement solutions to ensure data integrity and accuracy.
  • Implement best practices for data governance, security, and quality supporting the core business applications.
  • Responsible for data engineering source code control using GitLab.

Basic Qualifications :

  • Experience with relational databases and knowledge of query tools and / or BI tools like Power BI or OBIEE and data analysis tools.
  • Extensive experience with SQL and proficiency in writing complex queries.
  • Solid understanding of data warehousing concepts and platforms such as Oracle and cloud-based solutions.
  • Strong experience in automating ETL jobs via UNIX / LINUX shell scripts and CRON jobs.
  • Demonstrate a strong practical understanding of data warehousing from a production relational database environment.
  • Strong experience using analytic functions within Oracle or similar tools within non-relational (MongoDB, Cassandra etc.) database systems.
  • Strong understanding of distributed computing principles and experience with frameworks like Apache Spark
  • Hands-on-experience with data lake architectures and technologies in a cloud environment.
  • Experience with Atlassian suite of tools such as Jira and Confluence
  • Knowledge of Continuous Integration & Continuous Development tools (CI / CD)
  • Must be able to multitask efficiently and progressively and work comfortably in an ever-changing data environment.
  • Must work well in a team environment as well as independently.
  • Excellent verbal / written communication and problem-solving skills; ability to communicate information to a variety of groups at different technical skill levels.
  • Preferred Qualifications :

  • 5+ years of experience in developing, maintaining, and optimizing complex Oracle PL / SQL packages to aggregate transactional data for consumption by data science / machine learning applications.
  • 10+ years of experience in working in data engineering, with a focus on building and optimizing data pipelines and architectures. Must have full life cycle experience in design, development, deployment, and monitoring.
  • Experience with one or more relational database systems such as Oracle, MySQL, Postgres, SQL server, with heavy emphasis on Oracle.
  • Extensive experience with cloud platforms (e.g. AWS, Google Cloud, etc) and cloud based ETL / ELT tools.
  • Experience with Amazon services such as S3, Redshift, EMR and Scala.
  • Experience with migrating on-prem legacy database objects and data to the Amazon S3 cloud environment.
  • Experience or familiarity with data science / machine learning and development experience for supervised and unsupervised learning with structure and unstructured datasets.
  • Certifications in relevant technologies (e.g. AWS Certified Big Data, Google Professional Data Engineer) are a plus.
  • Create a job alert for this search

    Data Engineer Remote • Ashburn, VA, United States

    Related jobs
    Data Engineer

    Data Engineer

    Crystal Management | CMIT • Vienna, VA, United States
    Full-time
    CMiT is seeking an experienced Data Engineer to help lead the analysis, documentation, and migration of a ~2TB Oracle database environment to PostgreSQL. This role involves mapping complex data depe...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer (Databricks)

    Senior Data Engineer (Databricks)

    Infinitive Inc • Ashburn, VA, US
    Full-time
    Quick Apply
    Candidates must possess work authorization which does not require sponsorship by the employer for a visa.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and ...Show more
    Last updated: 30+ days ago
    Lead Ab Initio Data Engineer

    Lead Ab Initio Data Engineer

    ALTA IT Services • Reston, VA, US
    Temporary
    Lead Data Engineer (Ab Initio / AWS / Data Pipelines) Location : Reston, VA (Hybrid – onsite roughly once every 1–2 months) Duration : 12-Month Contract About the Role We’re looking for a Lead Data E...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Capital One • Pimmit, VA, US
    Full-time +1
    Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery en...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Forge Group, LLC • Reston, VA, USA
    Full-time
    Quick Apply
    Forge is a global solutions provider.We are a proud, certified 8a, woman-owned, service-disabled, veteran-owned small business (8a, WOSB, SDVOSB). We are known as international problem fixers who on...Show more
    Last updated: 7 days ago
    Data Engineer

    Data Engineer

    Altus Consulting Corp • Herndon, VA, USA
    Full-time
    Quick Apply
    Altus Consulting is seeking a skilled Data Engineer to join our dynamic team.You will be responsible for designing, developing, and maintaining data pipelines and infrastructure that provide reliab...Show more
    Last updated: 30+ days ago
    Data Engineer-Kaiserslautern, Germany

    Data Engineer-Kaiserslautern, Germany

    JANSON • Fairfax, Virginia, US
    Full-time
    Scroll down to find the complete details of the job offer, including experience required and associated duties and tasks. COMPANY is seeking a •Data Engineer • to join a cutting-edge initiative in su...Show more
    Last updated: 30+ days ago • Promoted
    Lead Software Engineer (Big Data / Cloudera Platform)

    Lead Software Engineer (Big Data / Cloudera Platform)

    Lumen Solutions Group, Inc. • Reston, VA, United States
    Full-time
    Lead Software Engineer (Big Data / Cloudera Platform).Reston, VA / Washington, DC (Hybrid - 1 Day per Month Onsite).Big Data platforms, Cloudera (CDP / CDH), and AWS. The ideal candidate will be an ex...Show more
    Last updated: 2 days ago • Promoted
    Cloud Engineer - SME

    Cloud Engineer - SME

    Pendulum LLC • Chantilly, VA, US
    Full-time
    Quick Apply
    JOB DESCRIPTION Clearance Level : .Top Secret / SCI with Full Scope Polygraph Skill Level(s) : Subject Matter Expert • use software such as Jira, Confluence, SharePoint, or similar to create...Show more
    Last updated: 30+ days ago
    Data Engineer

    Data Engineer

    Leidos Inc • Sterling, VA, United States
    Full-time
    At Leidos, we deliver innovative solutions through the efforts of our diverse and talented people who are dedicated to our customers' success. We empower our teams, contribute to our communities, an...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI Data Infra Engineer — Hybrid & Growth

    Senior AI Data Infra Engineer — Hybrid & Growth

    Adelphi • McLean, VA, United States
    Full-time
    A cutting-edge tech firm is seeking a Senior / Principal Software Engineer to develop secure data sharing middleware.The role requires expertise in software development and ML Ops.Ideal candidates wi...Show more
    Last updated: 6 hours ago • Promoted • New!
    Software Data Engineer

    Software Data Engineer

    ManTech • Springfield, Virginia, US
    Full-time
    MANTECH is seeking a motivated, career and customer-oriented Software Data Engineer to join our team in the Springfield, VA area. All candidates should make sure to read the following job descriptio...Show more
    Last updated: 3 days ago • Promoted
    Software Data Engineer

    Software Data Engineer

    MANTECH • Springfield, VA, United States
    Full-time
    Responsibilities include, but are not limited to : .Provide expert guidance on Enterprise Asset Management; Identify, recommend, and implement agreed upon leading industry practices, process methodol...Show more
    Last updated: 26 days ago • Promoted
    Data Engineer

    Data Engineer

    Credence • McLean, VA, US
    Full-time
    Quick Apply
    At Credence, we support our clients’ mission-critical needs, powered by technology.We provide cutting-edge solutions, including AI / ML, enterprise modernization, and advanced intelligence capabiliti...Show more
    Last updated: 30+ days ago
    Senior Data Engineer / AWS Data Engineer / Lead Data Engineer (REMOTE)

    Senior Data Engineer / AWS Data Engineer / Lead Data Engineer (REMOTE)

    Tap Growth ai • Falls Church, Virginia, US
    Remote
    Full-time +1
    We're Hiring : Programmer Analyst Principal! 🌟.We are seeking a skilled and experienced Programmer Analyst Principal to join our dynamic team. The ideal candidate will possess extensive knowledge in...Show more
    Last updated: 29 days ago
    Data Engineer

    Data Engineer

    ThinkTek • Fairfax, VA, USA
    Full-time
    Quick Apply
    ThinkTek LLC is a fast-growing Certified SBA 8(a) and Service-Disabled Veteran-Owned Small Business (SDVOSB).We specialize in providing management and technology consulting services to support the ...Show more
    Last updated: 27 days ago
    Databricks Platform Engineer (AWS) - (TS / SCI)

    Databricks Platform Engineer (AWS) - (TS / SCI)

    North Point Technology • Gaithersburg, MD, US
    Full-time
    This job requires an active Top Secret / SCI clearance (with CI Polygraph eligibility).Please apply only if you currently hold an active Top Secret clearance with SCI eligibility.North Point Techno...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer – AI / ML Pipelines (Consultant)

    Data Engineer – AI / ML Pipelines (Consultant)

    BLN24 • McLean, VA, US
    Full-time
    Quick Apply
    Data Engineer – AI / ML Pipelines (Consultant) Company : BLN24 About Us : We find strength in teamwork-a better you is a better us BLN24 is an award-winning Management Consulting Firm that&...Show more
    Last updated: 30+ days ago