Talent.com
Inherent Technologies
Senior Data EngineerInherent Technologies • San Jose, CA, United States
Senior Data Engineer

Senior Data Engineer

Inherent Technologies • San Jose, CA, United States
Hace 5 días
Tipo de contrato
  • A tiempo completo
  • Quick Apply
Descripción del trabajo

Position: Senior Data Engineer

Location: SAN JOSE, CA***Onsite***

Duration: 1 Year

Responsibilities

  • Lead the end-to-end migration (transformation and load) of high-volume, high-complexity data into a new PostgreSQL-based infrastructure
  • Design, build, and maintain robust ETL/ELT pipelines capable of processing millions of records reliably and efficiently
  • Map and reconcile complex legacy data structures across multiple business entities into a unified target schema
  • Define and implement data validation frameworks to ensure integrity, completeness, and accuracy throughout the migration
  • Optimize pipeline performance, including query tuning, indexing strategy, and batch/incremental load design in PostgreSQL
  • Identify, troubleshoot, and resolve data quality issues, schema mismatches, and pipeline failures
  • Document data mappings, transformation logic, and migration runbooks for engineering and business stakeholders
  • Partner with business and technical stakeholders to align migration scope, timelines, and data requirements
  • Establish monitoring, logging, and alerting to track pipeline health and data quality post-migration
  • Mentor junior data engineers and contribute to engineering best practices and standards

Required Qualifications

  • 5+ years of experience in data engineering, with demonstrated ownership of large-scale data migration projects
  • Strong to expert-level proficiency in Python for building and automating data pipelines
  • Deep hands-on experience with PostgreSQL/Oracle , including schema design, query optimization, and performance tuning
  • Proven experience designing and managing ETL/ELT pipelines at scale (millions of records)
  • Experience mapping and transforming complex, legacy data structures across disparate systems or business entities
  • Strong understanding of data validation, reconciliation, and quality assurance techniques
  • Solid grasp of data modeling principles (normalization, indexing, partitioning)
    Experience with version control (Git) and CI/CD practices for data pipelines

Preferred Qualifications

  • Experience with orchestration tools (e.g., Airflow, Dagster, Prefect)
  • Familiarity with cloud data platforms (AWS, GCP, or Azure)
  • Experience with other relational or NoSQL databases and cross-database migrations
  • Background working in regulated or high-stakes data environments (finance, healthcare, etc.)
  • Experience with containerization (Docker) and infrastructure-as-code
  • Exposure to data quality/testing frameworks (e.g., Great Expectations, dbt tests)

What Success Looks Like

  • A fully migrated, validated dataset in PostgreSQL with zero critical data loss or corruption
  • ETL/ELT pipelines that are documented, repeatable, and optimized for ongoing operation
  • A clear audit trail of data lineage and validation results across all business entities involved
Crear una alerta de empleo para esta búsqueda

Senior Data Engineer • San Jose, CA, United States

Ofertas similares

Data Engineer

SynergisticITFremont, CA, United States
A tiempo completo

Launch Your Data Career with Proof, Not PromisesAt SynergisticitIf you're serious about starting a high-impact, high-paying career in Data Science, Analytics, or Engineering, it's time to stop gues... Mostrar más

 • Oferta promocionada

Data Engineer - Remote

EXPERISSunnyvale, CA, United States
Teletrabajo
A tiempo completo

Data EngineerWe're hiring a Data Engineer to design, build, and operate the data pipelines and platform that power analytics and AI / ML use cases.You'll own batch and streaming ingestion, transfor... Mostrar más

 • Oferta promocionada

Travel CT Tech - $2975.22 / Week

Medical SolutionsSanta Cruz, CA, US
A tiempo completo

Medical Solutions is seeking an experienced CT Tech for an exciting Travel Allied job in Santa Cruz, CA.Shift: 8 hr PMs Start Date: ASAP Duration: 13 weeks Pay: $2975.A facility in Santa Cruz, CA i... Mostrar más

 • Oferta promocionada

Data Engineer

InterSourcesFremont, CA, United States
A tiempo completo

Certified Databricks ConsultantLocation:TX/GA/CADuration:Long-termClient:IBM/AT&TSkills:Need certified Databricks consultant with good experience in Spark and PySpark.Experience with Azure, Pyt... Mostrar más

 • Oferta promocionada

Senior Engineer: AI Applications SF, NYC, Remote

SwayablePalo Alto, CA, United States
Teletrabajo
A tiempo completo

About SwayableSwayable is a fast-growing cloud data product that doubles the impact of advertising by empirically measuring how it changes people's opinions.Our partners include Amazon, Meta, IBM, ... Mostrar más

 • Oferta promocionada

Lead Data Engineer

QcellsSanta Clara, CA, US
A tiempo completo

This role provides technical leadership in designing and optimizing ETL/ELT frameworks using Azure data services (Fabric, Data Lake, Data Factory), integrating data from ERP, CRM, and operational s... Mostrar más

Remote Senior Data Engineer - AI-Powered Pipelines

Altimate.aiSunnyvale, CA, United States
Teletrabajo
A tiempo completo

A leading AI-driven data solutions company in California is seeking a Senior Software Engineer to enhance AI capabilities and build scalable data infrastructures.You will design robust data systems... Mostrar más

 • Oferta promocionada

Data Engineer

ShiftCode AnalyticsSan Ramon, CA, United States
A tiempo completo

Data EngineerLocation:San Ramon, CA (100% Onsite)Duration:6-12 MonthsPositions:2Start Date:1/9/23Job Description:Integrate, extract the data using ETL and inject using AWS, build pipeline from AWS ... Mostrar más

 • Oferta promocionada

Staff Software Engineer, Data Frameworks

Ridge Line ServicesSan Ramon, CA, United States
A tiempo completo

Staff Software Engineer, Data FrameworksAre you a seasoned engineer passionate about transforming data into a powerful business asset? Do you thrive in environments where you can lead by example, m... Mostrar más

 • Oferta promocionada

Remote Data Entry - Product Support - $45 per hour

GL Inc.Santa Cruz, California
45,00 US$ por hora
Teletrabajo
A tiempo parcial +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Mostrar más

 • Oferta promocionada

Lead AI Data Engineer (Remote)

Allocate Holdings Inc.Palo Alto, CA, United States
Teletrabajo
A tiempo completo

Summary Allocate is looking for a Lead AI Data Engineer to design and implement the foundational data infrastructure that will power our AI-driven portfolio analysis and investment recommendation a... Mostrar más

 • Oferta promocionada

Software Principal Engineer- Data Storage

DellCupertino, CA, United States
A tiempo completo

Software Principal EngineerThe Software Engineering team delivers next-generation application enhancements and new products for a changing world.Working at the cutting edge, we design and develop s... Mostrar más

 • Oferta promocionada

Senior Hadoop Architect -- Remote Data Platform Lead

Tredence Inc.San Jose, CA, United States
Teletrabajo
A tiempo completo

A consulting firm is seeking a Principal Hadoop Architect to lead the optimization of a large-scale Big Data ecosystem.This role involves defining design standards and ensuring a highly optimized o... Mostrar más

 • Oferta promocionada

Senior DevOps Engineer

Scout MotorsFremont, CA, United States
A tiempo completo

Senior DevOps EngineerHere at Scout Motors, we're carrying forward the heritage of one of the most iconic American vehicles in history.One that forged the path for future generations of rugged SUVs... Mostrar más

 • Oferta promocionada

Data Engineer

Staffing the UniverseSanta Clara, CA, United States
A tiempo completo

Data EngineerLocation:RemoteExperience:4YearsAbout the Role:A Fintech is seeking a strong and passionate data engineer with experience in large scale system implementation, with a focus on complex ... Mostrar más

 • Oferta promocionada

Senior Software Engineer - Data Infrastructure

Applied IntuitionSunnyvale, CA, United States
A tiempo completo

Senior Software Engineer - Data InfrastructureApplied Intuition, Inc.Founded in 2017 and now valued at $15 billion, the Silicon Valley company is creating the digital infrastructure needed to bring... Mostrar más

 • Oferta promocionada

Remote Data Engineer

Global Channel ManagementSanta Clara, CA, United States
Teletrabajo
A tiempo completo

About the job Remote Data EngineerRemote Data Engineer needs 10 years experienceRemote Data Engineer requires :Must be local top Santa ClaraCloud Platform Expertise (GCP Focus) :Extensive hands-on ... Mostrar más

 • Oferta promocionada

Data Engineer (Python, Data Engg, Kafka) | Hybrid

Kaav Inc.Sunnyvale, CA, United States
A tiempo completo

Marketing Technology Team PositionThe Marketing Technology team has the mandate of increasing the rate of customer acquisition, retention, and revenue by optimizing products and inventing new marke... Mostrar más

 • Oferta promocionada

Staff Software Engineer, Data (Bay Area / Paris / Remote)

GenesisAISunnyvale, CA, United States
Teletrabajo
A tiempo completo

What You'll DoDesign, build, and maintain large-scale data pipelines (batch and streaming) for robotics foundation model training and evaluation at petabyte scaleOwn core data infrastructure :data ... Mostrar más

 • Oferta promocionada

People Operations Lead

Heron PowerScotts Valley, CA, United States
A tiempo completo

Senior People Operations Specialist.Heron Power is a startup building cutting-edge power electronics for the 21st-century grid.We aim to debottleneck the growth of electricity generation and consum... Mostrar más