Talent.com
GCP Sr. Data Lead
GCP Sr. Data LeadE-Solutions • San Jose, CA, United States
GCP Sr. Data Lead

GCP Sr. Data Lead

E-Solutions • San Jose, CA, United States
6 days ago
Job type
  • Full-time
Job description

Title  : GCP Data Engineer

Location  : San Jose, CA

Duration  : 12+ Month

Job Description

We are seeking a highly skilled and experienced Data Engineer with a strong background in AI / ML to design, build, and optimize robust data pipelines and infrastructure on the Google Cloud Platform (GCP). The ideal candidate will be passionate about leveraging data to power machine learning initiatives, ensuring data quality, accessibility, and scalability for advanced analytics and AI applications.

MINIMUM 10 YEARS OF EXPERIENCE

Responsibilities

  • Data Pipeline Development : Design, build, and maintain scalable, efficient, and reliable ETL / ELT data pipelines for batch and real-time processing using GCP services (e.g., Dataflow, Dataproc, Cloud Composer, Pub / Sub).
  • AI / ML Data Preparation : Collaborate closely with Data Scientists and Machine Learning Engineers to understand data requirements for model training, evaluation, and serving. Prepare, transform, and curate large, diverse datasets (structured, unstructured, streaming) to optimize them for AI / ML workloads.

GCP Ecosystem Expertise : Leverage a wide range of GCP data and AI / ML services, including :

  • Data Warehousing & Storage : BigQuery (for analytics and BigQuery ML), Cloud Storage, Cloud SQL, Cloud Bigtable.
  • Data Processing : Dataflow, Dataproc (Spark, Hadoop), Cloud Composer (Apache Airflow), Data Fusion.
  • AI / ML Services : Vertex AI (for model training, deployment, MLOps, Pipelines, Workbench, AutoML), AI Platform, TensorFlow Enterprise, Keras, PyTorch.
  • Data Governance & Quality : Implement and enforce data quality, security, and governance standards throughout the data lifecycle, ensuring data accuracy, consistency, and compliance with regulations.
  • Performance Optimization : Monitor, troubleshoot, and optimize the performance and cost-effectiveness of data pipelines and AI / ML infrastructure.
  • Automation & MLOps : Automate data processes, develop CI / CD pipelines for data and ML models, and contribute to MLOps best practices for seamless deployment and monitoring of AI / ML solutions.
  • Collaboration & Communication : Work effectively with cross-functional teams, including Data Scientists, Analysts, Software Engineers, and Product Managers, to understand data needs and deliver impactful solutions.
  • Innovation & Research : Stay up-to-date with the latest advancements in data engineering, AI / ML, and GCP technologies, continuously exploring and recommending new tools and approaches.
  • Qualifications

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related quantitative field.
  • Proven experience as a Data Engineer, with a strong focus on building data solutions for AI / ML applications.
  • In-depth knowledge and hands-on experience with Google Cloud Platform (GCP) data services (BigQuery, Dataflow, Dataproc, Cloud Storage, Cloud Composer, etc.).
  • Strong proficiency in programming languages such as Python (essential), and experience with Scala or Java is a plus.
  • Expertise in SQL and experience with various database technologies (relational, NoSQL, data warehouses).
  • Familiarity with machine learning concepts, algorithms, and workflows (e.g., feature engineering, model training, evaluation, deployment).
  • Experience with machine learning frameworks like TensorFlow or PyTorch.
  • Understanding of distributed systems, big data technologies, and real-time data processing.
  • Experience with version control systems (e.g., Git) and CI / CD practices.
  • Excellent problem-solving, analytical, and communication skills.
  • Google Cloud Professional Data Engineer certification is a strong plus.
  • #J-18808-Ljbffr

    Create a job alert for this search

    Lead Gcp • San Jose, CA, United States

    Related jobs
    Senior Master Data Governance & Strategy Lead

    Senior Master Data Governance & Strategy Lead

    Ernst & Young Oman • Palo Alto, CA, United States
    Full-time
    A global consulting firm is seeking a Senior Consultant for Data Management technology.This role involves designing data governance frameworks, enhancing data management capabilities, and implement...Show more
    Last updated: 7 days ago • Promoted
    Recovery Specialist II (On Call) - Behavioral Health 194 195

    Recovery Specialist II (On Call) - Behavioral Health 194 195

    Telecare Corporation • Santa Cruz, CA, United States
    Full-time
    Telecare's mission is to deliver excellent and effective behavioral health services that engage individuals in recovering their health, hopes, and dreams. Telecare continues to advance cultural dive...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Director - Health Systems Liaisons - West Team Lead (REMOTE)

    Sr. Director - Health Systems Liaisons - West Team Lead (REMOTE)

    Kaye / Bassman International • Hayward, CA, US
    Remote
    Full-time
    Kaye / Bassman International is a leading executive search firm that has been filling roles for Pharma and Biotech clients for over 35 years. Our Medical Affairs search practice is led by Michael Piet...Show more
    Last updated: 12 days ago • Promoted
    Director of Data Platforms

    Director of Data Platforms

    Bridge Analytics • Hayward, CA, United States
    Full-time
    Director of Data Platforms, Bridge Analytics.South San Francisco, CA (Hybrid, 2 days / week in office).Bridge Analytics is a pioneering, not-for-profit organization with a vital mission : to accelerat...Show more
    Last updated: 7 hours ago • Promoted • New!
    Sr. Statistical Programmer

    Sr. Statistical Programmer

    Redbock - an NES Fircroft company • Hayward, CA, US
    Full-time
    Our client is seeking a Senior Statistical Programming consultant with recent experience leading a submission.This individual will play a critical role in driving Statistical Programming e- submiss...Show more
    Last updated: 30+ days ago • Promoted
    Senior Cyber Defense & Data Lake Consultant

    Senior Cyber Defense & Data Lake Consultant

    Deloitte Touche Tohmatsu Ltd • Palo Alto, CA, United States
    Full-time
    A leading professional services firm in California is seeking a Senior Consultant in Cyber Defense & Resilience.The role involves designing cyber data programs and enhancing AI capabilities.Candida...Show more
    Last updated: 6 days ago • Promoted
    Senior Manager, REMS Data Programmer

    Senior Manager, REMS Data Programmer

    Jazz Pharmaceuticals • Fremont, California, USA
    Full-time
    If you are a current Jazz employee please apply via the Internal Career site.Jazz Pharmaceuticals is a global biopharma company whose purpose is to innovate to transform the lives of patients and ...Show more
    Last updated: 2 days ago • Promoted
    Travel CT Tech - $2860 / Week

    Travel CT Tech - $2860 / Week

    Uniti Med • Santa Cruz, CA, US
    Full-time
    Uniti Med is seeking an experienced CT Tech for an exciting Travel Allied job in Santa Cruz, CA.Shift : Inquire Start Date : 12 / 08 / 2025 Duration : 13 weeks Pay : $2860 / Week.Uniti Med provides career ...Show more
    Last updated: 27 days ago • Promoted
    Associate Director, Field Access Ops and Patient Services Analytics

    Associate Director, Field Access Ops and Patient Services Analytics

    Ardelyx • Fremont, CA, United States
    Full-time
    Ardelyx is a publicly traded commercial biopharmaceutical company founded with a mission to discover, develop and commercialize innovative first-in-class medicines that meet significant unmet medic...Show more
    Last updated: 27 days ago • Promoted
    Team Lead

    Team Lead

    Tempur Sealy • Palo Alto, CA, United States
    Full-time
    Tempur Sealy is committed to improving the sleep of more people, every night, all around the world.As a leading designer, manufacturer, distributor, and retailer of bedding products worldwide, we k...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Solution Sales Executive - Data and Analytics - SLED - West

    Sr. Solution Sales Executive - Data and Analytics - SLED - West

    ServiceNow • Santa Clara, CA, US
    Full-time
    Solution Sales Executive - Data and Analytics - SLED - West.It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work.F...Show more
    Last updated: 2 hours ago • Promoted • New!
    GTM Data Strategy Director

    GTM Data Strategy Director

    Elastic • Mountain View, CA, United States
    Full-time
    A leading tech company in California seeks a Director of Customer Data Strategy to drive data governance and strategy across the enterprise. The role involves defining a data roadmap, ensuring adopt...Show more
    Last updated: 6 days ago • Promoted
    Principal Product Manager, Data Platform

    Principal Product Manager, Data Platform

    Medallia, Inc. • Pleasanton, CA, United States
    Full-time
    Medallia is the pioneer and market leader in Experience Management.Our award-winning SaaS platform, Medallia Experience Cloud, leads the market in the management of experiences, insights, and actio...Show more
    Last updated: 17 days ago • Promoted
    SLP

    SLP

    National Staffing Solutions • Santa Cruz, CA, US
    Full-time
    Details of the SLP opening in Santa Cruz, CA : .Anticipated Start Date : 12 / 15 / 2025.Anticipated Pay Range : $1782 - $2058. Anticipated Duration of Assignment : 13 Weeks.Anticipated Schedule : 5x8 Days.We`...Show more
    Last updated: 1 day ago • Promoted
    Director, Nonclinical Development

    Director, Nonclinical Development

    Amber Bio • Hayward, CA, US
    Full-time
    Amber Bio is a biotechnology company pioneering new gene editing modalities using multi-kilobase edits to reach previously undruggable patient populations. Founded by pioneers in the CRISPR field fr...Show more
    Last updated: 15 days ago • Promoted
    GCP Data Architect

    GCP Data Architect

    Tror AI for everyone • Santa Clara, CA, United States
    Full-time
    Quick Apply
    Role : GCP Data Architect Location : Santa Clara CA (Local only) H1B, h4ead required < / ...Show more
    Last updated: 4 days ago
    Travel Echo Tech - $2958 / Week

    Travel Echo Tech - $2958 / Week

    LRS Healthcare - Allied • Santa Cruz, CA, US
    Full-time
    LRS Healthcare - Allied is seeking an experienced Echo Tech for an exciting Travel Allied job in Santa Cruz, CA.Shift : Inquire Start Date : ASAP Duration : 13 weeks Pay : $2958 / Week.Ready to start y...Show more
    Last updated: 3 days ago • Promoted
    Sales Director (26821)

    Sales Director (26821)

    Supermicro • San Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show more
    Last updated: 30+ days ago • Promoted