Talent.com
GCP Sr. Data Lead
GCP Sr. Data LeadE-Solutions • San Jose, CA, United States
No longer accepting applications
GCP Sr. Data Lead

GCP Sr. Data Lead

E-Solutions • San Jose, CA, United States
7 days ago
Job type
  • Full-time
Job description

Title  : GCP Data Engineer

Location  : San Jose, CA

Duration  : 12+ Month

Job Description

We are seeking a highly skilled and experienced Data Engineer with a strong background in AI / ML to design, build, and optimize robust data pipelines and infrastructure on the Google Cloud Platform (GCP). The ideal candidate will be passionate about leveraging data to power machine learning initiatives, ensuring data quality, accessibility, and scalability for advanced analytics and AI applications.

MINIMUM 10 YEARS OF EXPERIENCE

Responsibilities

  • Data Pipeline Development : Design, build, and maintain scalable, efficient, and reliable ETL / ELT data pipelines for batch and real-time processing using GCP services (e.g., Dataflow, Dataproc, Cloud Composer, Pub / Sub).
  • AI / ML Data Preparation : Collaborate closely with Data Scientists and Machine Learning Engineers to understand data requirements for model training, evaluation, and serving. Prepare, transform, and curate large, diverse datasets (structured, unstructured, streaming) to optimize them for AI / ML workloads.

GCP Ecosystem Expertise : Leverage a wide range of GCP data and AI / ML services, including :

  • Data Warehousing & Storage : BigQuery (for analytics and BigQuery ML), Cloud Storage, Cloud SQL, Cloud Bigtable.
  • Data Processing : Dataflow, Dataproc (Spark, Hadoop), Cloud Composer (Apache Airflow), Data Fusion.
  • AI / ML Services : Vertex AI (for model training, deployment, MLOps, Pipelines, Workbench, AutoML), AI Platform, TensorFlow Enterprise, Keras, PyTorch.
  • Data Governance & Quality : Implement and enforce data quality, security, and governance standards throughout the data lifecycle, ensuring data accuracy, consistency, and compliance with regulations.
  • Performance Optimization : Monitor, troubleshoot, and optimize the performance and cost-effectiveness of data pipelines and AI / ML infrastructure.
  • Automation & MLOps : Automate data processes, develop CI / CD pipelines for data and ML models, and contribute to MLOps best practices for seamless deployment and monitoring of AI / ML solutions.
  • Collaboration & Communication : Work effectively with cross-functional teams, including Data Scientists, Analysts, Software Engineers, and Product Managers, to understand data needs and deliver impactful solutions.
  • Innovation & Research : Stay up-to-date with the latest advancements in data engineering, AI / ML, and GCP technologies, continuously exploring and recommending new tools and approaches.
  • Qualifications

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related quantitative field.
  • Proven experience as a Data Engineer, with a strong focus on building data solutions for AI / ML applications.
  • In-depth knowledge and hands-on experience with Google Cloud Platform (GCP) data services (BigQuery, Dataflow, Dataproc, Cloud Storage, Cloud Composer, etc.).
  • Strong proficiency in programming languages such as Python (essential), and experience with Scala or Java is a plus.
  • Expertise in SQL and experience with various database technologies (relational, NoSQL, data warehouses).
  • Familiarity with machine learning concepts, algorithms, and workflows (e.g., feature engineering, model training, evaluation, deployment).
  • Experience with machine learning frameworks like TensorFlow or PyTorch.
  • Understanding of distributed systems, big data technologies, and real-time data processing.
  • Experience with version control systems (e.g., Git) and CI / CD practices.
  • Excellent problem-solving, analytical, and communication skills.
  • Google Cloud Professional Data Engineer certification is a strong plus.
  • #J-18808-Ljbffr

    Create a job alert for this search

    Lead Gcp • San Jose, CA, United States

    Related jobs
    Director - Data Governance

    Director - Data Governance

    Veracity • Santa Clara, CA, United States
    Temporary
    The Data Governance leader role is critical to the success of our data-driven initiatives.As we continues to expand its data capabilities, the complexity and scale of our data environments have inc...Show more
    Last updated: 30+ days ago • Promoted
    North America Enterprise Sales Lead — Data Hardware

    North America Enterprise Sales Lead — Data Hardware

    ByteDance • San Jose, CA, United States
    Full-time
    A leading tech company located in San Jose, California, is seeking a Head of Enterprise Sales.The candidate will be responsible for achieving revenue targets across the North American market and de...Show more
    Last updated: 13 hours ago • Promoted • New!
    Program Director (Provider Data Mgmt)

    Program Director (Provider Data Mgmt)

    Molina Healthcare • San Jose, CA, US
    Full-time
    JOB DESCRIPTION Job Summary Lead operational readiness initiatives across provider data and credentialing functions, supporting both new implementations and ongoing enhancements.This role is critic...Show more
    Last updated: 4 days ago • Promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Oppo Us Research Center • Palo Alto, California, United States
    Full-time
    OPPO US Research Center is looking for a highly motivated Data Engineer.In this role, you will be responsible for designing and implementing robust data warehouse architectures, enabling data-drive...Show more
    Last updated: 18 days ago • Promoted
    GTM Partner Lead for Databricks

    GTM Partner Lead for Databricks

    SAP • Palo Alto, California, USA
    Full-time +1
    At SAP we keep it simple : you bring your best to us and well bring out the best in you.Were builders touching over 20 industries and 80% of global commerce and we need your unique talents to help s...Show more
    Last updated: 22 days ago • Promoted
    Lead Data Analyst Engineer

    Lead Data Analyst Engineer

    PSRTEK • Sunnyvale, California, USA
    Full-time
    Experience in the shipping and freight domain.Experience in Shipping / Carriers / Modes of delivery / Metrics.Experience in Logistics Procurement and Invoice. Experience in Transport warehouse...Show more
    Last updated: 1 day ago • Promoted
    Director of Data Platforms

    Director of Data Platforms

    Bridge Analytics • Hayward, CA, United States
    Full-time
    Director of Data Platforms, Bridge Analytics.South San Francisco, CA (Hybrid, 2 days / week in office).Bridge Analytics is a pioneering, not-for-profit organization with a vital mission : to accelerat...Show more
    Last updated: 22 hours ago • Promoted • New!
    Senior Manager, REMS Data Programmer

    Senior Manager, REMS Data Programmer

    Jazz Pharmaceuticals • Fremont, California, USA
    Full-time
    If you are a current Jazz employee please apply via the Internal Career site.Jazz Pharmaceuticals is a global biopharma company whose purpose is to innovate to transform the lives of patients and ...Show more
    Last updated: 3 days ago • Promoted
    Senior Cyber Defense & Data Lake Consultant

    Senior Cyber Defense & Data Lake Consultant

    Deloitte Touche Tohmatsu Ltd • Palo Alto, CA, United States
    Full-time
    A leading professional services firm in California is seeking a Senior Consultant in Cyber Defense & Resilience.The role involves designing cyber data programs and enhancing AI capabilities.Candida...Show more
    Last updated: 7 days ago • Promoted
    Senior Vice President Data & Trisus Platform Engineering (San Jose)

    Senior Vice President Data & Trisus Platform Engineering (San Jose)

    Confidential • San Jose, CA, US
    Part-time
    Senior Vice President Data & Trisus Platform Engineering.Innovative healthcare revenue cycle management (RCM) software provider. The Company is seeking a Senior Vice President for Data and Platform ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Pipelines & Performance Engineer

    Senior Data Pipelines & Performance Engineer

    xage, inc • Palo Alto, CA, US
    Full-time
    A leading zero trust security company in Palo Alto, CA seeks a Principal Software Engineer specializing in data pipelines. This role involves collaboration with engineers to build internal data syst...Show more
    Last updated: 4 days ago • Promoted
    SAP BTP Integration Lead

    SAP BTP Integration Lead

    Shrive Technologies LLC • Fremont, California, USA
    Full-time
    Strong 10 years experience in SAP BTP CI BTP APIM PIPO.Strong experience in developing and implementing integration solutions using SAP BTP ensuring seamless connectivity and data flow across vario...Show more
    Last updated: 22 days ago • Promoted
    GTM Partner Lead for Snowflake

    GTM Partner Lead for Snowflake

    SAP SE • Palo Alto, California, United States
    Full-time +1
    At SAP, we keep it simple : you bring your best to us, and we'll bring out the best in you.We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to h...Show more
    Last updated: 4 days ago • Promoted
    Sr. Solution Sales Executive - Data and Analytics - SLED - West

    Sr. Solution Sales Executive - Data and Analytics - SLED - West

    ServiceNow • Santa Clara, CA, US
    Full-time
    Solution Sales Executive - Data and Analytics - SLED - West.It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work.F...Show more
    Last updated: 17 hours ago • Promoted • New!
    GTM Data Strategy Director

    GTM Data Strategy Director

    Elastic • Mountain View, CA, United States
    Full-time
    A leading tech company in California seeks a Director of Customer Data Strategy to drive data governance and strategy across the enterprise. The role involves defining a data roadmap, ensuring adopt...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Strategy & Governance Lead

    Senior Data Strategy & Governance Lead

    Databricks Inc. • Mountain View, CA, United States
    Full-time
    A leading data and AI company is seeking a Senior Manager of Data Strategy in San Francisco.This role involves leading data governance and management for FP&A, ensuring a single source of truth for...Show more
    Last updated: 1 hour ago • Promoted • New!
    GCP Data Architect

    GCP Data Architect

    Tror AI for everyone • Santa Clara, CA, United States
    Full-time
    Quick Apply
    Role : GCP Data Architect Location : Santa Clara CA (Local only) H1B, h4ead required < / ...Show more
    Last updated: 4 days ago
    GCP Data Architect ONSITE INDEPENDENT visa only

    GCP Data Architect ONSITE INDEPENDENT visa only

    TestingXperts Inc. DBA Damcosoft • Santa Clara, CA, United States
    Full-time +2
    Quick Apply
    Role : GCP Data Architect Location : Santa Clara CA (100% Onsite) Show more
    Last updated: 1 day ago