Talent.com
Data Engineer - GCP & Python / Pyspark

Data Engineer - GCP & Python / Pyspark

Aifa SolutionsLos Gatos, CA, United States
4 days ago
Job type
  • Temporary
Job description

Job Title : Data Engineer - GCP & Python / Pyspark

Location : Phoenix, AZ / / New York ( hybrid)

Job Type : 6-12 months Contract Role

Position : W2

About the Role

We are seeking an experienced Data Engineer with strong hands-on expertise in Google Cloud Platform (GCP) services and Python programming. The ideal candidate will build and optimize scalable data pipelines, manage workflows, and ensure seamless data ingestion, transformation, and processing.

Key Responsibilities

  • Design, develop, and maintain data pipelines and workflows using GCP services (Airflow, Pub / Sub, Dataproc, BigQuery).
  • Develop Airflow DAGs for orchestrating complex ETL / ELT processes.
  • Implement scalable data ingestion, transformation, and storage solutions on GCP.
  • Write and optimize SQL queries to extract, transform, and load data efficiently.
  • Leverage Python programming to build reusable data processing components and scripts.
  • Collaborate with cross-functional teams (data scientists, analysts, engineers) to support data-driven initiatives.
  • Ensure data quality, reliability, and security across all pipelines.

Required Skills & Experience

  • Strong hands-on experience with GCP services including Airflow, Pub / Sub, Dataproc, and BigQuery.
  • Proficiency in Python programming for data engineering tasks.
  • Expertise in SQL and relational database concepts.
  • Solid understanding of ETL / ELT design patterns and data modeling.
  • Experience with workflow orchestration tools and scalable data pipelines.
  • Strong problem-solving skills and ability to work in an agile environment.
  • Nice-to-Have

  • Experience with Cloud Storage, Dataflow, or other GCP services.
  • Familiarity with CI / CD pipelines and containerization (Docker / Kubernetes).
  • Knowledge of data governance and security best practices.
  • Create a job alert for this search

    Data Engineer Gcp • Los Gatos, CA, United States

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    INSPYR SolutionsCupertino, CA, United States
    Full-time
    ABOUT THIS FEATURED OPPORTUNITY.AI teams that depend on high-quality datasets to train their models.You'll work at the intersection of. These include use cases such as.Many projects are highly confi...Show moreLast updated: 4 days ago
    • Promoted
    Data Analysis Engineer (Python / Tableau ON-SITE)

    Data Analysis Engineer (Python / Tableau ON-SITE)

    OSI EngineeringCupertino, CA, US
    Full-time
    Seeking a Data Analysis Engineer.The role involves building Tableau dashboards, Python scripting, and working with hardware-generated data. This role will focus on building interactive Tableau dashb...Show moreLast updated: 1 day ago
    • Promoted
    Sr Data Engineer with GCP, Spark, Python

    Sr Data Engineer with GCP, Spark, Python

    InterSourcesSunnyvale, CA, United States
    Full-time
    Sr Data Engineer with GCP, Spark, Python.Experience building data pipelines in GCP.GCP Dataproc, GCS & BIGQuery experience. Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are re...Show moreLast updated: 4 days ago
    • Promoted
    GCP - Data Engineer

    GCP - Data Engineer

    Omni InclusiveSan Jose, CA, United States
    Full-time
    Strong knowledge in writing and interpreting complex SQL queries - Experience in GCP.Strong ability to design, develop, test and maintain ETL solution in Google Cloud Platform especially in BigQuey...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer GCP

    Data Engineer GCP

    Interaction24 LLCSunnyvale, CA, United States
    Full-time
    About the job Data Engineer GCP.GoogleAds Expertise is a plus (campaign / adsgroups setup APIs).Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ApTaskSunnyvale, CA, United States
    Full-time
    The client provides information technology (IT) services, including business outsourcing, infrastructure technology, and application services. The application service offered by the company includes...Show moreLast updated: 4 days ago
    • Promoted
    Data engineer with python

    Data engineer with python

    Info Way SolutionsFremont, CA, United States
    Full-time
    Role : Data Engineer (with strong Python and AWS experience).Design, implement, and manage robust data pipelines using Python, PySpark, SQL to efficiently extract, transform, and load data from div...Show moreLast updated: 4 days ago
    • Promoted
    Data engineer (Tableau, Python, Snowflake) @ Sunnyvale, CA

    Data engineer (Tableau, Python, Snowflake) @ Sunnyvale, CA

    Diverse LynxSunnyvale, CA, United States
    Full-time
    Key Skills : Data engineer (Tableau, Python, Snowflake).Location : Sunnyvale, CA ( 3days Hybrid).The ideal candidate will excel at collaborating with business users, cross-functional teams, and offsh...Show moreLast updated: 4 days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Axiom Software Solutions LimitedSunnyvale, CA, United States
    Full-time
    Strong expertise coding in Snowflake and Python with 5+ years of experience.Hands on knowledge of Spark and PySpark is an added advantage. Ability to collaborate with business users to gather requir...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TranzealSunnyvale, CA, United States
    Full-time
    Design, build, and maintain robust data pipelines using Apache Spark and Python.Develop and manage workflow orchestration using Apache Airflow. Implement scalable data solutions on Google Cloud Plat...Show moreLast updated: 4 days ago
    • Promoted
    Lead AI Engineer (GenAI Platform Services, Python)

    Lead AI Engineer (GenAI Platform Services, Python)

    Capital OneSan Jose, CA, United States
    Full-time +1
    Lead AI Engineer (GenAI Platform Services, Python).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader ...Show moreLast updated: 4 days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Diverse LynxSunnyvale, CA, United States
    Full-time
    Lead the design and implementation of scalable data ingestion architectures and pipelines into Snowflake.Develop, maintain, and optimize ETL / ELT processes using Snowflake features like Snowpipe, St...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Diverse LynxPleasanton, CA, United States
    Full-time
    Job Overview : We are seeking a talented and motivated Data Engineer with expertise in Spark SQL, Databricks, Azure Data Factory (ADF), SQL, IICS, Unix, PySpark, Python, and Azure Data Lake Storage ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Keylent IncSunnyvale, CA, United States
    Full-time
    We are looking for Data Engineer in Sunnyvale,CA.Day 1 onsite ( 3 days a week hybrid).FTE- 130k per annum + benefits.Subcon-73 $ per hour ( no layers are accepted). Strong Python development and sof...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer(SQl, Python)

    Data Engineer(SQl, Python)

    Tata Consultancy ServicesSunnyvale, CA, United States
    Full-time
    Must Have Technical / Functional Skills.Expert-level proficiency in SQL, including performance tuning, window functions, CTEs, and analytical queries. Strong Python skills for scripting, data processi...Show moreLast updated: 4 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    GlobalchannelmanagementSan Francisco, CA, US
    Full-time
    AWS Data Engineer needs 7+ years of experience in Amazon Web Services (AWS) Cloud Computing.Strong background in designing, developing, and maintaining scalable data pipelines for ingestion and pro...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tailored ManagementSan Francisco, CA, United States
    Full-time
    Job Description : Proficiency in Spark, Python, and SQL is essential for this role.Experience with relational databases such as Oracle, NoSQL databases including MongoDB and Cassandra, and big data ...Show moreLast updated: 4 days ago
    • Promoted
    Data Analysis Engineer (Python / Tableau)

    Data Analysis Engineer (Python / Tableau)

    OSI EngineeringSanta Clara, CA, US
    Full-time
    Overview : Seeking a Data Analysis Engineer.The role involves building Tableau dashboards, Python scripting, and working with hardware-generated data. This role will focus on building interactive Tab...Show moreLast updated: 30+ days ago