Talent.com
Data Engineer -(GCP,Airflow,Pyspark) Hybrid-Sunnyvale,CA
Data Engineer -(GCP,Airflow,Pyspark) Hybrid-Sunnyvale,CAKaav Inc. • Sunnyvale, CA, United States
Data Engineer -(GCP,Airflow,Pyspark) Hybrid-Sunnyvale,CA

Data Engineer -(GCP,Airflow,Pyspark) Hybrid-Sunnyvale,CA

Kaav Inc. • Sunnyvale, CA, United States
11 hours ago
Job type
  • Full-time
Job description

Description :

  • Bachelor or master's degree in computer science, Software Engineering, or a related field.
  • Proven experience (7+ years) as a data Engineer, preferably with a focus on software development, distributed systems.
  • Solid understanding of data engineering concepts, database design, ETL processes and data mining.
  • Proficiency in working with data technologies including SQL, Python, Spark, Scala, Hadoop and related technologies and tools.
  • Experience with ETL tools such as Apache Airflow, digdag, oozie.
  • Experience with?CI / CD?processes and tools such as Jenkins and Maven?
  • Strong understanding of metadata management, data lineage and data quality and tools.
  • Familiarity with Cloud Computing Services such as Google GCP and Microsoft Azure, as well as Distributed Storage Systems like Hive and Elastic Search a plus.
  • Experience implementing operational best practices such as monitoring, alerting, validation and exception handling.
  • Strong analytical, problem-solving skills with the ability to optimize, troubleshoot and debug data process and pipelines.
  • Excellent communication skills to collaborate effectively with cross-functional teams and present performance analysis findings.
  • Experience supporting and working with cross-functional teams and influence them with solutions in a dynamic environment.
  • Experience in?AdTech and advertising measurement
  • Knowledge of analytical tools such as Tableau / or Looker is preferred.

What project or initiative will they be working on?

  • Universal Onboarding / Account.
  • Will this role be hybrid?

  • Yes
  • If hybrid, how many days per week will need to be in office?

  • 2.
  • Top 3 Skills Needed or Required?

  • GCP,Airflow,Pyspark,Tableau.
  • What are the day-to-day responsibilities?

  • Build and maintain robust, scalable data pipelines for ingesting, transforming, and storing large volume of data to support client connect and its advertising needs.
  • Work on cloud platforms like Azure and Google Cloud for data storage, processing and analytics.
  • Create and deploy large-scale, containerized applications using Docker and Kubernetes in public clouds like Google GCP and Microsoft Azure.
  • Create and deploy large-scale, containerized applications using Docker and Kubernetes in public clouds like Google GCP and Microsoft Azure.
  • Manage data engineering projects from design to deployment, ensuring timely delivery and meeting project goals.
  • Self-starter, mentor who can lead engineers and engineering projects.
  • Coordinate, create, and complete technical design discussions to drive technical architecture.
  • Navigate complex systems?and deliver highly scalable and reliable production-ready code?
  • Understands, articulates, and applies principles of the defined strategy to routine business problems that involve a single function.
  • Support data operations including on-call rotations to troubleshoot production issues partnering with cross-functional teams.
  • Collaborate with cross-functional tech teams including developers, architects, operations to identify performance bottlenecks, system issues, and areas for optimization.
  • What is the makeup of the team?

  • Currently ABS-Data team consists of 10 associates who work on delivering various initiatives to support client Connect's roadmap.
  • Additional Job Details

  • GCP,Airflow,Pyspark,Tableau.
  • Required Skills : Data Analysis

    Additional Skills : Data EngineerThis is a high PRIORITY requisition. This is a PROACTIVE requisition

    Create a job alert for this search

    Data Engineer • Sunnyvale, CA, United States

    Related jobs
    Senior GCP Data Engineer

    Senior GCP Data Engineer

    Jconnect Inc • Sunnyvale, CA, United States
    Full-time
    Below is the requirement with my client.Please let me know if you are available for this role.Title : Senior GCP Data Engineer. Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are...Show more
    Last updated: 11 hours ago • Promoted • New!
    Senior Data Platform Engineer — AI-Driven, Scalable Pipelines

    Senior Data Platform Engineer — AI-Driven, Scalable Pipelines

    Booster • San Mateo, CA, United States
    Full-time
    A pioneering tech firm is seeking a Data Engineer to build data infrastructures that transform massive amounts of drone data into actionable insights. The ideal candidate has strong software and dat...Show more
    Last updated: 15 hours ago • Promoted • New!
    Data Engineer | 2025PX05009 | 477|DB-26453

    Data Engineer | 2025PX05009 | 477|DB-26453

    Mindverse Consulting Services • Mountain View, California, United States
    Remote
    Full-time
    We are looking for experienced contract data / software engineer contractors to support the Multi-Cloud Efficiency (MCE) team in scaling cost attribution infrastructure and improving financial visibi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer, Growth Platform & Pipelines

    Senior Data Engineer, Growth Platform & Pipelines

    Mixpanel • San Francisco, CA, United States
    Full-time
    A leading analytics platform in San Francisco is seeking a Senior Software Engineer in Data Engineering.The role involves building data pipelines and collaborating with cross-functional teams to en...Show more
    Last updated: 2 days ago • Promoted
    2025037 Senior Data Engineer

    2025037 Senior Data Engineer

    John Deere • San Francisco, California, United States
    Full-time
    There are over 7 billion people on this planet.And by 2050, there will be 2 billion more.Making sure there is enough food, fiber and infrastructure for our rapidly growing world is what we're all a...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (GCP Cloud)

    Data Engineer (GCP Cloud)

    Appworkshub • Santa Clara, California, United States
    Full-time
    Data Engineer (GCP Cloud) – 100% Onsite.We are seeking a highly skilled.This role requires designing and building scalable data solutions that support business intelligence, analytics, and machine ...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer GCP

    Data Engineer GCP

    Interaction24 LLC • Sunnyvale, CA, United States
    Full-time
    About the job Data Engineer GCP.GoogleAds Expertise is a plus (campaign / adsgroups setup APIs).Show more
    Last updated: 30+ days ago • Promoted
    GCP - Data Engineer

    GCP - Data Engineer

    Omni Inclusive • San Jose, CA, United States
    Full-time
    Strong knowledge in writing and interpreting complex SQL queries - Experience in GCP.Strong ability to design, develop, test and maintain ETL solution in Google Cloud Platform especially in BigQuey...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Duckbill • San Francisco, California, United States
    Full-time
    We are developing a SaaS product that simplifies financial planning and analysis of cloud billing data for large enterprises with complex cloud spending requirements. We're looking for a data engine...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Cynet Systems • San Jose, CA, United States
    Full-time
    Require 5-7 + years of experience Data Engineers GCP Strong knowledge in writing and interpreting complex SQL queries Experience in GCP is plusStrong ability to design, develop, test and maintain E...Show more
    Last updated: 11 hours ago • Promoted • New!
    Data Pipeline Engineer IV

    Data Pipeline Engineer IV

    Pyramid Consulting • Mountain View, CA, United States
    Temporary
    Please review the job description below and contact me ASAP if you are interested.Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and pai...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior GCP Data Engineer

    Senior GCP Data Engineer

    Pyramid Consulting • Santa Clara, CA, United States
    Temporary
    Please review the job description below and contact me ASAP if you are interested.Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and pai...Show more
    Last updated: 9 hours ago • Promoted • New!
    Snowflake Data Engineer

    Snowflake Data Engineer

    Diverse Lynx • Sunnyvale, CA, United States
    Full-time
    Lead the design and implementation of scalable data ingestion architectures and pipelines into Snowflake.Develop, maintain, and optimize ETL / ELT processes using Snowflake features like Snowpipe, St...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer@Sunnyvale, CA

    Senior Data Engineer@Sunnyvale, CA

    Diverse Lynx • Sunnyvale, CA, United States
    Full-time
    Key Skills : Data engineer (Tableau, Python, Snowflake).The ideal candidate will excel at collaborating with business users, cross-functional teams, and offshore teams to deliver high-quality data s...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Engineer - AG

    Data Engineer - AG

    Bayone • Sunnyvale, CA, United States
    Full-time
    Demonstrates up-to-date expertise and applies this to the development,.Supporting and aligning efforts to meet customer, business. Create software design and architecture for next software solution....Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer (only local to Sunnyvale, CA)

    Senior Data Engineer (only local to Sunnyvale, CA)

    Inficare • Sunnyvale, CA, United States
    Full-time
    Job Title : Senior Data Engineer (Tableau, Python, Snowflake).Location : Sunnyvale, CA ( 3 days Hybrid).The ideal candidate will excel at collaborating with business users, cross-functional teams, an...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Engineer, Data Lake & Governance

    Data Engineer, Data Lake & Governance

    Gridware • San Francisco, CA, United States
    Full-time
    Get AI-powered advice on this job and more exclusive features.Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid.We pioneered a groundbre...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer with GCP

    Data Engineer with GCP

    HCL Global Systems • Sunnyvale, CA, United States
    Full-time
    Sr : Data Engineer Description : We are looking for a highly energetic and collaborative Data Engineer for a 12-month engagement. Responsibilities : As a Senior Data Engineer, you will.Design and devel...Show more
    Last updated: 11 hours ago • Promoted • New!