Talent.com
GCP Data Engineer
GCP Data EngineerCynet Systems • Sunnyvale, CA, United States
GCP Data Engineer

GCP Data Engineer

Cynet Systems • Sunnyvale, CA, United States
6 days ago
Job type
  • Full-time
Job description

Job Description :

Pay Range : $65hr - $70hr

Responsibilities :

  • Design and develop big data applications using the latest open source technologies.
  • Desired working in offshore model and Managed outcome.
  • Develop logical and physical data models for big data platforms.
  • utomate workflows using Apache Airflow.
  • Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
  • Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
  • Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
  • Mentor junior engineers on the team
  • Lead daily standups and design reviews
  • Groom and prioritize backlog using JIRA
  • ct as the point of contact for your assigned business domain

Requirements :

  • GCP Experience.
  • 4+ years of recent GCP experience.
  • Experience building data pipelines in GCP.
  • GCP Dataproc, GCS & BIGQuery experience
  • 10+ years of hands-on experience with developing data warehouse solutions and data products.
  • 6+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required.
  • 5+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
  • Experience with programming languages : Python, Java, Scala, etc.
  • Experience with scripting languages : Perl, Shell, etc.
  • Practice working with, processing, and managing large data sets (multi TB / PB scale).
  • Exposure to test driven development and automated testing frameworks.
  • Background in Scrum / Agile development methodologies.
  • Capable of delivering on multiple competing priorities with little supervision.
  • Excellent verbal and written communication skills.
  • Bachelor's Degree in computer science or equivalent experience.
  • The most successful candidates will also have experience in the following :
  • Gitflow.
  • tlassian products - BitBucket, JIRA, Confluence etc.
  • Continuous Integration tools such as Bamboo, Jenkins, or TFS.
  • Create a job alert for this search

    Gcp Data Engineer • Sunnyvale, CA, United States

    Related jobs
    Senior GCP Data Engineer

    Senior GCP Data Engineer

    Jconnect Inc • Sunnyvale, CA, United States
    Full-time
    Below is the requirement with my client.Please let me know if you are available for this role.Title : Senior GCP Data Engineer. Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer -(GCP,Airflow,Pyspark) Hybrid-Sunnyvale,CA

    Data Engineer -(GCP,Airflow,Pyspark) Hybrid-Sunnyvale,CA

    Kaav Inc. • Sunnyvale, CA, United States
    Full-time
    Bachelor or master's degree in computer science, Software Engineering, or a related field.Proven experience (7+ years) as a data Engineer, preferably with a focus on software development, distribut...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer GCP

    Data Engineer GCP

    Interaction24 LLC • Sunnyvale, CA, United States
    Full-time
    About the job Data Engineer GCP.GoogleAds Expertise is a plus (campaign / adsgroups setup APIs).Show more
    Last updated: 30+ days ago • Promoted
    GCP Cloud Engineer

    GCP Cloud Engineer

    Info Way Solutions • Fremont, CA, United States
    Temporary
    Info Way Solutions, LLC We have job opening for.Job description is given below : .Kindly check the JD and share your views. Need technical resource with strong hands-on experience in GCP.You are respo...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Adobe • San Jose, CA, United States
    Full-time
    Changing the world through digital experiences is what Adobe's all about.We give everyone-from emerging artists to global brands-everything they need to design and deliver exceptional digital exper...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Pipelines & Performance Engineer

    Senior Data Pipelines & Performance Engineer

    xage, inc • Palo Alto, CA, United States
    Full-time
    A leading zero trust security company in Palo Alto, CA seeks a Principal Software Engineer specializing in data pipelines. This role involves collaboration with engineers to build internal data syst...Show more
    Last updated: 12 hours ago • Promoted • New!
    Data Engineer - Cloud Infrastructure

    Data Engineer - Cloud Infrastructure

    Apple • Cupertino, CA, United States
    Full-time
    Apple delivers the most popular cameras in the world.Each product release provides breakthroughs in photography with stunning camera features that customers love. Our cameras deploy imaging complexi...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Maintec Technologies • Sunnyvale, CA, United States
    Full-time
    Proven experience as a data engineer, with at least 5 years of experience in a similar role.Design, implement, and optimize data pipelines using. Spark with Scala, Airflow, and other relevant techno...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer with GCP

    Data Engineer with GCP

    Inficare • Sunnyvale, CA, United States
    Full-time
    Job Title : Senior Data Engineer with GCP.Location : Sunnyvale, CA (Onsite from day 1).Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required. Experience with programming lan...Show more
    Last updated: 6 days ago • Promoted
    Data Pipeline Engineer IV

    Data Pipeline Engineer IV

    Pyramid Consulting • Mountain View, CA, United States
    Temporary
    Please review the job description below and contact me ASAP if you are interested.Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and pai...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer - AG

    Data Engineer - AG

    Bayone • Sunnyvale, CA, United States
    Full-time
    Demonstrates up-to-date expertise and applies this to the development,.Supporting and aligning efforts to meet customer, business. Create software design and architecture for next software solution....Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer IV

    Data Pipeline Engineer IV

    Hire Talent • Mountain View, CA, United States
    Full-time
    Data Engineer - Mobile Cloud ServiceLocation : Mountain View, CAGeneral Description : The Cloud services group is looking for world class engineers to join our technology innovation group focused on t...Show more
    Last updated: 6 days ago • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    Tekfortune Inc • Pleasanton, CA, United States
    Permanent
    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries.In this quickly ch...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer III

    Data Engineer III

    Walmart • Sunnyvale, CA, United States
    Full-time
    Crossman Avenue, Sunnyvale, CA 94089.Identifies possible options to address the business problems within one's discipline through analytics, big data analytics, and automation.Supports the developm...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer 3

    Data Engineer 3

    PayPal • San Jose, CA, United States
    Full-time
    PayPal has been revolutionizing commerce globally for more than 25 years.Creating innovative experiences that make moving money, selling, and shopping simple, personalized, and secure, PayPal empow...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer with GCP

    Data Engineer with GCP

    HCL Global Systems • Sunnyvale, CA, United States
    Full-time
    Sr : Data Engineer Description : We are looking for a highly energetic and collaborative Data Engineer for a 12-month engagement. Responsibilities : As a Senior Data Engineer, you will.Design and devel...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer 3

    Data Engineer 3

    Ursus Inc • San Jose, CA, United States
    Full-time
    LOCATION : San Jose, CA (Hybrid).Strong proficiency in Python, SQL / PLSQL, and big data technologies (e.Proven experience in data warehousing, data modeling, and ETL development (Airflow or similar)....Show more
    Last updated: 6 days ago • Promoted
    Data Engineer

    Data Engineer

    CData Software • Pleasanton, CA, United States
    Full-time
    Should have good experience with Spark SQL, Databricks, Azure Data Factory (ADF), SQL, IICS, Unix, PySpark, Python, and Azure Data Lake Storage (ADLS). We are seeking a talented and motivated Data E...Show more
    Last updated: 16 days ago • Promoted