Talent.com
GCP Data Engineer
GCP Data EngineerCynet Systems • Sunnyvale, CA, United States
No longer accepting applications
GCP Data Engineer

GCP Data Engineer

Cynet Systems • Sunnyvale, CA, United States
12 days ago
Job type
  • Full-time
Job description

Job Description :

Pay Range : $65hr - $70hr

Responsibilities :

  • Design and develop big data applications using the latest open source technologies.
  • Desired working in offshore model and Managed outcome.
  • Develop logical and physical data models for big data platforms.
  • utomate workflows using Apache Airflow.
  • Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
  • Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
  • Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
  • Mentor junior engineers on the team
  • Lead daily standups and design reviews
  • Groom and prioritize backlog using JIRA
  • ct as the point of contact for your assigned business domain

Requirements :

  • GCP Experience.
  • 4+ years of recent GCP experience.
  • Experience building data pipelines in GCP.
  • GCP Dataproc, GCS & BIGQuery experience
  • 10+ years of hands-on experience with developing data warehouse solutions and data products.
  • 6+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required.
  • 5+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
  • Experience with programming languages : Python, Java, Scala, etc.
  • Experience with scripting languages : Perl, Shell, etc.
  • Practice working with, processing, and managing large data sets (multi TB / PB scale).
  • Exposure to test driven development and automated testing frameworks.
  • Background in Scrum / Agile development methodologies.
  • Capable of delivering on multiple competing priorities with little supervision.
  • Excellent verbal and written communication skills.
  • Bachelor's Degree in computer science or equivalent experience.
  • The most successful candidates will also have experience in the following :
  • Gitflow.
  • tlassian products - BitBucket, JIRA, Confluence etc.
  • Continuous Integration tools such as Bamboo, Jenkins, or TFS.
  • Create a job alert for this search

    Gcp Data Engineer • Sunnyvale, CA, United States

    Related jobs
    DATA ENGINEER

    DATA ENGINEER

    Purple Drive • Pleasanton, CA, United States
    Full-time
    The Senior Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and architectures on AWS to support scalable data processing, storage, and analytics.The ...Show more
    Last updated: 25 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    eTeam • Fremont, CA, United States
    Full-time
    Location : Fremont, CA (Hybrid 3 days a week from office).Min 5 years of experience in modern data engineering / data warehousing / data lakes technologies on cloud platforms like Azure, AWS, GCP, Data ...Show more
    Last updated: 30+ days ago • Promoted
    Data Architect : GCP Cloud Data Modeling and Governance

    Data Architect : GCP Cloud Data Modeling and Governance

    TechDigital Group • San Jose, CA, United States
    Full-time
    An established industry player is seeking a Data Architect with extensive experience in data modeling and architecture.This role involves collaborating with cross-functional teams to design and del...Show more
    Last updated: 11 days ago • Promoted
    GCP Cloud Engineer

    GCP Cloud Engineer

    Info Way Solutions • Fremont, CA, United States
    Temporary
    Info Way Solutions, LLC We have job opening for.Job description is given below : .Kindly check the JD and share your views. Need technical resource with strong hands-on experience in GCP.You are respo...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Inizio Partners • Fremont, CA, United States
    Full-time
    About the job Lead Data Engineer.Location : Fremont, CA(3 days onsite, 2 days work from home).Candidate should Provide technical expertise in needs identification, data modelling, data movement, tra...Show more
    Last updated: 30+ days ago • Promoted
    GCP Certified Data and Machine Learning Engineers

    GCP Certified Data and Machine Learning Engineers

    Avant Digital Inc. • Mountain View, CA, United States
    Part-time
    GCP Certified Data and Machine Learning Engineers.GCP Certified Data Engineer or Certified Machine Learning Engineer.We are seeking professionally certified GCP engineers specialized in Data or Mac...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Pipelines & Performance Engineer

    Senior Data Pipelines & Performance Engineer

    xage, inc • Palo Alto, CA, US
    Full-time
    A leading zero trust security company in Palo Alto, CA seeks a Principal Software Engineer specializing in data pipelines. This role involves collaboration with engineers to build internal data syst...Show more
    Last updated: 4 days ago • Promoted
    Data Engineer

    Data Engineer

    VEEV • Hayward, CA, United States
    Full-time
    Veev is leading the transformation of the construction industry with an innovative approach to modular home construction. Veev's prefabricated closed-panel systems allow homes to be assembled effici...Show more
    Last updated: 11 days ago • Promoted
    Data Engineer

    Data Engineer

    Diverse Lynx • Pleasanton, CA, United States
    Full-time
    Job Overview : We are seeking a talented and motivated Data Engineer with expertise in Spark SQL, Databricks, Azure Data Factory (ADF), SQL, IICS, Unix, PySpark, Python, and Azure Data Lake Storage ...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    Tekfortune Inc • Pleasanton, CA, United States
    Permanent
    Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries.In this quickly ch...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer (San Jose)

    Lead Data Engineer (San Jose)

    Mentor Talent Acquisition • San Jose, CA, United States
    Full-time
    Were looking for a Lead Data Engineer to spearhead the design, implementation, and iteration of a world-class, modern data infrastructure that powers analytics, data science, and ML / AI systems.You ...Show more
    Last updated: 1 day ago • Promoted
    GCP Data Architect ONSITE INDEPENDENT visa only

    GCP Data Architect ONSITE INDEPENDENT visa only

    TestingXperts Inc. DBA Damcosoft • Santa Clara, CA, United States
    Full-time +2
    Quick Apply
    Role : GCP Data Architect Location : Santa Clara CA (100% Onsite) Show more
    Last updated: 1 day ago
    GCP Data Architect

    GCP Data Architect

    Tror AI for everyone • Santa Clara, CA, United States
    Full-time
    Quick Apply
    Role : GCP Data Architect Location : Santa Clara CA (Local only) H1B, h4ead required < / ...Show more
    Last updated: 5 days ago
    Data Engineer

    Data Engineer

    Apex Informatics • Pleasanton, CA, United States
    Full-time
    Bachelor's degree or equivalent experience in computer science, applied math, physics, engineering, statistics, economics or related field. SQL, Python, PySpark, Jupyter Notebook, database design, a...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    CData Software • Pleasanton, CA, United States
    Full-time
    Should have good experience with Spark SQL, Databricks, Azure Data Factory (ADF), SQL, IICS, Unix, PySpark, Python, and Azure Data Lake Storage (ADLS). We are seeking a talented and motivated Data E...Show more
    Last updated: 22 days ago • Promoted
    Data Engineer

    Data Engineer

    Midjourney • Sunnyvale, California, United States
    Full-time
    Midjourney is a research lab exploring new mediums to expand the imaginative powers of the human species.We are a small, self-funded team focused on design, human infrastructure, and AI.We have no ...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer III (Cupertino)

    Data Engineer III (Cupertino)

    PTR Global • Cupertino, CA, US
    Full-time +1
    This will be a data engineer role for processing battery testing data to facilitate battery algorithm delivery and support battery algorithm simulations to validate the battery algorithm and projec...Show more
    Last updated: 13 hours ago • Promoted • New!
    Data Platform Engineer / AI Workloads (Sunnyvale)

    Data Platform Engineer / AI Workloads (Sunnyvale)

    The Crypto Recruiters • Sunnyvale, CA, US
    Part-time +1
    We are actively searching for a Data Infrastructure Engineer to join our team on a permanent basis.In this founding engineer role you will focus on building next-generation data infrastructure for ...Show more
    Last updated: 1 day ago • Promoted