GCP Data EngineerCynet Systems • Sunnyvale, CA, United States
GCP Data Engineer
Cynet Systems • Sunnyvale, CA, United States
14 hours ago
Job type
- Full-time
Job descriptionGCP Experience. 4+ years of recent GCP experience. Experience building data pipelines in GCP. GCP Dataproc, GCS & BIGQuery experience 10+ years of hands-on experience with developing data warehouse solutions and data products. 6+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required. 5+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms. Experience with programming languages : Python, Java, Scala, etc. Experience with scripting languages : Perl, Shell, etc. Practice working with, processing, and managing large data sets (multi TB / PB scale). Exposure to test driven development and automated testing frameworks. Background in Scrum / Agile development methodologies. Capable of delivering on multiple competing priorities with little supervision. Excellent verbal and written communication skills. Bachelor's Degree in computer science or equivalent experience. The most successful candidates will also have experience in the following : Gitflow. tlassian products - BitBucket, JIRA, Confluence etc. Continuous Integration tools such as Bamboo, Jenkins, or TFS.
Job Description :
Pay Range : $65hr - $70hr
Responsibilities :
- Design and develop big data applications using the latest open source technologies.
- Desired working in offshore model and Managed outcome.
- Develop logical and physical data models for big data platforms.
- utomate workflows using Apache Airflow.
- Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
- Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
- Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
- Mentor junior engineers on the team
- Lead daily standups and design reviews
- Groom and prioritize backlog using JIRA
- ct as the point of contact for your assigned business domain
Requirements :
Create a job alert for this search
Gcp Data Engineer • Sunnyvale, CA, United States
Related jobs
We are looking for experienced contract data / software engineer contractors to support the Multi-Cloud Efficiency (MCE) team in scaling cost attribution infrastructure and improving financial visibi...Show more
We are seeking a highly skilled and motivated Senior Data Engineer to join our team at Shopmonkey.This role is critical to building, maintaining and improving our data infrastructure, ensuring that...Show more
We are looking for a Data Engineer or Analytics Engineer to join our Data team.You will collaborate with the data scientist and engineers to design, build, and scale high-leverage data models, foun...Show more
There are over 7 billion people on this planet.And by 2050, there will be 2 billion more.Making sure there is enough food, fiber and infrastructure for our rapidly growing world is what we're all a...Show more
Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...Show more
Data Engineer (GCP Cloud) – 100% Onsite.We are seeking a highly skilled.This role requires designing and building scalable data solutions that support business intelligence, analytics, and machine ...Show more
We are developing a SaaS product that simplifies financial planning and analysis of cloud billing data for large enterprises with complex cloud spending requirements.
We're looking for a data engine...Show more
BUILDER – DATA ENGINEER (GROWTH).Santa Clara until SF office opens in Q3, then may need to travel 1 day per week to Santa Clara or on as needed basis).
You’ve built and scaled data infrastructure fr...Show more
We are looking for a Data Engineer to build out and scale our Analytics platform.As a member of the team, you will be responsible for building and scaling a robust platform that will act as the dri...Show more
We are redefining how knowledge is shared.We are enabling anyone to transform their unique expertise into an interactive experience, a digital version of their mind : a dynamic reflection of their k...Show more
As an employee, you Turn Change Into Value® - for our clients, for our company, for your professional growth, for the consumers.
We hire the best and brightest, who are driven to create lasting valu...Show more
The Balbix Security Cloud uses AI and automation to reinvent how the World's leading organizations reduce their cyber risk.
With Balbix, security teams can accurately inventory their cloud and on-pr...Show more
Interested in working on cutting-edge blockchain technology and creating equitable access to the global financial system? Since 2014, the mission-driven team at the Stellar Development Foundation (...Show more
We are Rokt, a hyper-growth ecommerce leader.Rokt is the global leader in ecommerce, unlocking real-time relevance in the moment that matters most.
Rokt’s AI Brain and ecommerce Network powers billi...Show more
Are you ready to make an impact?.West Monroe is seeking a talented Data Engineer to join our Data Engineering & Analytics team.
In this role, you will collaborate with our clients to address their m...Show more
Location : Fully Onsite in either Fremont, CA or Austin, TX.This position is a fully onsite position and not eligible for relocation.
Salary : Up to $90,000 + 10% performance bonus (DOE & Geographic L...Show more
We’re a small, cross-functional team focused on building AI systems that reason and code.We care deeply about understanding how people interact with these systems and how we can use data to make th...Show more
Checkr is building the data platform to power safe and fair decisions.Established in 2014, Checkr’s innovative technology and robust data platform help customers assess risk and ensure safety and c...Show more
Data Engineer | 2025PX05009 | 477|DB-26453
Mindverse Consulting Services • Mountain View, California, United States
Remote
Full-time
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Shopmonkey • Morgan Hill, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer
Kikoff • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
2025037 Senior Data Engineer
John Deere • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Sr. Data Engineer (multiple openings)
Visa • Foster City, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer (GCP Cloud)
Appworkshub • Santa Clara, California, United States
Full-time
Last updated: 3 days ago • Promoted
Data Engineer
Duckbill • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Builder - Data Engineer (Growth)
Reevo • Santa Clara, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer - Open on W2 only
Dataflix • San Jose, CA, United States
Remote
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer
Delphi • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Xscion • San Francisco, California, United States
Remote
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer
Balbix • San Jose, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer
Stellar Development Foundation • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer
Rokt • San Francisco, California, United States
Full-time
Last updated: 3 days ago • Promoted
Data Engineer
West Monroe • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer (Onsite, US)
Wipro Technologies • Fremont, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Data Engineer
Imbue • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Checkr • San Francisco, California, United States
Full-time
Last updated: 30+ days ago • Promoted