Design and develop big data applications using the latest open source technologies.
Desired working in offshore model and Managed outcome.
Develop logical and physical data models for big data platforms.
utomate workflows using Apache Airflow.
Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
Mentor junior engineers on the team
Lead daily standups and design reviews
Groom and prioritize backlog using JIRA
ct as the point of contact for your assigned business domain
Requirements :
GCP Experience.
4+ years of recent GCP experience.
Experience building data pipelines in GCP.
GCP Dataproc, GCS & BIGQuery experience
10+ years of hands-on experience with developing data warehouse solutions and data products.
6+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required.
5+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
Experience with programming languages : Python, Java, Scala, etc.
Experience with scripting languages : Perl, Shell, etc.
Practice working with, processing, and managing large data sets (multi TB / PB scale).
Exposure to test driven development and automated testing frameworks.
Background in Scrum / Agile development methodologies.
Capable of delivering on multiple competing priorities with little supervision.
Excellent verbal and written communication skills.
Bachelor's Degree in computer science or equivalent experience.
The most successful candidates will also have experience in the following :
Gitflow.
tlassian products - BitBucket, JIRA, Confluence etc.
Continuous Integration tools such as Bamboo, Jenkins, or TFS.
Create a job alert for this search
Gcp Data Engineer • Sunnyvale, CA, United States
Related searches
Related jobs
Data Engineer | 2025PX05009 | 477|DB-26453
Mindverse Consulting Services • Mountain View, California, United States
Remote
Full-time
We are looking for experienced contract data / software engineer contractors to support the Multi-Cloud Efficiency (MCE) team in scaling cost attribution infrastructure and improving financial visibi...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Shopmonkey • Morgan Hill, California, United States
Full-time
We are seeking a highly skilled and motivated Senior Data Engineer to join our team at Shopmonkey.This role is critical to building, maintaining and improving our data infrastructure, ensuring that...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Kikoff • San Francisco, California, United States
Full-time
We are looking for a Data Engineer or Analytics Engineer to join our Data team.You will collaborate with the data scientist and engineers to design, build, and scale high-leverage data models, foun...Show more
Last updated: 30+ days ago • Promoted
2025037 Senior Data Engineer
John Deere • San Francisco, California, United States
Full-time
There are over 7 billion people on this planet.And by 2050, there will be 2 billion more.Making sure there is enough food, fiber and infrastructure for our rapidly growing world is what we're all a...Show more
Last updated: 30+ days ago • Promoted
Sr. Data Engineer (multiple openings)
Visa • Foster City, California, United States
Full-time
Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...Show more
Last updated: 30+ days ago • Promoted
Data Engineer (GCP Cloud)
Appworkshub • Santa Clara, California, United States
Full-time
Data Engineer (GCP Cloud) – 100% Onsite.We are seeking a highly skilled.This role requires designing and building scalable data solutions that support business intelligence, analytics, and machine ...Show more
Last updated: 3 days ago • Promoted
Data Engineer
Duckbill • San Francisco, California, United States
Full-time
We are developing a SaaS product that simplifies financial planning and analysis of cloud billing data for large enterprises with complex cloud spending requirements.
We're looking for a data engine...Show more
Last updated: 30+ days ago • Promoted
Builder - Data Engineer (Growth)
Reevo • Santa Clara, California, United States
Full-time
BUILDER – DATA ENGINEER (GROWTH).Santa Clara until SF office opens in Q3, then may need to travel 1 day per week to Santa Clara or on as needed basis).
You’ve built and scaled data infrastructure fr...Show more
Last updated: 30+ days ago • Promoted
Data Engineer - Open on W2 only
Dataflix • San Jose, CA, United States
Remote
Full-time
We are looking for a Data Engineer to build out and scale our Analytics platform.As a member of the team, you will be responsible for building and scaling a robust platform that will act as the dri...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Delphi • San Francisco, California, United States
Full-time
We are redefining how knowledge is shared.We are enabling anyone to transform their unique expertise into an interactive experience, a digital version of their mind : a dynamic reflection of their k...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Xscion • San Francisco, California, United States
Remote
Full-time
As an employee, you Turn Change Into Value® - for our clients, for our company, for your professional growth, for the consumers.
We hire the best and brightest, who are driven to create lasting valu...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Balbix • San Jose, California, United States
Full-time
The Balbix Security Cloud uses AI and automation to reinvent how the World's leading organizations reduce their cyber risk.
With Balbix, security teams can accurately inventory their cloud and on-pr...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Stellar Development Foundation • San Francisco, California, United States
Full-time
Interested in working on cutting-edge blockchain technology and creating equitable access to the global financial system? Since 2014, the mission-driven team at the Stellar Development Foundation (...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Rokt • San Francisco, California, United States
Full-time
We are Rokt, a hyper-growth ecommerce leader.Rokt is the global leader in ecommerce, unlocking real-time relevance in the moment that matters most.
Rokt’s AI Brain and ecommerce Network powers billi...Show more
Last updated: 3 days ago • Promoted
Data Engineer
West Monroe • San Francisco, California, United States
Full-time
Are you ready to make an impact?.West Monroe is seeking a talented Data Engineer to join our Data Engineering & Analytics team.
In this role, you will collaborate with our clients to address their m...Show more
Last updated: 30+ days ago • Promoted
Data Engineer (Onsite, US)
Wipro Technologies • Fremont, California, United States
Full-time
Location : Fully Onsite in either Fremont, CA or Austin, TX.This position is a fully onsite position and not eligible for relocation.
Salary : Up to $90,000 + 10% performance bonus (DOE & Geographic L...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Imbue • San Francisco, California, United States
Full-time
We’re a small, cross-functional team focused on building AI systems that reason and code.We care deeply about understanding how people interact with these systems and how we can use data to make th...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Checkr • San Francisco, California, United States
Full-time
Checkr is building the data platform to power safe and fair decisions.Established in 2014, Checkr’s innovative technology and robust data platform help customers assess risk and ensure safety and c...Show more