Design and develop big data applications using the latest open source technologies.
Desired working in offshore model and Managed outcome.
Develop logical and physical data models for big data platforms.
utomate workflows using Apache Airflow.
Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
Mentor junior engineers on the team
Lead daily standups and design reviews
Groom and prioritize backlog using JIRA
ct as the point of contact for your assigned business domain
Requirements :
GCP Experience.
4+ years of recent GCP experience.
Experience building data pipelines in GCP.
GCP Dataproc, GCS & BIGQuery experience
10+ years of hands-on experience with developing data warehouse solutions and data products.
6+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required.
5+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
Experience with programming languages : Python, Java, Scala, etc.
Experience with scripting languages : Perl, Shell, etc.
Practice working with, processing, and managing large data sets (multi TB / PB scale).
Exposure to test driven development and automated testing frameworks.
Background in Scrum / Agile development methodologies.
Capable of delivering on multiple competing priorities with little supervision.
Excellent verbal and written communication skills.
Bachelor's Degree in computer science or equivalent experience.
The most successful candidates will also have experience in the following :
Gitflow.
tlassian products - BitBucket, JIRA, Confluence etc.
Continuous Integration tools such as Bamboo, Jenkins, or TFS.
Create a job alert for this search
Gcp Data Engineer • Sunnyvale, CA, United States
Related searches
Related jobs
Senior GCP Data Engineer
Jconnect Inc • Sunnyvale, CA, United States
Full-time
Below is the requirement with my client.Please let me know if you are available for this role.Title : Senior GCP Data Engineer.
Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are...Show more
Last updated: 6 days ago • Promoted
Data Engineer -(GCP,Airflow,Pyspark) Hybrid-Sunnyvale,CA
Kaav Inc. • Sunnyvale, CA, United States
Full-time
Bachelor or master's degree in computer science, Software Engineering, or a related field.Proven experience (7+ years) as a data Engineer, preferably with a focus on software development, distribut...Show more
Last updated: 6 days ago • Promoted
Data Engineer GCP
Interaction24 LLC • Sunnyvale, CA, United States
Full-time
About the job Data Engineer GCP.GoogleAds Expertise is a plus (campaign / adsgroups setup APIs).Show more
Last updated: 30+ days ago • Promoted
GCP Cloud Engineer
Info Way Solutions • Fremont, CA, United States
Temporary
Info Way Solutions, LLC We have job opening for.Job description is given below : .Kindly check the JD and share your views.
Need technical resource with strong hands-on experience in GCP.You are respo...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Adobe • San Jose, CA, United States
Full-time
Changing the world through digital experiences is what Adobe's all about.We give everyone-from emerging artists to global brands-everything they need to design and deliver exceptional digital exper...Show more
Last updated: 30+ days ago • Promoted
Senior Data Pipelines & Performance Engineer
xage, inc • Palo Alto, CA, United States
Full-time
A leading zero trust security company in Palo Alto, CA seeks a Principal Software Engineer specializing in data pipelines.
This role involves collaboration with engineers to build internal data syst...Show more
Last updated: 12 hours ago • Promoted • New!
Data Engineer - Cloud Infrastructure
Apple • Cupertino, CA, United States
Full-time
Apple delivers the most popular cameras in the world.Each product release provides breakthroughs in photography with stunning camera features that customers love.
Our cameras deploy imaging complexi...Show more
Last updated: 30+ days ago • Promoted
GCP Data Engineer
Maintec Technologies • Sunnyvale, CA, United States
Full-time
Proven experience as a data engineer, with at least 5 years of experience in a similar role.Design, implement, and optimize data pipelines using.
Spark with Scala, Airflow, and other relevant techno...Show more
Last updated: 6 days ago • Promoted
Data Engineer with GCP
Inficare • Sunnyvale, CA, United States
Full-time
Job Title : Senior Data Engineer with GCP.Location : Sunnyvale, CA (Onsite from day 1).Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required.
Experience with programming lan...Show more
Last updated: 6 days ago • Promoted
Data Pipeline Engineer IV
Pyramid Consulting • Mountain View, CA, United States
Temporary
Please review the job description below and contact me ASAP if you are interested.Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and pai...Show more
Last updated: 6 days ago • Promoted
Data Engineer - AG
Bayone • Sunnyvale, CA, United States
Full-time
Demonstrates up-to-date expertise and applies this to the development,.Supporting and aligning efforts to meet customer, business.
Create software design and architecture for next software solution....Show more
Last updated: 30+ days ago • Promoted
Data Pipeline Engineer IV
Hire Talent • Mountain View, CA, United States
Full-time
Data Engineer - Mobile Cloud ServiceLocation : Mountain View, CAGeneral Description : The Cloud services group is looking for world class engineers to join our technology innovation group focused on t...Show more
Last updated: 6 days ago • Promoted
Databricks Data Engineer
Tekfortune Inc • Pleasanton, CA, United States
Permanent
Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries.In this quickly ch...Show more
Last updated: 30+ days ago • Promoted
Data Engineer III
Walmart • Sunnyvale, CA, United States
Full-time
Crossman Avenue, Sunnyvale, CA 94089.Identifies possible options to address the business problems within one's discipline through analytics, big data analytics, and automation.Supports the developm...Show more
Last updated: 30+ days ago • Promoted
Data Engineer 3
PayPal • San Jose, CA, United States
Full-time
PayPal has been revolutionizing commerce globally for more than 25 years.Creating innovative experiences that make moving money, selling, and shopping simple, personalized, and secure, PayPal empow...Show more
Last updated: 6 days ago • Promoted
Data Engineer with GCP
HCL Global Systems • Sunnyvale, CA, United States
Full-time
Sr : Data Engineer Description : We are looking for a highly energetic and collaborative Data Engineer for a 12-month engagement.
Responsibilities : As a Senior Data Engineer, you will.Design and devel...Show more
Last updated: 6 days ago • Promoted
Data Engineer 3
Ursus Inc • San Jose, CA, United States
Full-time
LOCATION : San Jose, CA (Hybrid).Strong proficiency in Python, SQL / PLSQL, and big data technologies (e.Proven experience in data warehousing, data modeling, and ETL development (Airflow or similar)....Show more
Last updated: 6 days ago • Promoted
Data Engineer
CData Software • Pleasanton, CA, United States
Full-time
Should have good experience with Spark SQL, Databricks, Azure Data Factory (ADF), SQL, IICS, Unix, PySpark, Python, and Azure Data Lake Storage (ADLS).
We are seeking a talented and motivated Data E...Show more