GCP Data EngineerCynet Systems • Sunnyvale, CA, United States
No longer accepting applications
GCP Data Engineer
Cynet Systems • Sunnyvale, CA, United States
12 days ago
Job type
Full-time
Job description
Job Description :
Pay Range : $65hr - $70hr
Responsibilities :
Design and develop big data applications using the latest open source technologies.
Desired working in offshore model and Managed outcome.
Develop logical and physical data models for big data platforms.
utomate workflows using Apache Airflow.
Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
Mentor junior engineers on the team
Lead daily standups and design reviews
Groom and prioritize backlog using JIRA
ct as the point of contact for your assigned business domain
Requirements :
GCP Experience.
4+ years of recent GCP experience.
Experience building data pipelines in GCP.
GCP Dataproc, GCS & BIGQuery experience
10+ years of hands-on experience with developing data warehouse solutions and data products.
6+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required.
5+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
Experience with programming languages : Python, Java, Scala, etc.
Experience with scripting languages : Perl, Shell, etc.
Practice working with, processing, and managing large data sets (multi TB / PB scale).
Exposure to test driven development and automated testing frameworks.
Background in Scrum / Agile development methodologies.
Capable of delivering on multiple competing priorities with little supervision.
Excellent verbal and written communication skills.
Bachelor's Degree in computer science or equivalent experience.
The most successful candidates will also have experience in the following :
Gitflow.
tlassian products - BitBucket, JIRA, Confluence etc.
Continuous Integration tools such as Bamboo, Jenkins, or TFS.
Create a job alert for this search
Gcp Data Engineer • Sunnyvale, CA, United States
Related jobs
DATA ENGINEER
Purple Drive • Pleasanton, CA, United States
Full-time
The Senior Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and architectures on AWS to support scalable data processing, storage, and analytics.The ...Show more
Last updated: 25 days ago • Promoted
Lead Data Engineer
eTeam • Fremont, CA, United States
Full-time
Location : Fremont, CA (Hybrid 3 days a week from office).Min 5 years of experience in modern data engineering / data warehousing / data lakes technologies on cloud platforms like Azure, AWS, GCP, Data ...Show more
Last updated: 30+ days ago • Promoted
Data Architect : GCP Cloud Data Modeling and Governance
TechDigital Group • San Jose, CA, United States
Full-time
An established industry player is seeking a Data Architect with extensive experience in data modeling and architecture.This role involves collaborating with cross-functional teams to design and del...Show more
Last updated: 11 days ago • Promoted
GCP Cloud Engineer
Info Way Solutions • Fremont, CA, United States
Temporary
Info Way Solutions, LLC We have job opening for.Job description is given below : .Kindly check the JD and share your views.
Need technical resource with strong hands-on experience in GCP.You are respo...Show more
Last updated: 30+ days ago • Promoted
Lead Data Engineer
Inizio Partners • Fremont, CA, United States
Full-time
About the job Lead Data Engineer.Location : Fremont, CA(3 days onsite, 2 days work from home).Candidate should Provide technical expertise in needs identification, data modelling, data movement, tra...Show more
Last updated: 30+ days ago • Promoted
GCP Certified Data and Machine Learning Engineers
Avant Digital Inc. • Mountain View, CA, United States
Part-time
GCP Certified Data and Machine Learning Engineers.GCP Certified Data Engineer or Certified Machine Learning Engineer.We are seeking professionally certified GCP engineers specialized in Data or Mac...Show more
Last updated: 30+ days ago • Promoted
Senior Data Pipelines & Performance Engineer
xage, inc • Palo Alto, CA, US
Full-time
A leading zero trust security company in Palo Alto, CA seeks a Principal Software Engineer specializing in data pipelines.
This role involves collaboration with engineers to build internal data syst...Show more
Last updated: 4 days ago • Promoted
Data Engineer
VEEV • Hayward, CA, United States
Full-time
Veev is leading the transformation of the construction industry with an innovative approach to modular home construction.
Veev's prefabricated closed-panel systems allow homes to be assembled effici...Show more
Last updated: 11 days ago • Promoted
Data Engineer
Diverse Lynx • Pleasanton, CA, United States
Full-time
Job Overview : We are seeking a talented and motivated Data Engineer with expertise in Spark SQL, Databricks, Azure Data Factory (ADF), SQL, IICS, Unix, PySpark, Python, and Azure Data Lake Storage ...Show more
Last updated: 30+ days ago • Promoted
Databricks Data Engineer
Tekfortune Inc • Pleasanton, CA, United States
Permanent
Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for world's leading organizations in a broad range of industries.In this quickly ch...Show more
Last updated: 30+ days ago • Promoted
Lead Data Engineer (San Jose)
Mentor Talent Acquisition • San Jose, CA, United States
Full-time
Were looking for a Lead Data Engineer to spearhead the design, implementation, and iteration of a world-class, modern data infrastructure that powers analytics, data science, and ML / AI systems.You ...Show more
Last updated: 1 day ago • Promoted
GCP Data Architect ONSITE INDEPENDENT visa only
TestingXperts Inc. DBA Damcosoft • Santa Clara, CA, United States
Full-time +2
Quick Apply
Role : GCP Data Architect Location : Santa Clara CA (100% Onsite) Show more
Last updated: 1 day ago
GCP Data Architect
Tror AI for everyone • Santa Clara, CA, United States
Full-time
Quick Apply
Role : GCP Data Architect Location : Santa Clara CA (Local only) H1B, h4ead required < / ...Show more
Last updated: 5 days ago
Data Engineer
Apex Informatics • Pleasanton, CA, United States
Full-time
Bachelor's degree or equivalent experience in computer science, applied math, physics, engineering, statistics, economics or related field.
SQL, Python, PySpark, Jupyter Notebook, database design, a...Show more
Last updated: 22 days ago • Promoted
Data Engineer
CData Software • Pleasanton, CA, United States
Full-time
Should have good experience with Spark SQL, Databricks, Azure Data Factory (ADF), SQL, IICS, Unix, PySpark, Python, and Azure Data Lake Storage (ADLS).
We are seeking a talented and motivated Data E...Show more
Last updated: 22 days ago • Promoted
Data Engineer
Midjourney • Sunnyvale, California, United States
Full-time
Midjourney is a research lab exploring new mediums to expand the imaginative powers of the human species.We are a small, self-funded team focused on design, human infrastructure, and AI.We have no ...Show more
Last updated: 1 day ago • Promoted
Data Engineer III (Cupertino)
PTR Global • Cupertino, CA, US
Full-time +1
This will be a data engineer role for processing battery testing data to facilitate battery algorithm delivery and support battery algorithm simulations to validate the battery algorithm and projec...Show more
Last updated: 13 hours ago • Promoted • New!
Data Platform Engineer / AI Workloads (Sunnyvale)
The Crypto Recruiters • Sunnyvale, CA, US
Part-time +1
We are actively searching for a Data Infrastructure Engineer to join our team on a permanent basis.In this founding engineer role you will focus on building next-generation data infrastructure for ...Show more