Senior Data Engineer (AI/ML, Cloud) - Full Time - Bay Area, CARight Skale, Inc. • Pleasanton, CA, United States

Senior Data Engineer (AI / ML, Cloud) - Full Time - Bay Area, CA

Right Skale, Inc. • Pleasanton, CA, United States

22 days ago

Job type

Full-time

Job description

Senior Data Engineer (AI / ML, Cloud) - Full Time - Bay Area, CA

We are seeking a Senior Data Engineer to design and implement AI / ML-driven data solutions for enterprise cloud environments. You'll leverage modern data engineering, data warehousing, and data lake technologies on platforms like AWS, Azure, and GCP to optimize multi-cloud data workflows in a fast-paced, innovative setting.

Responsibilities

Design and develop data pipelines, data lakes, and data warehouses using cloud platforms (AWS, Azure, GCP, Databricks) with a preference for Azure expertise.
Experience with SQL, schema design, and dimensional data modeling to build scalable data solutions.
Implement ETL / ELT processes using tools like Azure Data Factory (ADF), Informatica, Talend, and data warehousing technologies (Azure Synapse, Amazon Redshift, Snowflake, Google BigQuery).
Utilize big data tools (Databricks, Spark) and programming skills in PySpark and Spark SQL to support AI / ML-driven data analytics.
Collaborate with cross-functional teams to ensure data warehouse best practices, development standards, and methodologies are met.

Required Skills

Minimum 5 years in modern data engineering, data warehousing, or data lake technologies on cloud platforms (AWS, Azure, GCP, Databricks)

10+ years with SQL, schema design, and dimensional data modeling.

Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience).

Hands-on experience with Azure (preferred), AWS, GCP, and Databricks for data solutions.

Proficiency with ADF, Informatica, Talend, and technologies like Azure Synapse, Amazon Redshift, Snowflake, or Google Big Query.

Strong experience with Databricks, Spark, PySpark, and Spark SQL for big data processing.

Solid knowledge of data warehouse best practices, development standards, and Agile methodologies.

Excellent communication, teamwork, and self-learning abilities in a fast-paced environment.

Preferred Skills

Knowledge of Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Services, or Cosmos DB for advanced data streaming and storage.

Experience with SAP ECC, S / 4, or Hana for enterprise data integration.

Intermediate proficiency in data visualization tools (e.g., Power BI) for actionable insights.

Expertise in Azure DevOps, CI / CD deployments, and cloud migration methodologies.

Proven track record of delivering scalable, AI / ML-enhanced data solutions in IT services environments.

Create a job alert for this search

Cloud Data Engineer • Pleasanton, CA, United States

Related jobs

Senior Software Engineer – AI & Cloud Productivity Suite

Google Inc. • Sunnyvale, CA, United States

Full-time

A leading technology company is seeking a Senior Software Engineer to develop innovative solutions within Google Workspace. The role involves managing project priorities and contributing to cutting-...Show more

Last updated: 8 hours ago • Promoted • New!

Remote Senior Data Engineer - AI-Powered Pipelines

Altimate.ai • Sunnyvale, CA, United States

Remote

Full-time

A leading AI-driven data solutions company in California is seeking a Senior Software Engineer to enhance AI capabilities and build scalable data infrastructures. You will design robust data systems...Show more

Last updated: 8 days ago • Promoted

Sr. ML Engineer, AI Cloud

Tenstorrent • Santa Clara, California, United States

Full-time +1

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions mu...Show more

Last updated: 30+ days ago • Promoted

Senior Cloud Engineer

Verily Life Sciences • Mountain View, CA, United States

Full-time

Verily is a subsidiary of Alphabet that is using a data-driven approach to change the way people manage their health and the way healthcare is delivered. Launched from Google X in 2015, our purpose ...Show more

Last updated: 30+ days ago • Promoted

Senior Software Engineer, Data Science & Analytics Platform Engineering

Apple • Cupertino, CA, United States

Full-time

Imagine what you could do here.At Apple, revolutionary ideas have a way of becoming extraordinary products, services, and customer experiences. Join the Services Data Science & Analytics Platform an...Show more

Last updated: 11 days ago • Promoted

Senior Software Engineer, Data Ingestion and Movement - DGX Cloud

NVIDIA • Santa Clara, CA, United States

Full-time

NVIDIA is seeking a Senior Software Engineer to build a worldwide network of fast, efficient, and reliable data transfer systems. The goal is to enable NVIDIA AI workflows by enabling self-service d...Show more

Last updated: 11 days ago • Promoted

Senior ML Data Engineer

Midjourney • Hayward, CA, United States

Full-time

We're the data team behind Midjourney's image generation models.We handle the dataset side : processing, filtering, scoring, captioning, and all the distributed compute that makes high-quality train...Show more

Last updated: 1 day ago • Promoted

Senior Engineer Cloud Architecture

Tata Consultancy Services • Fremont, CA, United States

Full-time

Must Have Technical / Functional Skills.Net, C#, Java, AWS Roles & Responsibilities.Software Development : Design, develop, test, and deploy robust, scalable, and secure applications using C#,.Cloud A...Show more

Last updated: 14 days ago • Promoted

Senior Data Platform Engineer – Hybrid

General Motors • Mountain View, CA, United States

Full-time

A leading automotive company in California is seeking an experienced engineer to architect and automate data processing systems. The role involves building data pipelines and ensuring data quality f...Show more

Last updated: 8 days ago • Promoted

Senior ML Platform Engineer - GenAI & Data Pipelines

Adobe • San Jose, CA, US

Full-time

A leading software company is seeking a Senior Machine Learning Engineer in San Jose, California.This role focuses on building AI data pipelines, developing ML models, and ensuring ethical AI use.T...Show more

Last updated: 2 days ago • Promoted

Senior AI Platform Engineer — API Leadership & Cloud

Cisco Systems, Inc. • San Jose, CA, United States

Full-time

A technological leader in San Jose is searching for a Senior Software Engineer to lead API development for their AI platform. The role requires deep knowledge of Kubernetes, cloud infrastructure, an...Show more

Last updated: 6 days ago • Promoted

Senior AI Engineer

Commerceiq • Mountain View, California, United States

Full-time

CommerceIQ’s AI-powered digital commerce platform is revolutionizing the way brands sell online.Our unified ecommerce management solutions empower brands to make smarter, faster decisions through i...Show more

Last updated: 30+ days ago • Promoted

Senior Data / AI / ML Software Engineer

Crossing Hurdles • Hayward, CA, United States

Full-time

Crossing Hurdles is a global recruitment firm partnering with, a fast-growing Clinical Data Intelligence platform built on 12+ years of advanced research in Machine Reading and Knowledge Graph tech...Show more

Last updated: 1 day ago • Promoted

Senior Software Engineer, AI / ML

Striim • Palo Alto, CA, United States

Full-time

Striim, (pronounced "stream" with two i's for integration and intelligence), is a unified data integration and streaming platform that connects clouds, data, and applications with unprecedented spe...Show more

Last updated: 11 days ago • Promoted

Senior AI Engineer

Linkedin • Sunnyvale, California, United States

Full-time

LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover excit...Show more

Last updated: 19 days ago • Promoted

Senior Data Engineer

Sigmaways Inc • Hayward, CA, United States

Full-time

If you’re hands on with modern data platforms, cloud tech, and big data tools and you like building solutions that are secure, repeatable, and fast, this role is for you. As a Senior Data Engineer, ...Show more

Last updated: 1 day ago • Promoted

Senior ML Platform Engineer for Large-Scale AI Infra

Apple Inc. • Santa Clara, CA, United States

Full-time

A leading technology company in Santa Clara is seeking a Machine Learning Engineer to design and build large-scale distributed services that power their search and foundation model platforms.You wi...Show more

Last updated: 8 hours ago • Promoted • New!

Senior DevOps Engineer — Big Data & Cloud Scale

Roku, Inc. • San Jose, CA, United States

Full-time

A leading streaming platform company in California is looking for a skilled DevOps engineer to automate and scale Big Data technology stacks. The role involves building CI / CD pipelines, setting up m...Show more

Last updated: 7 days ago • Promoted