Principal Data Engineer – R01560587Brillio • San Francisco, United States

Principal Data Engineer – R01560587

Brillio • San Francisco, United States

1 day ago

Job type

Full-time

Job description

Job requirements

Experience Range : 12 - 15 years of experience, including significant hands-on expertise in Snowflake data architecture and data engineering

Key Responsibilities :

Design and implement scalable Snowflake data architectures to support enterprise data warehousing and analytics needs

Optimize Snowflake performance through advanced tuning, warehousing strategies, and efficient data sharing solutions

Develop robust data pipelines using Python and DBT, including modeling, testing, macros, and snapshot management

Implement and enforce security best practices such as RBAC, data masking, and row-level security across cloud data platforms

Architect and manage AWS-based data solutions leveraging S3, Redshift, Lambda, Glue, EC2, and IAM for secure and reliable data operations

Orchestrate and monitor complex data workflows using Apache Airflow, including DAG design, operator configuration, and scheduling

Utilize version control systems such as Git to manage codebase and facilitate collaborative data engineering workflows

Integrate and process high-volume data using Apache ecosystem tools such as Spark, Kafka, and Hive, with an understanding of Hadoop environments

Required Skills :

Advanced hands-on experience with Snowflake, including performance tuning and warehousing strategies

Expertise in Snowflake security features such as RBAC, data masking, and row-level security

Proficiency in advanced Python programming for data engineering tasks

In-depth knowledge of DBT for data modeling, testing, macros, and snapshot management

Strong experience with AWS services including S3, Redshift, Lambda, Glue, EC2, and IAM

Extensive experience designing and managing Apache Airflow DAGs and scheduling workflows

Proficiency in version control using Git for collaborative development

Hands-on experience with Apache Spark, Kafka, and Hive

Solid understanding of Hadoop ecosystem

Expertise in SQL (basic and advanced), including SnowSQL, PLSQL, and T-SQL

Strong requirement understanding, presentation, and documentation skills; ability to translate business needs into clear, structured functional / technical documents and present them effectively to stakeholders.

Preferred Skills :

Experience with Salesforce Data Cloud integration

Familiarity with data cataloging tools such as Alation

Exposure to real-time streaming architectures

Experience working in multi-cloud environments

Knowledge of DevOps or DataOps practices

Certifications in data cloud technologies

Desired Qualifications :

Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field

Relevant certifications in Snowflake, AWS, or data engineering technologies are highly desirable

Salary : 140-150 USD per year salary

Create a job alert for this search

Principal Data Engineer R01560587 • San Francisco, United States

Similar jobs

Principal Data Engineer

Tendo Systems • San Francisco, CA, United States

Full-time

As a Principal Data Engineer, you will work within the Engineering team and contribute to Tendo’s strategic data engineering solutions by ingesting, transforming, and warehousing healthcare-related...Show more

Last updated: 30+ days ago • Promoted

Remote Principal Data Engineer - AI Platform Leader

Upbound - Job Posting • San Francisco, CA, United States

Remote

Full-time

A leading cloud-native infrastructure company is seeking a Principal Data Engineer to lead technical efforts in building sophisticated data platforms. The ideal candidate will have over 10 years of ...Show more

Last updated: 30+ days ago • Promoted

Principal Data Engineer - AI (REMOTE)

Upbound • San Francisco, CA, United States

Remote

Full-time

Upbound is redefining how modern infrastructure is built.As the creators of Crossplane and the pioneers of the Intelligent Control Plane, we are leading the shift toward. We’re seeking an exceptiona...Show more

Last updated: 30+ days ago • Promoted

Principal Data Platform Engineer - Real-Time Analytics

vercel.com • San Francisco, CA, United States

Full-time

A leading tech company is seeking a Principal Engineer to lead the development of a next-generation Data Platform.The role involves hands-on engineering and technical leadership, designing scalable...Show more

Last updated: 30+ days ago • Promoted

Principal PM, Agentic AI Data Platform

DataRobot • San Francisco, CA, United States

Full-time

A leading AI solutions provider in San Francisco is seeking a Principal Product Manager specializing in Data and AI for their Agent Workforce Platform. The ideal candidate will have at least 8 years...Show more

Last updated: 1 day ago • Promoted

Principal Engineer, Shared Platforms & Services – AI Enablement

Levi Strauss & Co. • San Francisco, CA, United States

Full-time +1

Principal Engineer, Shared Platforms & Services – AI Enablement page is loaded## Principal Engineer, Shared Platforms & Services – AI Enablementlocations : HQ-Office, San Francisco, CA, USA : Rem...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

The Rockridge Group • Emeryville, California, US

Full-time

Job Description Job Description TITLE : DATA ENGINEER LOCATION : 100% remote Skillsets / experience : • Engineer background • Google Applications / Analytics experience required • Google Search consol...Show more

Last updated: 6 days ago • Promoted

Principal Data Platform Engineer

Harnham • San Francisco, CA, United States

Full-time

San Francisco, CA (Remote Eligible – US Only).Are you ready to lead the design and build of a world-class data platform from the ground up?. A high-growth, product-led tech company is looking for a ...Show more

Last updated: 30+ days ago • Promoted

Platform Engineer, Enterprise AI & Data Infra

OpenAI • San Francisco, CA, United States

Full-time

A leading AI research firm in San Francisco is seeking a professional to design and deploy services that empower models and agents. The role involves ensuring data access patterns enhance model perf...Show more

Last updated: 30+ days ago • Promoted

Principal Machine Learning Engineer

Gap Inc. • San Francisco, CA, United States

Full-time

Principal Machine Learning Engineer.Full time Two Folsom, San Francisco, CA, US 94105.Our brands bridge the gaps we see in the world. Old Navy democratizes style to ensure everyone has access to qua...Show more

Last updated: 1 day ago • Promoted

Data Engineer

Contact Government Services, LLC • San Francisco, California, US

Full-time

Job Description Job Description Data Engineer Employment Type : Full-Time, Mid-level Department : Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly gr...Show more

Last updated: 6 days ago • Promoted

Principal Data Platform Engineer : Graph & AI

Salesforce, Inc. • San Francisco, CA, United States

Full-time

A leading technology company is looking for a Principal Software Engineer to architect their data platform.Candidates should have extensive experience in software engineering focusing on backend sy...Show more

Last updated: 30+ days ago • Promoted

Principal Machine Learning Engineer

Gap • San Francisco, CA, United States

Full-time

Our brands bridge the gaps we see in the world.Old Navy democratizes style to ensure everyone has access to quality fashion at every price point. Athleta unleashes the potential of every woman, rega...Show more

Last updated: 30+ days ago • Promoted

Principal Software Engineer, Data Platform

salesforce.com, inc. • San Francisco, CA, United States

Full-time

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Salesforce is the #1 AI CRM, where humans with age...Show more

Last updated: 30+ days ago • Promoted

Principal Data Scientist

Equinix • Redwood City, CA, United States

Full-time

Equinix is the world's digital infrastructure company, shortening the path to connectivity to enable the innovations that enrich our work, life and planet. A place where tech thinkers and future bui...Show more

Last updated: 30+ days ago • Promoted

Data Engineer - Data Engineering

Plaid • San Francisco, California, US

Full-time

Job Description Job Description The main goal of the DE team in 2024-25 is to build robust golden data sets to power our business goals of creating more insights based products.Making data-driven...Show more

Last updated: 6 days ago • Promoted

Principal Engineer

Adyen • San Francisco, CA, United States

Full-time

Adyen provides payments, data, and financial products in a single solution for customers like Facebook, Uber, H&M, and Microsoft - making us the financial technology platform of choice.At Adyen, ev...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Kiddom • San Francisco, California, US

Full-time +1

Job Description Job Description Kiddom is redefining how technology powers learning.We combine world-class curriculum with cutting-edge AI and modern SaaS infrastructure to help schools deliver t...Show more

Last updated: 6 days ago • Promoted