Talent.com
No longer accepting applications
Principal Data Engineer for AI Platform

Principal Data Engineer for AI Platform

MastercardSan Francisco, CA, United States
16 hours ago
Job type
  • Full-time
Job description

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title and Summary

Principal Data Engineer for AI Platform

About Mastercard : Mastercard is a global technology company in the payments industry, connecting billions of consumers, financial institutions, merchants, governments, and businesses worldwide. We are driving the future of commerce by enabling secure, simple, and smart transactions. Artificial Intelligence is at the core of our strategy to make Mastercard stronger and commerce safer, smarter and more personal. At Mastercard, we’re building next‑generation AI‑powered platforms to drive innovation and impact.

Role

  • Drive modernization from legacy and on‑prem systems to modern, cloud‑native, and hybrid data platforms.
  • Architect and lead the development of a Multi‑Agent ETL Platform for batch and event streaming, integrating AI agents to autonomously manage ETL tasks such as data discovery, schema mapping, and error resolution.
  • Define and implement data ingestion, transformation, and delivery pipelines using scalable frameworks (e.g., Apache Airflow, Nifi, dbt, Spark, Kafka, or Dagster).
  • Leverage LLMs, and agent frameworks (e.g., LangChain, CrewAI, AutoGen) to automate pipeline management and monitoring.
  • Ensure robust data governance, cataloging, versioning, and lineage tracking across the ETL platform.
  • Define project roadmaps, KPIs, and performance metrics for platform efficiency and data reliability.
  • Establish and enforce best practices in data quality, CI / CD for data pipelines, and observability.
  • Collaborate closely with cross‑functional teams (Data Science, Analytics, and Application Development) to understand requirements and deliver efficient data ingestion and processing workflows.
  • Establish and enforce best practices, automation standards, and monitoring frameworks to ensure the platform’s reliability, scalability, and security.
  • Build relationships and communicate effectively with internal and external stakeholders, including senior executives, to influence data‑driven strategies and decisions.
  • Continuously engage and improve teams’ performance by conducting recurring meetings, knowing your people, managing career development, and understanding who is at risk.
  • Oversee deployment, monitoring, and scaling of ETL and agent workloads across multi cloud environments.
  • Continuously improve platform performance, cost efficiency, and automation maturity.

All About You

  • Hands‑on experience in data engineering, data platform strategy, or a related technical domain.
  • Proven experience leading global data engineering or platform engineering teams.
  • Proven experience in building and modernizing distributed data platforms using technologies such as Apache Spark, Kafka, Flink, NiFi, and Cloudera / Hadoop.
  • Strong experience with one or more of data pipeline tools (Nifi, Airflow, dbt, Spark, Kafka, Dagster, etc.) and distributed data processing at scale.
  • Experience building and managing AI‑augmented or agent‑driven systems will be a plus.
  • Proficiency in Python, SQL, and data ecosystems (Oracle, AWS Glue, Azure Data Factory, BigQuery, Snowflake, etc.).
  • Deep understanding of data modeling, metadata management, and data governance principles.
  • Proven success in leading technical teams and managing complex, cross‑functional projects.
  • Passion for staying current in a fast‑paced field with proven ability to lead innovation in a scaled organization.
  • Excellent communication skills, with the ability to tailor technical concepts to executive, operational, and technical audiences.
  • Expertise and ability to lead technical decision‑making considering scalability, cost efficiency, stakeholder priorities, and time to market.
  • Proven track leading high‑performing teams with experience leading and coaching director‑level reports and experienced individual contributors.
  • Advanced degree in Data Science, Computer Science, Information Technology, Business Administration, or a related field. Equivalent experience will also be considered.
  • Why Join Us?

    At Mastercard, you’ll help shape the future of AI in global commerce—solving complex challenges at scale, driving financial inclusion, and reinforcing the trust and security that define our brand. You’ll work with world‑class talent, cutting‑edge technologies, and will make a lasting impact.

    Equal Opportunity Statement

    #AI1 Mastercard is a merit‑based, inclusive, equal opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law. We hire the most qualified candidate for the role. In the US or Canada, if you require accommodations or assistance to complete the online application process or during the recruitment process, please contact reasonable_accommodation@mastercard.com and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly.

    Corporate Security Responsibility

  • Abide by Mastercard’s security policies and practices;
  • Ensure the confidentiality and integrity of the information being accessed;
  • Report any suspected information security violation or breach, and
  • Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.
  • Compensation and Benefits

    In line with Mastercard’s total compensation philosophy and assuming that the job will be performed in the US, the successful candidate will be offered a competitive base salary and may be eligible for an annual bonus or commissions depending on the role. The base salary offered may vary depending on multiple factors, including but not limited to location, job‑related knowledge, skills, and experience.

    Mastercard benefits for full‑time (and certain part‑time) employees generally include : insurance (including medical, prescription drug, dental, vision, disability, life insurance); flexible spending account and health savings account; paid leaves (including 16 weeks of new parent leave and up to 20 days of bereavement leave); 80 hours of Paid Sick and Safe Time, 25 days of vacation time and 5 personal days, pro‑rated based on date of hire; 10 annual paid U.S. observed holidays; 401k with a best‑in‑class company match; deferred compensation for eligible roles; fitness reimbursement or on‑site fitness facilities; eligibility for tuition reimbursement; and many more.

    Mastercard benefits for interns generally include : 56 hours of Paid Sick and Safe Time; jury duty leave; and on‑site fitness facilities in some locations.

    Pay Ranges

    Arlington, Virginia : $170,000 - $273,000 USD

    Purchase, New York : $170,000 - $273,000 USD

    San Francisco, California : $178,000 - $284,000 USD

    #J-18808-Ljbffr

    Create a job alert for this search

    Engineer Ai Platform • San Francisco, CA, United States

    Related jobs
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    TendSan Francisco, CA, United States
    Full-time
    As a Principal Data Engineer, you will work within the Engineering team and contribute to Tendo’s strategic data engineering solutions by ingesting, transforming, and warehousing healthcare-related...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    Tendo SystemsSan Francisco, CA, United States
    Full-time
    As a Principal Data Engineer, you will work within the Engineering team and contribute to Tendo’s strategic data engineering solutions by ingesting, transforming, and warehousing healthcare-related...Show moreLast updated: 4 days ago
    • Promoted
    Principal AI Engineer

    Principal AI Engineer

    MastercardSan Francisco, CA, United States
    Full-time
    Mastercard is a global technology leader in the payments industry, connecting billions of consumers, financial institutions, merchants, governments, and businesses worldwide.Artificial Intelligence...Show moreLast updated: 4 days ago
    • Promoted
    Principal Data Platform Engineer

    Principal Data Platform Engineer

    HarnhamSan Francisco, CA, United States
    Full-time
    San Francisco, CA (Remote Eligible – US Only).Are you ready to lead the design and build of a world-class data platform from the ground up?. A high-growth, product-led tech company is looking for a ...Show moreLast updated: 7 days ago
    • Promoted
    • New!
    Founding Data Platform Engineer for GenAI

    Founding Data Platform Engineer for GenAI

    Cogent SecuritySan Francisco, CA, United States
    Full-time
    A pioneering cybersecurity company in San Francisco is looking for skilled Founding and Staff-level Engineers.You will design foundational data platforms and enable robust data pipelines for genera...Show moreLast updated: 5 hours ago
    • Promoted
    Principal, Data Engineer

    Principal, Data Engineer

    Gemini Trust CompanySan Francisco, CA, United States
    Full-time
    Gemini is a global crypto and Web3 platform founded by Cameron and Tyler Winklevoss in 2014, offering a wide range of simple, reliable, and secure crypto products and services to individuals and in...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    SanasPalo Alto, CA, United States
    Full-time
    Founded by a team of Stanford researchers and entrepreneurs with deep industry experience, Sanas has developed the world’s first real-time speech transformation platform capable of accent translati...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    UberSan Francisco, CA, United States
    Full-time
    This is a Technical Data Leader position.The Data Engineering team focuses on building core Business Intelligence and Data Solutions for multiple business verticals at Uber, like Uber Eats, Grocery...Show moreLast updated: 18 days ago
    • Promoted
    Principal Engineer - AI Tools

    Principal Engineer - AI Tools

    UberSan Francisco, CA, United States
    Full-time
    At Uber, developer productivity is a cornerstone of our innovation engine.We are seeking a world‑class Principal Engineer (Director‑equivalent) to lead the next frontier of software development by ...Show moreLast updated: 7 days ago
    • Promoted
    Principal Engineer, AI Engineering

    Principal Engineer, AI Engineering

    OktaSan Francisco, CA, United States
    Full-time
    Okta is The World's Identity Company.We free everyone to safely use any technology, anywhere, on any device or app.Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secur...Show moreLast updated: 7 days ago
    • Promoted
    Principal Database Engineer

    Principal Database Engineer

    Informatica LLCRedwood City, CA, United States
    Full-time
    Build Your Career at Informatica.We seek innovative thinkers who believe in the power of data to drive meaningful change. At Informatica, we welcome adventurous minds eager to solve the world's most...Show moreLast updated: 20 days ago
    • Promoted
    • New!
    Principal AI Engineer

    Principal AI Engineer

    AquentSan Bruno, CA, United States
    Permanent
    This role is onsite in San Bruno, CA or Bentonville, AR and relocation is offered • • •.As a Principal Engineer, AI Systems in the Design Organization, you will : . Implement and Productionize AI Systems...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Platform Engineer : Data Infra for AI Systems | Hybrid + Equity

    Platform Engineer : Data Infra for AI Systems | Hybrid + Equity

    bemSan Francisco, CA, United States
    Full-time
    A forward-thinking tech company in San Francisco is seeking a Platform Engineer to architect data infrastructures and develop multi-cloud solutions for AI systems. This role combines deep data knowl...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    Principal Data Engineer for AI Platform

    Principal Data Engineer for AI Platform

    MasterCardSan Francisco, CA, United States
    Full-time +1
    Mastercard powers economies and empowers people in 200+ countries and territories worldwide.Together with our customers, we’re helping build a sustainable economy where everyone can prosper.We supp...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Principal AI Engineer

    Principal AI Engineer

    MasterCardSan Francisco, CA, United States
    Full-time +1
    Mastercard powers economies and empowers people in 200+ countries and territories worldwide.Together with our customers, we’re helping build a sustainable economy where everyone can prosper.We supp...Show moreLast updated: 1 hour ago
    • Promoted
    • New!
    Principal Data Engineer

    Principal Data Engineer

    TENDOSan Francisco, CA, United States
    Full-time
    As a Principal Data Engineer, you will work within the Engineering team and contribute to Tendo's strategic data engineering solutions by ingesting, transforming, and warehousing healthcare-related...Show moreLast updated: 1 hour ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    TendoSan Francisco, CA, United States
    Full-time
    As a Principal Data Engineer, you will work within the Engineering team and contribute to Tendo’s strategic data engineering solutions by ingesting, transforming, and warehousing healthcare-related...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior / Principal AI Platform Engineer, Data

    Senior / Principal AI Platform Engineer, Data

    RobloxSan Mateo, CA, United States
    Full-time
    Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences- all created by our global community of developers...Show moreLast updated: 1 hour ago