Talent.com
Principal Software Engineer - AI Systems

Principal Software Engineer - AI Systems

ODAIASunnyvale, CA, United States
7 hours ago
Job type
  • Full-time
Job description

Position Summary...

What you’ll do... What you’ll do

1. AI Systems Engineering

  • Design and implement large-scale, production-grade AI systems that integrate LLMs and Generative AI into real-world applications.
  • Build frameworks that support Retrieval-Augmented Generation (RAG), agentic workflows, and multi-step reasoning at scale.
  • Ensure models and agents are production-ready with strong observability, monitoring, and performance optimization.

2. Architecture & Scalability

  • Architect distributed, fault-tolerant systems capable of supporting high-throughput AI workloads.
  • Lead the design of modular, extensible, and reusable components to accelerate AI adoption across teams.
  • Build MVPs quickly, validate assumptions, and iterate toward scalable long-term solutions.
  • 3. Integration & Delivery

  • Partner with product and platform teams to integrate AI into customer-facing and enterprise-grade applications.
  • Define and enforce standards for APIs, services, and infrastructure that enable seamless AI adoption.
  • Balance functional requirements with non-functional goals such as reliability, latency, and security.
  • 4. Leadership & Mentorship

  • Drive technical strategy for AI initiatives and guide teams in best practices for AI‑driven software development.
  • Mentor engineers across software and AI domains to elevate overall technical expertise.
  • Contribute to thought leadership in AI engineering through internal frameworks, design patterns, and reusable components.
  • What you’ll bring

  • 12+ years of experience in software engineering (backend, distributed systems, large‑scale platforms), with 2+ years applying Generative AI / LLMs in production.
  • Proven expertise in distributed computing, cloud-native architectures (GCP, Azure, or AWS), and systems that prioritize scalability and fault tolerance.
  • Strong coding skills in Python (preferred) and at least one system‑level language (Java, Go, or C++).
  • Experience with ML / AI frameworks (PyTorch, TensorFlow, Hugging Face) as a plus, but applied in the context of building systems, not just training models.
  • Deep knowledge of RAG pipelines, vector databases, and real‑time data integration.
  • Familiarity with resilience engineering : disaster recovery, failover, monitoring, and high availability.
  • Exposure to multi‑modal AI (text, image, video) and optimization techniques (quantization, distillation) is advantageous.
  • Strong grounding in system design, performance engineering, and design patterns.
  • Track record of delivering production systems with AI at scale, not just research or prototyping.
  • Key Positioning Shift

  • Moved model training / fine‑tuning to secondary importance → framed as a plus, not the core.
  • Emphasized distributed systems, cloud, APIs, reliability, and software engineering fundamentals.
  • Framed role as “AI Systems Engineer” / “AI Engineer” instead of “ML Engineer.”
  • Highlighted production integration and customer‑facing impact, which appeals to senior software engineers.
  • Equal Opportunity Employer

    Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers, and the communities we serve live better when we really know them. That means understanding, respecting, and valuing unique styles, experiences, identities, ideas, and opinions – while being inclusive of all people.

    At Walmart, we offer competitive pay as well as performance‑based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company‑paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short‑term and long‑term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.

    You will also receive PTO and / or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable.

    For information about PTO, see https : / / one.walmart.com / notices.

    Live Better U is a Walmart‑paid education benefit program for full‑time and part‑time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short‑form certificates. Tuition, books, and fees are completely paid for by Walmart.

    Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms.

    For information about benefits and eligibility, see One.Walmart.

    The annual salary range for this position is $143,000.00-$286,000.00

    Additional compensation includes annual or quarterly performance bonuses.

    Additional compensation for certain positions may also include :

  • Stock
  • Minimum Qualifications

  • Option 1 : Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 5 years’ experience in software engineering or related area.
  • Option 2 : 7 years’ experience in software engineering or related area.
  • Preferred Qualifications

  • Master’s degree in computer science, computer engineering, computer information systems, software engineering, or related area and 3 years' experience in software engineering or related area. We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart’s accessibility standards and guidelines for supporting an inclusive culture.
  • Primary Location

    1395 Crossman Ave, Sunnyvale, CA 94089-1114, United States of America

    Walmart and its subsidiaries are committed to maintaining a drug‑free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment.

    #J-18808-Ljbffr

    Create a job alert for this search

    Principal Engineer Ai • Sunnyvale, CA, United States

    Related jobs
    • Promoted
    Principal Software Engineer - Automotive AI Frameworks

    Principal Software Engineer - Automotive AI Frameworks

    Renesas Electronics CorporationSan Francisco, CA, United States
    Full-time
    ADAS領域では、AIを活用した機能や性能への要求が日々高度化しています。そのため、お客様のアプリケーション開発をより容易かつ効率的にする、抽象度の高い使いやすいフレームワークの提供が急務となっています。ルネサスでは、顧客のユースケースを深く理解し、R-Car SoCのシステム性能やAIアクセラレータの能力を最大限に引き出すフレームワークの開発を推進しています。.R-Car SoC向けシステ...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer - AI Agent Infrastructure (Healthcare)

    Software Engineer - AI Agent Infrastructure (Healthcare)

    Honey HealthHayward, CA, United States
    Full-time
    Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patient data, processing orders and prescri...Show moreLast updated: 11 days ago
    • Promoted
    Senior Software Engineer - AI Agent Infrastructure (Healthcare)

    Senior Software Engineer - AI Agent Infrastructure (Healthcare)

    Honey HealthFremont, CA, United States
    Full-time
    Honey Health is the all-in-one AI back office for primary and specialty care.Our AI agents autonomously handle core back-office jobs, such as aggregating patients data, processing orders and prescr...Show moreLast updated: 9 days ago
    • Promoted
    Principal AI Software Engineer, Product

    Principal AI Software Engineer, Product

    MonographSan Francisco, CA, United States
    Full-time
    Gusto is a modern, online people platform that helps small businesses take care of their teams.On top of full-service payroll, Gusto offers health insurance, 401(k)s, expert HR, and team management...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Software Engineer

    Principal Software Engineer

    SupermicroSan Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Software Engineer

    Principal Software Engineer

    Cisco Systems, Inc.San Jose, CA, United States
    Full-time
    Who We Are Cisco's Cloud Security organization is at the forefront of securing the modern workforce, protecting users, data, and applications wherever they reside. As the cornerstone of Cisco's Se...Show moreLast updated: 6 days ago
    • Promoted
    Principal Software Engineer – AI Platform

    Principal Software Engineer – AI Platform

    Snorkel AISan Francisco, CA, United States
    Full-time
    At Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data.We’re on a mission to help enterprises transform expert knowledge into specialized AI at scale.The AI land...Show moreLast updated: 1 day ago
    • Promoted
    Principal Engineer - AI Tools

    Principal Engineer - AI Tools

    UberSan Francisco, CA, United States
    Full-time
    At Uber, developer productivity is a cornerstone of our innovation engine.We are seeking a world‑class Principal Engineer (Director‑equivalent) to lead the next frontier of software development by ...Show moreLast updated: 7 days ago
    • Promoted
    Principal Engineer, AI Engineering

    Principal Engineer, AI Engineering

    OktaSan Francisco, CA, United States
    Full-time
    Okta is The World's Identity Company.We free everyone to safely use any technology, anywhere, on any device or app.Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secur...Show moreLast updated: 7 days ago
    • Promoted
    Principal Software Engineer II - Elasticsearch - Query Engine, Database Internals

    Principal Software Engineer II - Elasticsearch - Query Engine, Database Internals

    ElasticMountain View, CA, United States
    Full-time
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Software Engineer, Applied AI

    Principal Software Engineer, Applied AI

    Chaos, Inc.San Francisco, CA, United States
    Full-time
    Founded in 2022 by a seasoned leadership team, CHAOS has quickly become the place where world-class multi-disciplinary engineers come to build mission-critical technologies.CHAOS has a mission-focu...Show moreLast updated: 4 days ago
    • Promoted
    Principal Software Engineer, Managed AI

    Principal Software Engineer, Managed AI

    Crusoe Energy Systems LLCSan Francisco, CA, United States
    Full-time
    Crusoe's mission is to accelerate the abundance of energy and intelligence.We’re crafting the engine that powers a world where people can create ambitiously with AI — without sacrificing scale, spe...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Software Engineer - AI Governance

    Principal Software Engineer - AI Governance

    OneTrustSan Francisco, CA, United States
    Full-time
    Principal Software Engineer - AI Governance.OneTrust’s mission is to enable organizations to use data and AI responsibly. Our platform simplifies the collection of data with consent and preferences,...Show moreLast updated: 3 days ago
    • Promoted
    Principal Software Engineer, Managed AI

    Principal Software Engineer, Managed AI

    CrusoeSan Francisco, CA, United States
    Full-time
    Crusoe's mission is to accelerate the abundance of energy and intelligence.We’re crafting the engine that powers a world where people can create ambitiously with AI — without sacrificing scale, spe...Show moreLast updated: 5 days ago
    • Promoted
    Principal Software Engineer

    Principal Software Engineer

    CEF AISan Francisco, CA, United States
    Full-time
    Are you excited by the opportunity to become a part of a badass team leading the AI-first data revolution?.Do you thrive on solving hard problems (individually and collectively), yet humble and hun...Show moreLast updated: 22 days ago
    • Promoted
    Principal Software Engineer, Managed AI

    Principal Software Engineer, Managed AI

    Epoch BiodesignSan Francisco, CA, United States
    Full-time
    San Francisco, CA - US, Sunnyvale, CA - US.Crusoe's mission is to accelerate the abundance of energy and intelligence.We’re crafting the engine that powers a world where people can create ambitious...Show moreLast updated: 7 days ago
    • Promoted
    Principal Software Engineer

    Principal Software Engineer

    Informatica LLCRedwood City, CA, United States
    Full-time
    Build Your Career at Informatica.We seek innovative thinkers who believe in the power of data to drive meaningful change. At Informatica, we welcome adventurous, work-from-anywhere minds eager to so...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Principal Software Engineer - AI Systems

    Principal Software Engineer - AI Systems

    ODAIASunnyvale, CA, United States
    Full-time
    Design and implement large-scale, production-grade AI systems that integrate LLMs and Generative AI into real-world applications. Build frameworks that support Retrieval-Augmented Generation (RAG), ...Show moreLast updated: 2 hours ago