Talent.com
Principal Software Engineer - AI Systems
Principal Software Engineer - AI SystemsODAIA • Sunnyvale, CA, United States
Principal Software Engineer - AI Systems

Principal Software Engineer - AI Systems

ODAIA • Sunnyvale, CA, United States
4 days ago
Job type
  • Full-time
Job description

Position Summary...

What you’ll do... What you’ll do

1. AI Systems Engineering

  • Design and implement large-scale, production-grade AI systems that integrate LLMs and Generative AI into real-world applications.
  • Build frameworks that support Retrieval-Augmented Generation (RAG), agentic workflows, and multi-step reasoning at scale.
  • Ensure models and agents are production-ready with strong observability, monitoring, and performance optimization.

2. Architecture & Scalability

  • Architect distributed, fault-tolerant systems capable of supporting high-throughput AI workloads.
  • Lead the design of modular, extensible, and reusable components to accelerate AI adoption across teams.
  • Build MVPs quickly, validate assumptions, and iterate toward scalable long-term solutions.
  • 3. Integration & Delivery

  • Partner with product and platform teams to integrate AI into customer-facing and enterprise-grade applications.
  • Define and enforce standards for APIs, services, and infrastructure that enable seamless AI adoption.
  • Balance functional requirements with non-functional goals such as reliability, latency, and security.
  • 4. Leadership & Mentorship

  • Drive technical strategy for AI initiatives and guide teams in best practices for AI‑driven software development.
  • Mentor engineers across software and AI domains to elevate overall technical expertise.
  • Contribute to thought leadership in AI engineering through internal frameworks, design patterns, and reusable components.
  • What you’ll bring

  • 12+ years of experience in software engineering (backend, distributed systems, large‑scale platforms), with 2+ years applying Generative AI / LLMs in production.
  • Proven expertise in distributed computing, cloud-native architectures (GCP, Azure, or AWS), and systems that prioritize scalability and fault tolerance.
  • Strong coding skills in Python (preferred) and at least one system‑level language (Java, Go, or C++).
  • Experience with ML / AI frameworks (PyTorch, TensorFlow, Hugging Face) as a plus, but applied in the context of building systems, not just training models.
  • Deep knowledge of RAG pipelines, vector databases, and real‑time data integration.
  • Familiarity with resilience engineering : disaster recovery, failover, monitoring, and high availability.
  • Exposure to multi‑modal AI (text, image, video) and optimization techniques (quantization, distillation) is advantageous.
  • Strong grounding in system design, performance engineering, and design patterns.
  • Track record of delivering production systems with AI at scale, not just research or prototyping.
  • Key Positioning Shift

  • Moved model training / fine‑tuning to secondary importance → framed as a plus, not the core.
  • Emphasized distributed systems, cloud, APIs, reliability, and software engineering fundamentals.
  • Framed role as “AI Systems Engineer” / “AI Engineer” instead of “ML Engineer.”
  • Highlighted production integration and customer‑facing impact, which appeals to senior software engineers.
  • Equal Opportunity Employer

    Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers, and the communities we serve live better when we really know them. That means understanding, respecting, and valuing unique styles, experiences, identities, ideas, and opinions – while being inclusive of all people.

    At Walmart, we offer competitive pay as well as performance‑based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company‑paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short‑term and long‑term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.

    You will also receive PTO and / or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable.

    For information about PTO, see https : / / one.walmart.com / notices.

    Live Better U is a Walmart‑paid education benefit program for full‑time and part‑time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short‑form certificates. Tuition, books, and fees are completely paid for by Walmart.

    Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms.

    For information about benefits and eligibility, see One.Walmart.

    The annual salary range for this position is $143,000.00-$286,000.00

    Additional compensation includes annual or quarterly performance bonuses.

    Additional compensation for certain positions may also include :

  • Stock
  • Minimum Qualifications

  • Option 1 : Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 5 years’ experience in software engineering or related area.
  • Option 2 : 7 years’ experience in software engineering or related area.
  • Preferred Qualifications

  • Master’s degree in computer science, computer engineering, computer information systems, software engineering, or related area and 3 years' experience in software engineering or related area. We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart’s accessibility standards and guidelines for supporting an inclusive culture.
  • Primary Location

    1395 Crossman Ave, Sunnyvale, CA 94089-1114, United States of America

    Walmart and its subsidiaries are committed to maintaining a drug‑free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment.

    #J-18808-Ljbffr

    Create a job alert for this search

    Principal Engineer Ai • Sunnyvale, CA, United States

    Related jobs
    Principal Software Engineer – AI Systems

    Principal Software Engineer – AI Systems

    Walmart Canada • Sunnyvale, CA, United States
    Full-time
    Balance functional requirements with non-functional goals such as reliability, latency, and security.Generative AI / LLMs • • in production. Strong coding skills in • •Python (preferred) • • and at least o...Show more
    Last updated: 30+ days ago • Promoted
    Principal AI Engineer (San Jose, CA)

    Principal AI Engineer (San Jose, CA)

    Tenex.AI Inc • San Jose, CA, United States
    Full-time
    TENEX is an AI-native, automation-first, built-for-scale Managed Detection and Response (MDR) provider.We are a force multiplier for defenders, helping organizations enhance their cybersecurity pos...Show more
    Last updated: 3 days ago • Promoted
    AI First Software Engineer - Senior Manager

    AI First Software Engineer - Senior Manager

    PwC • San Jose, CA, United States
    Full-time
    At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients.These individuals comb...Show more
    Last updated: 3 days ago • Promoted
    Principal Software Engineer, ML Systems

    Principal Software Engineer, ML Systems

    Waymo • Mountain View, CA, US
    Full-time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...Show more
    Last updated: 10 days ago • Promoted
    Software Engineer - Analytics & AI

    Software Engineer - Analytics & AI

    Cxapp Us, Inc. • San Ramon, California, United States
    Full-time
    At CXApp, we are the innovators of Indoor Intelligence, delivering actionable insights for people, places and things.Our flagship product the “CXApp” is a workplace experience platform for the ente...Show more
    Last updated: 30+ days ago • Promoted
    Principal Software Engineer ( Sr Architect )

    Principal Software Engineer ( Sr Architect )

    Blue Yonder • Palo Alto, CA, United States
    Full-time
    We are seeking an experienced Principal Software Engineer to lead a team of product engineers in designing, developing, and implementing AI-driven solutions at Blue Yonder and provide strategic tec...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer - Principal

    Software Engineer - Principal

    Siemens • Fremont, CA, United States
    Full-time
    Siemens EDA is a global technology leader in Electronic Design Automation software.Our software tools enable companies around the world to develop highly innovative electronic products faster and m...Show more
    Last updated: 8 days ago • Promoted
    Principal Software Engineer

    Principal Software Engineer

    Supermicro • San Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show more
    Last updated: 30+ days ago • Promoted
    Principal Software Engineer

    Principal Software Engineer

    DigiCert • Sunnyvale, California, USA
    Full-time
    Were a leading global security authority thats disrupting our own category.Our encryption is trusted by the major ecommerce brands the worlds largest companies the major cloud providers entire coun...Show more
    Last updated: 15 days ago • Promoted
    Principal AI Research Engineer — Automotive Systems

    Principal AI Research Engineer — Automotive Systems

    General Motors • Mountain View, CA, United States
    Full-time
    A leading automotive company is seeking a Principal Machine Learning Engineer to drive AI initiatives in vehicle design and manufacturing. This role requires a PhD in computer science or electrical ...Show more
    Last updated: 19 hours ago • Promoted • New!
    Principal Platform Architect, Agentic AI

    Principal Platform Architect, Agentic AI

    NVIDIA • Santa Clara, CA, United States
    Full-time
    Principal Platform Architect, Agentic AI.NVIDIA has been transforming accelerated computing with innovation that’s fueled by great technology—and amazing people. As part of Nvidia's applied AI team ...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI Engineer (Gen AI Platform Services, Agentic Systems)

    Senior AI Engineer (Gen AI Platform Services, Agentic Systems)

    Capital One • San Jose, CA, United States
    Full-time +1
    Senior AI Engineer (Gen AI Platform Services, Agentic Systems).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an indu...Show more
    Last updated: 30+ days ago • Promoted
    Principal AI Engineer

    Principal AI Engineer

    TENEX.AI • San Jose, California, United States
    Full-time
    TENEX is an AI-native, automation-first, built-for-scale Managed Detection and Response (MDR) provider.We are a force multiplier for defenders, helping organizations enhance their cybersecurity pos...Show more
    Last updated: 30+ days ago • Promoted
    Principal Software Engineer, IAM

    Principal Software Engineer, IAM

    Zscaler • San Jose, California, United States
    Full-time
    Serving thousands of enterprise customers around the world including 40% of Fortune 500 companies, Zscaler (NASDAQ : ZS) was founded in 2007 with a mission to make the cloud a safe place to do busin...Show more
    Last updated: 30+ days ago • Promoted
    Software AI Engineer

    Software AI Engineer

    Jade Global • San Jose, CA, United States
    Full-time
    Design, develop, and implement AI / ML models and algorithms using Python.Deploy and manage AI solutions on cloud platforms (e. Collaborate with data scientists and other engineers to integrate AI mod...Show more
    Last updated: 30+ days ago • Promoted
    Principal AI / ML System Software Engineer

    Principal AI / ML System Software Engineer

    d-Matrix • Santa Clara, CA, United States
    Full-time
    AI to power the transformation of technology.We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. We value humility and believe in direct communic...Show more
    Last updated: 30+ days ago • Promoted
    Principal Systems Engineer – Cloud Infra & Automation

    Principal Systems Engineer – Cloud Infra & Automation

    NVIDIA Corporation • Santa Clara, CA, United States
    Full-time
    A leading technology company is seeking a Principal Systems Software Engineer to manage and design scalable software systems for their cloud infrastructure. Candidates should have over 15 years of e...Show more
    Last updated: 3 days ago • Promoted
    Elasticsearch - Principal Software Engineer II - Vector Search

    Elasticsearch - Principal Software Engineer II - Vector Search

    Elastic • Mountain View, CA, United States
    Full-time
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...Show more
    Last updated: 30+ days ago • Promoted