Talent.com
Principal Software Engineer - AI Systems
Principal Software Engineer - AI SystemsODAIA • Sunnyvale, CA, United States
Principal Software Engineer - AI Systems

Principal Software Engineer - AI Systems

ODAIA • Sunnyvale, CA, United States
3 days ago
Job type
  • Full-time
Job description

Position Summary...

What you’ll do... What you’ll do

1. AI Systems Engineering

  • Design and implement large-scale, production-grade AI systems that integrate LLMs and Generative AI into real-world applications.
  • Build frameworks that support Retrieval-Augmented Generation (RAG), agentic workflows, and multi-step reasoning at scale.
  • Ensure models and agents are production-ready with strong observability, monitoring, and performance optimization.

2. Architecture & Scalability

  • Architect distributed, fault-tolerant systems capable of supporting high-throughput AI workloads.
  • Lead the design of modular, extensible, and reusable components to accelerate AI adoption across teams.
  • Build MVPs quickly, validate assumptions, and iterate toward scalable long-term solutions.
  • 3. Integration & Delivery

  • Partner with product and platform teams to integrate AI into customer-facing and enterprise-grade applications.
  • Define and enforce standards for APIs, services, and infrastructure that enable seamless AI adoption.
  • Balance functional requirements with non-functional goals such as reliability, latency, and security.
  • 4. Leadership & Mentorship

  • Drive technical strategy for AI initiatives and guide teams in best practices for AI‑driven software development.
  • Mentor engineers across software and AI domains to elevate overall technical expertise.
  • Contribute to thought leadership in AI engineering through internal frameworks, design patterns, and reusable components.
  • What you’ll bring

  • 12+ years of experience in software engineering (backend, distributed systems, large‑scale platforms), with 2+ years applying Generative AI / LLMs in production.
  • Proven expertise in distributed computing, cloud-native architectures (GCP, Azure, or AWS), and systems that prioritize scalability and fault tolerance.
  • Strong coding skills in Python (preferred) and at least one system‑level language (Java, Go, or C++).
  • Experience with ML / AI frameworks (PyTorch, TensorFlow, Hugging Face) as a plus, but applied in the context of building systems, not just training models.
  • Deep knowledge of RAG pipelines, vector databases, and real‑time data integration.
  • Familiarity with resilience engineering : disaster recovery, failover, monitoring, and high availability.
  • Exposure to multi‑modal AI (text, image, video) and optimization techniques (quantization, distillation) is advantageous.
  • Strong grounding in system design, performance engineering, and design patterns.
  • Track record of delivering production systems with AI at scale, not just research or prototyping.
  • Key Positioning Shift

  • Moved model training / fine‑tuning to secondary importance → framed as a plus, not the core.
  • Emphasized distributed systems, cloud, APIs, reliability, and software engineering fundamentals.
  • Framed role as “AI Systems Engineer” / “AI Engineer” instead of “ML Engineer.”
  • Highlighted production integration and customer‑facing impact, which appeals to senior software engineers.
  • Equal Opportunity Employer

    Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers, and the communities we serve live better when we really know them. That means understanding, respecting, and valuing unique styles, experiences, identities, ideas, and opinions – while being inclusive of all people.

    At Walmart, we offer competitive pay as well as performance‑based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company‑paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short‑term and long‑term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.

    You will also receive PTO and / or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable.

    For information about PTO, see https : / / one.walmart.com / notices.

    Live Better U is a Walmart‑paid education benefit program for full‑time and part‑time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short‑form certificates. Tuition, books, and fees are completely paid for by Walmart.

    Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms.

    For information about benefits and eligibility, see One.Walmart.

    The annual salary range for this position is $143,000.00-$286,000.00

    Additional compensation includes annual or quarterly performance bonuses.

    Additional compensation for certain positions may also include :

  • Stock
  • Minimum Qualifications

  • Option 1 : Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 5 years’ experience in software engineering or related area.
  • Option 2 : 7 years’ experience in software engineering or related area.
  • Preferred Qualifications

  • Master’s degree in computer science, computer engineering, computer information systems, software engineering, or related area and 3 years' experience in software engineering or related area. We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart’s accessibility standards and guidelines for supporting an inclusive culture.
  • Primary Location

    1395 Crossman Ave, Sunnyvale, CA 94089-1114, United States of America

    Walmart and its subsidiaries are committed to maintaining a drug‑free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment.

    #J-18808-Ljbffr

    Create a job alert for this search

    Principal Engineer Ai • Sunnyvale, CA, United States

    Related jobs
    Principal Software Engineer – AI Systems

    Principal Software Engineer – AI Systems

    Walmart Canada • Sunnyvale, CA, United States
    Full-time
    Balance functional requirements with non-functional goals such as reliability, latency, and security.Generative AI / LLMs • • in production. Strong coding skills in • •Python (preferred) • • and at least o...Show more
    Last updated: 30+ days ago • Promoted
    Principal AI Engineer (San Jose, CA)

    Principal AI Engineer (San Jose, CA)

    Tenex.AI Inc • San Jose, CA, United States
    Full-time
    TENEX is an AI-native, automation-first, built-for-scale Managed Detection and Response (MDR) provider.We are a force multiplier for defenders, helping organizations enhance their cybersecurity pos...Show more
    Last updated: 3 days ago • Promoted
    AI First Software Engineer - Senior Manager

    AI First Software Engineer - Senior Manager

    PwC • San Jose, CA, United States
    Full-time
    At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients.These individuals comb...Show more
    Last updated: 3 days ago • Promoted
    Principal Software Engineer ( Sr Architect )

    Principal Software Engineer ( Sr Architect )

    Blue Yonder • Palo Alto, CA, United States
    Full-time
    We are seeking an experienced Principal Software Engineer to lead a team of product engineers in designing, developing, and implementing AI-driven solutions at Blue Yonder and provide strategic tec...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer - Principal

    Software Engineer - Principal

    Siemens • Fremont, CA, United States
    Full-time
    Siemens EDA is a global technology leader in Electronic Design Automation software.Our software tools enable companies around the world to develop highly innovative electronic products faster and m...Show more
    Last updated: 7 days ago • Promoted
    Principal Software Engineer

    Principal Software Engineer

    Supermicro • San Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show more
    Last updated: 30+ days ago • Promoted
    Principal Software Engineer

    Principal Software Engineer

    Cisco Systems, Inc. • San Jose, CA, United States
    Full-time
    The application window has been extended to 11 / 30 / 2025.Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received.Strong preference for Bay ...Show more
    Last updated: 9 days ago • Promoted
    Senior AI Engineer (Gen AI Platform Services, Agentic Systems)

    Senior AI Engineer (Gen AI Platform Services, Agentic Systems)

    Capital One • San Jose, CA, United States
    Full-time +1
    Senior AI Engineer (Gen AI Platform Services, Agentic Systems).At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an indu...Show more
    Last updated: 30+ days ago • Promoted
    Principal Platform Architect, Agentic AI

    Principal Platform Architect, Agentic AI

    NVIDIA • Santa Clara, CA, United States
    Full-time
    Principal Platform Architect, Agentic AI.NVIDIA has been transforming accelerated computing with innovation that’s fueled by great technology—and amazing people. As part of Nvidia's applied AI team ...Show more
    Last updated: 30+ days ago • Promoted
    Principal Ai Architect

    Principal Ai Architect

    Intapp • Palo Alto, CA, United States
    Full-time
    Intapp’s Intelligent Cloud platform.This executive-level, hands-on role is critical to ensuring our technology ecosystem is scalable, integrated, and AI-enabled. You’ll collaborate across engineerin...Show more
    Last updated: 10 days ago • Promoted
    Principal Software Architect - Federated AI

    Principal Software Architect - Federated AI

    Nvidia Corporation • Santa Clara, CA, United States
    Full-time
    NVIDIA is now looking for a Principal Software Architect in our federated AI group.The quality of AI models developed is only as good as the data it was trained on, and hence large datasets are nec...Show more
    Last updated: 19 days ago • Promoted
    Principal AI Architect

    Principal AI Architect

    Intapp, Inc. • Palo Alto, CA, United States
    Full-time
    Principal AI Architect • • • •Location : • • Palo Alto, CA • •About the Role • •As the • •Principal AI Architect • •, you will define and lead the technical vision, architecture, and strategy for Intapp’s Intell...Show more
    Last updated: 8 days ago • Promoted
    Software Engineer - Analytics & AI

    Software Engineer - Analytics & AI

    CXApp, Inc • San Ramon, CA, United States
    Full-time
    CXAPP is a forward-thinking technology company that leverages AI and data science to drive innovation and deliver cutting-edge solutions. At CXApp, we are the innovators of Indoor Intelligence, deli...Show more
    Last updated: 30+ days ago • Promoted
    Software AI Engineer

    Software AI Engineer

    Jade Global • San Jose, CA, United States
    Full-time
    Design, develop, and implement AI / ML models and algorithms using Python.Deploy and manage AI solutions on cloud platforms (e. Collaborate with data scientists and other engineers to integrate AI mod...Show more
    Last updated: 30+ days ago • Promoted
    Principal AI / ML System Software Engineer

    Principal AI / ML System Software Engineer

    d-Matrix • Santa Clara, CA, United States
    Full-time
    AI to power the transformation of technology.We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. We value humility and believe in direct communic...Show more
    Last updated: 30+ days ago • Promoted
    Principal Systems Engineer – Cloud Infra & Automation

    Principal Systems Engineer – Cloud Infra & Automation

    NVIDIA Corporation • Santa Clara, CA, United States
    Full-time
    A leading technology company is seeking a Principal Systems Software Engineer to manage and design scalable software systems for their cloud infrastructure. Candidates should have over 15 years of e...Show more
    Last updated: 2 days ago • Promoted
    Elasticsearch - Principal Software Engineer II - Vector Search

    Elasticsearch - Principal Software Engineer II - Vector Search

    Elastic • Mountain View, CA, United States
    Full-time
    Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale - unleashing the potential of businesses and people.The Elastic Search AI...Show more
    Last updated: 30+ days ago • Promoted
    Principal Software Engineer

    Principal Software Engineer

    Fortinet • Santa Clara, CA, United States
    Full-time
    Design and implement platform-level systems.Build scalable, highly available, and cost-efficient services that support.Collaborate with Product and Engineering stakeholders to define functional spe...Show more
    Last updated: 30+ days ago • Promoted