Talent.com
Software Engineer, Simulator Evaluation
Software Engineer, Simulator EvaluationWaymo • San Francisco, CA, United States
Software Engineer, Simulator Evaluation

Software Engineer, Simulator Evaluation

Waymo • San Francisco, CA, United States
2 days ago
Job type
  • Full-time
Job description

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self?Driving Car Project in 2009, Waymo has focused on building the Waymo DriverThe World's Most Experienced Driverto improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymos fully autonomous ride?hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider?only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

Waymos simulator is one of the most complex virtual environments ever built. It blends deterministic logic, physical dynamics, and state?of?the?art Generative AI to create a training ground for the Waymo Driver. The Simulator Evaluation team faces the ultimate data challenge : "How do you mathematically prove that a virtual world is ""real""?"

We are looking for a Software Engineer to build the metrics and pipelines that grade this hybrid environment. You will work at the intersection of systems engineering and AI, writing the code that processes petabytes of simulation logs to answer a simple but vital question : "Did the simulator do the right thing?"

In this role, you will report to Senior Staff Software Engineering Manager and serve as a core contributor to the simulator evaluation stack.

You Will

  • Implement Evaluation Metrics and mine Datasets : You will translate mathematical concepts and product requirements into robust, efficient code (C++ / Python). You will implement metrics that measure everything from agent rule compliance (e.g., "Did it stop at the red light?") to the statistical quality of AI?generated traffic. You will use a variety of methods to mine from Waymos enormous corpse of driving logs to select the most relevant examples to evaluate the simulator on.
  • Build Scalable Pipelines : You will own key components of our data processing infrastructure. You will write and maintain the pipelines that ingest simulation logs, compute metrics at scale, and surface results to the broader engineering team.
  • Analyze & Debug : You will act as the first line of defense for simulation quality. You will dig into metric results to distinguish between genuine regressions (e.g., a code bug causing cars to stall) and evaluation noise.
  • Collaborate & Iterate : You will work closely with Tech Leads to refine our evaluation capabilities, quickly prototyping new ideas and hardening them for production use.

You Have

  • Engineering Craftsmanship :
  • 2+ years of industry experience in software development.

  • Solid proficiency in Python or C++, with experience writing clean, testable, and maintainable production code.
  • Experience with version control, code review, and debugging complex systems.
  • Data Fluency :
  • You are comfortable working with data. You know how to query a dataset (SQL / Pandas), visualize a result, and sanity?check your own metrics.

  • You have a curiosity for "why" the numbers look the way they do.
  • Adaptability :
  • You are excited to work in a hybrid environment where you might evaluate a physics engine one day and a generative model the next.

    We Prefer

  • Experience with data processing frameworks (e.g., MapReduce, Flume, Spark), data analysis libraries (Pandas, NumPy), or machine learning.
  • Background in Autonomous driving, Robotics, Simulation, or AdTech.
  • Familiarity with basic statistics or machine learning concepts.
  • Experience validating software performance or quality (e.g., building test infrastructure).
  • The expected base salary range for this full?time position across US locations is listed below. Actual starting pay will be based on job?related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

    Waymo employees are also eligible to participate in Waymos discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.

    Salary Range

    $170,000$216,000 USD

    #J-18808-Ljbffr

    Create a job alert for this search

    Software Engineer Simulator Evaluation • San Francisco, CA, United States

    Similar jobs
    Software engineer, SaaS

    Software engineer, SaaS

    Hercules • San Francisco, California, US
    Full-time
    Job Description Job Description What are we looking for? We are looking for a full-stack software engineer who specializes in SaaS. What are examples of projects you'd lead? You could build • SDK...Show more
    Last updated: 3 days ago • Promoted
    Software Engineer - GenAI Evaluations, AiDP

    Software Engineer - GenAI Evaluations, AiDP

    Apple Inc. • San Francisco, CA, United States
    Full-time
    Software Engineer - GenAI Evaluations, AiDP.San Francisco Bay Area, California, United States Corporate Functions.We are seeking a driven and analytical Software Engineer to join Apple’s Generative...Show more
    Last updated: 30+ days ago • Promoted
    Founding Software Engineer AI Infra & Evaluation (Equity)

    Founding Software Engineer AI Infra & Evaluation (Equity)

    AfterQuery • San Francisco, CA, United States
    Full-time
    A pioneering AI firm in San Francisco is seeking an entry-level engineer.In this role, you will design and build scalable systems for AI evaluation. Responsibilities include collaborating across tea...Show more
    Last updated: 10 days ago • Promoted
    Full-Stack Software Engineer

    Full-Stack Software Engineer

    Blockstream • Menlo Park, California, US
    Full-time
    Job Description Job Description Blockstream was founded in 2014 by Dr.Adam Back and a group of fellow cryptographers and engineers passionate about Bitcoin and its potential to change the future ...Show more
    Last updated: 3 days ago • Promoted
    Lead AI Safety and Enablement Engineer

    Lead AI Safety and Enablement Engineer

    Exact Sciences • Redwood City, CA, US
    Full-time +1
    At Exact Sciences, we’re helping change how the world prevents, detects and guides treatment for cancer.We give patients and clinicians the clarity needed to make confident decisions whe...Show more
    Last updated: 1 day ago • Promoted
    Senior Software Engineer

    Senior Software Engineer

    GoodLeap • San Mateo County, California, US
    Full-time
    Job Description Job Description About GoodLeap : GoodLeap is a technology company delivering best-in-class financing and software products for sustainable solutions, from solar panels and batterie...Show more
    Last updated: 3 days ago • Promoted
    Software Engineer

    Software Engineer

    Equation Staffing • Menlo Park, California, US
    Full-time
    Job Description Job Description Learn to Win Senior Software Engineer Learn to Win (L2W) is actively seeking senior software engineers to support our infrastructure, backend, and frontend systems...Show more
    Last updated: 3 days ago • Promoted
    Software Engineer, Platforms

    Software Engineer, Platforms

    WisdomAI • San Mateo County, California, US
    Full-time
    Job Description Job Description About Wisdom WisdomAI has the mission to provide access and insights from data to everyone. We believe in the power of data to drive better decisions and we believe...Show more
    Last updated: 3 days ago • Promoted
    Applications Engineer I

    Applications Engineer I

    16500 Sixteen Five Hundred • Emeryville, California, US
    Temporary
    Job Description Job Description Job Description : Entry Level Lighting Controls Application Engineer I.You will gain exciting real-world experience and understanding of architectural and electrica...Show more
    Last updated: 3 days ago • Promoted
    Senior Engineer, AI Evaluation & Reliability (Agentic AI)

    Senior Engineer, AI Evaluation & Reliability (Agentic AI)

    Anomali • Redwood City, CA, US
    Full-time
    Anomali is headquartered in Silicon Valley and is the Leading AI-Powered Security Operations Platform that is modernizing security operations. At the center of it is an omnipresent, intelligent, and...Show more
    Last updated: 30+ days ago • Promoted
    Principal Software Engineer

    Principal Software Engineer

    RapidAI • San Mateo County, California, US
    Full-time
    Job Description Job Description RapidAI is the trusted leader in deep clinical AI, helping hospitals deliver faster, more informed care through intelligent imaging and integrated workflows.The Ra...Show more
    Last updated: 3 days ago • Promoted
    Senior Software Engineer, Front End, eCommerce

    Senior Software Engineer, Front End, eCommerce

    Elever Professional, LP • Menlo Park, California, US
    Full-time
    Job Description Job Description Elever Professional has partnered with a global leader in consumer Financial Technology to recruit a Web Development leader to join an engineering team and lead Fr...Show more
    Last updated: 3 days ago • Promoted
    Geophysical Software Engineer (5300C) - Berkeley Seismological Lab

    Geophysical Software Engineer (5300C) - Berkeley Seismological Lab

    InsideHigherEd • Berkeley, California, United States
    Full-time
    Geophysical Software Engineer (5300C) - Berkeley Seismological Lab.At the University of California, Berkeley, we are dedicated to fostering a community where everyone feels welcome and can thrive.O...Show more
    Last updated: 9 days ago • Promoted
    Principal Software Engineer

    Principal Software Engineer

    Informatica LLC • Redwood City, CA, United States
    Full-time
    Principal Software Engineer in Redwood City, CA.Informatica is seeking an experienced Principal Software Engineer to design, develop, and evolve our core Connectivity ecosystem including APIs, conn...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Post-Trade Financial Systems

    Senior Software Engineer, Post-Trade Financial Systems

    The Voleon Group • Berkeley, California, US
    Full-time
    Job Description Job Description Voleon is a technology company that applies state-of-the-art AI and machine learning techniques to real-world problems in finance. For nearly two decades, we have l...Show more
    Last updated: 3 days ago • Promoted
    Forward Deployed Engineer

    Forward Deployed Engineer

    Sendbird • San Mateo County, California, US
    Full-time
    Job Description Job Description Sendbird is on a mission to build the AI workforce of tomorrow.Sendbird is the omnichannel AI agent platform enterprises choose to elevate the customer experience ...Show more
    Last updated: 3 days ago • Promoted
    2026 Summer Project Engineer - San Francisco Bay Area

    2026 Summer Project Engineer - San Francisco Bay Area

    Silverado Contractors • Emeryville, California, US
    Full-time
    Job Description Job Description Join Silverado Contractors as a 2026 Summer Project Engineer and take your first step into the exciting world of construction engineering! This opportunity will al...Show more
    Last updated: 3 days ago • Promoted
    Full Stack AI Software Engineer

    Full Stack AI Software Engineer

    Freshworks • San Mateo County, California, US
    Full-time
    Job Description Job Description Company Description Organizations everywhere struggle under the crushing costs and complexities of "solutions" that promise to simplify their lives.To create a bet...Show more
    Last updated: 3 days ago • Promoted