Talent.com
Senior Software Engineer, ML Evaluation (Infrastructure)
Senior Software Engineer, ML Evaluation (Infrastructure)Waymo • Mountain View, CA, United States
Senior Software Engineer, ML Evaluation (Infrastructure)

Senior Software Engineer, ML Evaluation (Infrastructure)

Waymo • Mountain View, CA, United States
10 hours ago
Job type
  • Full-time
Job description

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The World's Most Experienced Driver™-to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo's fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

The Predictive Planning team (PrePlan) develops and deploys state-of-the-art machine learning solutions that predict the future state of the world and plan the Waymo Driver's behavior. Our mission is to transform Waymo's unprecedented scale of driving data into robust, generalizable, and performant deep neural networks. These models enable the autonomous vehicle to navigate complex environments safely and efficiently.

The team's work touches on all of the most exciting aspects of machine learning, including but not limited to Large Language Models (LLMs), Reinforcement Learnings (RL), and Vision understanding. In this role, you will ensure that our systems remain reliable in the face of this rapid, experiment-driven development.

In this hybrid role, you will report to a Technical Lead Manager.

You will :

  • Collaborate with Machine Learning Engineers, Data Scientists, and ML Infrastructure Engineers to surface signals on model, component, and system performance
  • Develop, scale, and maintain CI / CD pipelines for automating metric computation, aggregation, and monitoring
  • Build data management tooling to improve reproducibility and scale analyses automatically as Waymo drives more miles
  • Collaborate with ML and product teams to define evaluation criteria and translate those into metrics and targets
  • Stay current with emerging technologies and trends in ML evaluation and metrics design.
  • Be aware of best practices used in the Alphabet stack of ML technologies (e.g. TF, JAX, Flax, Beam etc).

You have :

  • B.S. or higher in Computer Science, Math, or equivalent real-world experience
  • 4+ years building and maintaining high-scale distributed or ML inference systems
  • Coding and testing skills, specifically Python / C++
  • Familiarity with large-scale fleet management, testing, and deployment, e.g. : GCP / AWS / Kubernetes, Jenkins, GCS / S3, etc.
  • Familiarity with large-scale ML tools, e.g. : tf.serving / Torchserve, Kubeflow / Sagemaker Pipelines / Vertex AI Pipelines, etc.
  • Understanding of Machine Learning fundamentals and experience with popular ML frameworks such as JAX, PyTorch, or TensorFlow.
  • We prefer :

  • Experience developing and maintaining evaluation pipelines for ML models
  • Experience deploying and supporting machine learning models for computer vision, natural language processing, robotics / motion planning, or recommendation systems.
  • Experience supporting a large team of MLEs developing high-capacity, production-grade models and components
  • Strong understanding of metrics computation and regression detection at scale
  • The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

    Waymo employees are also eligible to participate in Waymo's discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.

    Salary Range

    $204,000-$259,000 USD

    Create a job alert for this search

    Senior Software Engineer Infrastructure • Mountain View, CA, United States

    Related jobs
    Senior Software Engineer, Model Evaluation - Simulation

    Senior Software Engineer, Model Evaluation - Simulation

    Waymo • Mountain View, CA, United States
    Full-time
    Waymo is an autonomous driving technology company with the mission to be the most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Wa...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, Quantitative Evaluations

    Senior Software Engineer, Quantitative Evaluations

    Waymo • Mountain View, CA, United States
    Full-time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...Show more
    Last updated: 11 hours ago • Promoted • New!
    Senior Software Engineer, ML Infra

    Senior Software Engineer, ML Infra

    Ambient • Redwood City, CA, United States
    Full-time
    AI-powered physical security platform helping the world's leading enterprises reduce risk, improve operational efficiency, and gain critical insights. Fortune 500 organizations, rely on Ambient.Our ...Show more
    Last updated: 22 hours ago • Promoted • New!
    Senior ML Engineer

    Senior ML Engineer

    Typeface • Palo Alto, California, United States
    Full-time
    Typeface is on a mission to help everyone express their unique imagination.We believe technology is a creative partner that empowers any company to tell their unique stories faster and easier than ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Infrastructure, Machine Learning

    Senior Software Engineer - Infrastructure, Machine Learning

    Baton • San Francisco, California, United States
    Full-time
    With $10B in freight under management, our technology reaches every part of the U.We design and ship category-defining software that enables Ryder and its 50,000+ customers—including some of the wo...Show more
    Last updated: 30+ days ago • Promoted
    AI / ML - Senior OS Software Engineer, Evaluation

    AI / ML - Senior OS Software Engineer, Evaluation

    Apple • Cupertino, CA, United States
    Full-time
    We are looking for an experienced software engineer to build Experimentation platforms to empower Apple engineers in delivering great user experiences. We are addressing key challenges to accelerate...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer, ML Infrastructure, PrePlan

    Senior Software Engineer, ML Infrastructure, PrePlan

    Waymo • Mountain View, CA, United States
    Full-time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...Show more
    Last updated: 10 hours ago • Promoted • New!
    Senior / Staff Software Engineer, Machine Learning Infrastructure

    Senior / Staff Software Engineer, Machine Learning Infrastructure

    Nuro • Mountain View, California, United States
    Full-time
    Nuro is a self-driving technology company on a mission to make autonomy accessible to all.Founded in 2016, Nuro is building the world’s most scalable driver, combining cutting-edge AI with automoti...Show more
    Last updated: 4 days ago • Promoted
    Software Engineer, ML

    Software Engineer, ML

    Heartflow • San Francisco, California, United States
    Full-time
    Heartflow is a medical technology company advancing the diagnosis and management of coronary artery disease, the #1 cause of death worldwide, using cutting-edge technology.The flagship product—an A...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer - ML Performance

    Software Engineer - ML Performance

    Baseten • San Ramon, California, United States
    Full-time
    We’re a growing team of builders backed by top-tier investors, including.ML teams at enterprises and category-defining AI-native companies like. Baseten to power their core production workloads with...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - ML Infrastructure

    Senior Software Engineer - ML Infrastructure

    Applied Intuition • Sunnyvale, CA, United States
    Full-time
    Applied Intuition is the vehicle intelligence company that accelerates the global adoption of safe, AI-driven machines.Founded in 2017 and now valued at $15 billion following its recent Series F fu...Show more
    Last updated: 10 hours ago • Promoted • New!
    ML Infrastructure Engineer

    ML Infrastructure Engineer

    Openai • San Francisco, California, United States
    Full-time
    The Runtime team builds the low level framework components to power our ML training systems.We work on building robust, scalable, high performance components to support our distributed training wor...Show more
    Last updated: 30+ days ago • Promoted
    Senior Software Engineer - Machine Learning Platform

    Senior Software Engineer - Machine Learning Platform

    Snowflake • Menlo Park, California, United States
    Full-time
    The Snowflake Machine Learning Platform team’s mission is to enable customers to bring their machine learning and deep learning workloads to Snowflake. Our customers want to build powerful models wi...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer - ML Infrastructure

    Software Engineer - ML Infrastructure

    Specter • San Francisco, California, United States
    Full-time
    Specter is creating a software-defined "control plane" for the physical world.We are starting with protecting American businesses by granting them ubiquitous perception over their physical assets.T...Show more
    Last updated: 2 days ago • Promoted
    Software Engineer, Machine Learning Infrastructure

    Software Engineer, Machine Learning Infrastructure

    Datologyai • Redwood City, California, United States
    Full-time
    Companies want to train their own large models on their own data.The current industry standard is to train on a random sample of your data, which is inefficient at best and actively harmful to mode...Show more
    Last updated: 30+ days ago • Promoted
    AI / ML System Software Engineer, Senior Staff

    AI / ML System Software Engineer, Senior Staff

    D-matrix • Santa Clara, California, United States
    Full-time
    AI to power the transformation of technology.We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. We value humility and believe in direct communic...Show more
    Last updated: 30+ days ago • Promoted
    ML Infrastructure Engineer, Safeguards

    ML Infrastructure Engineer, Safeguards

    Anthropic • San Francisco, California, United States
    Full-time
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...Show more
    Last updated: 30+ days ago • Promoted
    Staff ML Engineer - Infrastructure

    Staff ML Engineer - Infrastructure

    ChipStack • San Jose, California, United States
    Full-time
    Chips are at the center of today's tech-driven world.But how we design them has not changed in decades, while their complexity and specialization have skyrocketed due to increasing performance dema...Show more
    Last updated: 30+ days ago • Promoted