Talent.com
Director of Engineering, Simulation Evaluation

Director of Engineering, Simulation Evaluation

WaymoSan Francisco, CA, United States
30+ days ago
Job type
  • Full-time
Job description

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The World's Most Experienced Driver-to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo's fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

We are seeking an experienced Director, Simulation Evaluation to lead our efforts in rigorously assessing the safety, compliance, and service quality of the Waymo Driver. This critical role will be instrumental in scaling our autonomous vehicle technology by developing and overseeing the advanced quantitative methodologies and infrastructure required to evaluate performance in new cities, novel situations, and address issues identified in the field.

You will lead a team of highly skilled quantitative evaluation engineers and data scientists focused on developing innovative workflows and tools that accelerate the evaluation of the Waymo Driver. Your leadership will be pivotal in ensuring the robustness and scalability of our evaluation processes as we expand our operations.

You will :

  • Define and Drive Strategy : Develop and execute the strategic roadmap for quantitative evaluation, aligning it with Waymo's business objectives and product development lifecycle. Drive the technical strategy for how we measure the Waymo driver's behavior in all situations, from interactions with pedestrians, to navigating construction zones.
  • Lead and Mentor a High-Performing Team : Recruit, build, and lead a team of quantitative evaluation specialists, fostering a culture of technical excellence, innovation, and continuous improvement. This includes guiding individual contributors who are focused on :
  • Creating metrics and evaluations for the areas that matter most to Waymo.
  • Developing ML-based tooling for data mining, identification, sampling, and optimization of evaluation workflows using simulations of logged and synthetically generated driving scenarios.
  • Improving product requirements for "eval of eval" tools and measurements to understand and control the quality of Waymo's driving evaluation tools.
  • Translating product requirements into engineering and data science tasks, and implementing these tasks.
  • Critically examining and improving the data and statistical methods used to evaluate our tools.
  • Extending and improving underlying infrastructure to meet product needs and ensure consistency across the stack.
  • Working with partners to integrate evaluation tools into workflows and processes.
  • Champion Quantitative Rigor : Oversee the design, development, and implementation of sophisticated quantitative methods and statistical models for evaluating the Waymo Driver's performance across diverse operational domains.
  • Innovate Evaluation Workflows : Drive the creation of scalable and efficient workflows for evaluating safety, compliance, and service quality, crucial for expanding into new operational design domains (ODDs) and addressing emergent challenges.
  • Collaborate Cross-Functionally : Partner closely with onboard engineering, system engineering, and commercial teams, product management, operations, and legal teams to integrate evaluation insights into product development cycles and inform strategic decision-making.
  • Ensure Data Integrity and Infrastructure : Guide the development and maintenance of robust data processing pipelines and underlying infrastructure to support large-scale quantitative evaluation, ensuring data quality and consistency.
  • Communicate Insights : Clearly communicate complex quantitative findings and recommendations to diverse stakeholders, including senior leadership, to drive product improvements and business outcomes.

You have :

  • 10+ years of industry experience in quantitative analysis, data science, or a related field, with a significant portion in a leadership or management role.
  • 5+ years of experience managing and growing high-performing quantitative or data science teams, including managing managers, within a complex engineering environment.
  • Masters in Machine Learning, Statistics, Mathematics, Physics, Robotics, a related quantitative field, or equivalent practical experience.
  • Deep expertise in statistical modeling, experimental design, and quantitative methods, with a proven track record of applying these to real-world problems delivered into production.
  • Proficiency in programming languages such as C++ and / or Python, with experience building scalable data and evaluation tools.
  • Proven ability to translate complex technical requirements into actionable engineering and data science tasks.
  • Experience developing evaluation tools, metrics, statistical algorithms, and related data infrastructure is highly preferred.
  • Experience iterating on product vision with Product Managers and leadership.
  • Excellent communication, interpersonal, and leadership skills, with the ability to influence and inspire at all levels.
  • We prefer :

  • PhD in one of the quantitative fields listed above.
  • Strong understanding of machine learning principles and their application in data mining, sampling, and optimization.
  • Experience with evaluation of autonomous vehicle systems.
  • Deep expertise in architecting solutions that efficiently utilize massive-scale infrastructure to achieve high-performance and scalability.
  • #LI-Hybrid

    The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process.

    Waymo employees are also eligible to participate in Waymo's discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.

    Salary Range

    $332,000 — $421,000 USD

    Create a job alert for this search

    Director Of Engineering • San Francisco, CA, United States

    Related jobs
    • Promoted
    Director of Engineering, Simulation Evaluation

    Director of Engineering, Simulation Evaluation

    WaymoMountain View, CA, United States
    Full-time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...Show moreLast updated: 30+ days ago
    • Promoted
    Director of Engineering

    Director of Engineering

    HarnhamSan Francisco, CA, United States
    Full-time
    Director of Engineering – Lead Innovation in Healthcare Technology.Are you passionate about building cutting-edge software solutions that make a real impact on healthcare? This is a unique opportun...Show moreLast updated: 30+ days ago
    • Promoted
    Director of Engineering

    Director of Engineering

    AllTrailsSan Francisco, CA, United States
    Full-time
    AllTrails is the world’s most popular and trusted platform for outdoor exploration.We connect people to the outdoors, help them discover new places, and elevate their experiences on the trail.With ...Show moreLast updated: 30+ days ago
    • Promoted
    Director Of Engineering

    Director Of Engineering

    KognitosSan Jose, CA, US
    Full-time
    Kognitos is at the forefront of revolutionizing the trillion-dollar hyper-automation market.Our mission is to redefine how software is built and maintained by leveraging cutting-edge multi-agent au...Show moreLast updated: 30+ days ago
    • Promoted
    Director of Engineering

    Director of Engineering

    January AIMenlo Park, CA, United States
    Full-time
    Get AI-powered advice on this job and more exclusive features.This range is provided by January AI.Your actual pay will be based on your skills and experience — talk with your recruiter to learn mo...Show moreLast updated: 26 days ago
    • Promoted
    Sr. Director of Solutions Engineering

    Sr. Director of Solutions Engineering

    CrusoeSan Francisco, CA, United States
    Full-time
    Crusoe is seeking a Senior Director of Solutions Engineering to lead and scale our global team.This leadership role sits at the intersection of Sales, Product, and Engineering, driving customer suc...Show moreLast updated: 8 days ago
    • Promoted
    Director of Engineering

    Director of Engineering

    Lilt, Inc.San Francisco, CA, United States
    Full-time
    AI is changing how the world communicates — and LILT is leading that transformation.AI, machine translation, and human-in-the-loop. At LILT, we empower our teammates with leading tools, global colla...Show moreLast updated: 1 day ago
    • Promoted
    Director of Engineering, Strategy Applications

    Director of Engineering, Strategy Applications

    The Voleon GroupBerkeley, CA, US
    Full-time
    Director Of Engineering, Strategy Applications.Voleon is a technology company that applies state-of-the-art AI and machine learning techniques to real-world problems in finance.For more than a deca...Show moreLast updated: 30+ days ago
    • Promoted
    Director of Engineering - Platform

    Director of Engineering - Platform

    RipplingSan Francisco, CA, United States
    Full-time
    Rippling gives businesses one place to run HR, IT, and Finance.It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and co...Show moreLast updated: 1 day ago
    • Promoted
    Director of Engineering

    Director of Engineering

    JanuaryMenlo Park, CA, US
    Full-time
    January AI is the first "precision health" company that combines continuous glucose monitoring along with heart rate, sleep, activity and food tracking, to enable you to see the impact of your diet...Show moreLast updated: 30+ days ago
    • Promoted
    Director, Solution Engineering

    Director, Solution Engineering

    SupermicroSan Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show moreLast updated: 30+ days ago
    • Promoted
    Engineering Director, Adoption

    Engineering Director, Adoption

    Cloudflare, Inc.San Francisco, CA, United States
    Full-time
    At Cloudflare, we are on a mission to help build a better Internet.Today the company runs one of the world's largest networks that powers millions of websites and other Internet properties for cust...Show moreLast updated: 12 days ago
    • Promoted
    Director of Engineering

    Director of Engineering

    Optiwatt, Inc.San Francisco, CA, United States
    Full-time
    As our first VP of Engineering, you will be instrumental in scaling our R&D organization, enhancing our engineering practices, and directly contributing to Optiwatt's rapid growth.You will lead and...Show moreLast updated: 29 days ago
    • Promoted
    Director of Engineering

    Director of Engineering

    VantacaRedwood City, CA, United States
    Full-time
    HOAi is a fast-growing startup revolutionizing the community association management industry.Our AI workforce platform integrates machine learning technology to streamline labor-heavy processes, el...Show moreLast updated: 3 days ago
    • Promoted
    Sr. Director of Application Design & Customer Engineering

    Sr. Director of Application Design & Customer Engineering

    JobotSanta Clara, CA, US
    Full-time
    Global Leader in Precision Timing Semiconductor Solutions | Semiconductor Experience Required (Applications, Design, or Customer Engineering) | Driving Innovation Across AI, Datacenter & Commun...Show moreLast updated: 4 days ago
    • Promoted
    Director of Engineering, Mapping

    Director of Engineering, Mapping

    Socotra, Inc.San Francisco, CA, United States
    Full-time
    At Lyft, our purpose is to serve and connect.We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. About 4 years ago, Lyft began ...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Director Engineering

    Sr. Director Engineering

    UniphoreStanford, CA, US
    Full-time
    Senior Director Of Engineering.Uniphore is one of the largest B2B AI-native companiesdecades-proven, built-for-scale and designed for the enterprise. The company drives business outcomes, across mul...Show moreLast updated: 30+ days ago
    • Promoted
    Director of Engineering

    Director of Engineering

    HiveSan Francisco, CA, United States
    Full-time
    Hive is the leading provider of cloud-based AI solutions to understand, search, and generate content, and is trusted by hundreds of the world's largest and most innovative organizations.The company...Show moreLast updated: 30+ days ago
    • Promoted
    Director, TPM (System Engineering)

    Director, TPM (System Engineering)

    PsiQuantumMilpitas, CA, United States
    Full-time
    Quantum computing holds the promise of humanity's mastery over the natural world, but only if we can build a.PsiQuantum is on a mission to build the first real, useful quantum computers, capable of...Show moreLast updated: 30+ days ago
    • Promoted
    Director of Engineering

    Director of Engineering

    WatlowSan Jose, CA, United States
    Full-time
    We are making a positive impact every day as our solutions enrich the lives of people everywhere.We have been providing breakthrough thermal solutions for nearly a century.Our corporate values guid...Show moreLast updated: 30+ days ago