Talent.com
Senior / Staff Machine Learning Engineer - Perception Offline Driving Intelligence

Senior / Staff Machine Learning Engineer - Perception Offline Driving Intelligence

ZooxFoster City, CA, United States
30+ days ago
Job type
  • Full-time
Job description

The Offline Driving Intelligence (ODIN) team at Zoox is leveraging the latest in AI to craft algorithms that understand the world. We leverage large models first offline and we devise a path of impact into our self-driving robot, enabling safe and efficient navigation in complex environments.

As an engineer in the ODIN team, you will develop advanced multimodal large language models that enhance environmental understanding. You'll develop and fine-tune these models for off-vehicle analysis while working with the onboard team to deliver impact in our robotaxi platform, ensuring they can efficiently identify hazards and interpret driving restrictions with minimal latency. Working alongside world-class engineers and researchers, you'll leverage premium sensor data and cutting-edge infrastructure to validate your algorithms in real-world conditions, directly impacting productivity, safety and the capability of Zoox's autonomous system.

In this role, you will :

  • Lead the development of multimodal large language models that enhance our robotaxis' understanding of complex urban environments
  • Design effective model architectures and sophisticated training techniques, leveraging all the inputs from our sensor stack and the overall large scale data we have at Zoox.
  • Drive end-to-end ML solutions from research to production, utilizing Zoox's extensive data pipelines and infrastructure to improve autonomous driving capabilities
  • Collaborate with perception, planning, safety, and systems teams to integrate your models into the vehicle's decision-making pipeline
  • Validate and optimize your solutions using real-world driving scenarios, directly contributing to the safety and reliability of Zoox's autonomous system

Qualifications :

  • MS or PhD in Computer Science, Machine Learning, or related technical field
  • Demonstrated experience training and deploying large language models (LLMs)
  • Experience building and maintaining ML training pipelines, including data preprocessing, model training, and evaluation
  • Proficiency in Python and ML libraries (PyTorch, NumPy) demonstrated through professional or research projects
  • Experience training with large scale datasets (e.g. tens of millions of videos)
  • Bonus Qualifications :

  • Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)
  • Experience with autonomous robotics systems
  • $242,000 - $333,000 a year

    We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

    Create a job alert for this search

    Machine Learning Engineer • Foster City, CA, United States

    Related jobs
    • Promoted
    Senior / Staff Machine Learning Engineer, Perception

    Senior / Staff Machine Learning Engineer, Perception

    algojobsSan Francisco, CA, United States
    Full-time
    At Agtonomy, we’re not just building tech—we’re transforming how vital industries get work done.Our Physical AI and fleet services turn heavy machinery into intelligent, autonomous systems that tac...Show moreLast updated: 5 days ago
    • Promoted
    Senior Artificial Intelligence / Machine Learning Engineer

    Senior Artificial Intelligence / Machine Learning Engineer

    BMO Financial GroupSan Francisco, CA, United States
    Part-time
    This is a Hybrid role (2 days / week in office).We are seeking a highly analytical and technically proficient Senior ML / AI Engineer to join our ARC team. This role is ideal for someone with a strong f...Show moreLast updated: 23 hours ago
    • Promoted
    Senior Machine Learning Engineer, ML Platform

    Senior Machine Learning Engineer, ML Platform

    Block IncSan Francisco, CA, United States
    Full-time
    Block uses Machine Learning and AI across many of its products and domains.For ML practitioners Block-wide, the ML Inference & Training team provides critical infrastructure, platforms, and librari...Show moreLast updated: 1 day ago
    • Promoted
    Machine Learning Engineer - Perception Offline Driving Intelligence

    Machine Learning Engineer - Perception Offline Driving Intelligence

    ZooxSan Mateo, CA, United States
    Full-time
    Machine Learning Engineer - Perception Offline Driving Intelligence.The Offline Driving Intelligence (ODIN) team at Zoox is leveraging the latest in AI to craft algorithms that understand the world...Show moreLast updated: 1 day ago
    • Promoted
    Senior Machine Learning Engineer, Rider Experience

    Senior Machine Learning Engineer, Rider Experience

    UberSan Francisco, CA, United States
    Full-time
    Rider Experience drives and enables the critical trip booking funnel within the Rides app that makes up almost all of the trip transactions and contributes tremendously to business growth.We active...Show moreLast updated: 30+ days ago
    • Promoted
    Senior / Staff Applied Machine Learning Engineer

    Senior / Staff Applied Machine Learning Engineer

    ComfyUISan Francisco, CA, United States
    Full-time
    We're looking for someone who loves optimizing model inference to join us in building the core of ComfyUI - the most complex and bleeding-edge part of our engine. You'll be working on making AI mode...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Machine Learning Engineer, AI Authoring

    Senior Machine Learning Engineer, AI Authoring

    Unity TechnologiesSan Francisco, CA, United States
    Full-time
    Senior Machine Learning Engineer, AI Authoring.At Unity, we're shaping the future of real-time 3D development by enabling creators to harness intelligent, autonomous systems.Our next-generation age...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Machine Learning Engineer, LLM / VLM Visual Reasoning

    Senior Machine Learning Engineer, LLM / VLM Visual Reasoning

    WaymoSan Francisco, CA, United States
    Full-time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...Show moreLast updated: 23 hours ago
    • Promoted
    Senior / Staff Machine Learning Engineer, Perception

    Senior / Staff Machine Learning Engineer, Perception

    AgtonomySan Francisco, CA, United States
    Full-time
    At Agtonomy, were not just building techwere transforming how vital industries get work done.Our Physical AI and fleet services turn heavy machinery into intelligent, autonomous systems that tackle...Show moreLast updated: 1 day ago
    • Promoted
    Senior Machine Learning Engineer - Perception in Foster City

    Senior Machine Learning Engineer - Perception in Foster City

    Energy Jobline ZRFoster City, CA, United States
    Full-time
    Energy Jobline is the largest and fastest growing global Energy Job Board and Energy Hub.We have an audience reach of over 7 million energy professionals, 400,000+ monthly advertised global energy ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Machine Learning Engineer, Applied AI

    Senior Machine Learning Engineer, Applied AI

    Block USAAlbany, CA, United States
    Full-time
    Block is one company built from many blocks, all united by the same purpose of economic empowerment.The blocks that form our foundational teams - People, Finance, Counsel, Hardware, Information Sec...Show moreLast updated: 23 hours ago
    • Promoted
    Senior Artificial Intelligence / Machine Learning Engineer

    Senior Artificial Intelligence / Machine Learning Engineer

    BmoSan Francisco, CA, United States
    Part-time
    This is a Hybrid role (2 days / week in office).We are seeking a highly analytical and technically proficient Senior ML / AI Engineer to join our ARC team. This role is ideal for someone with a strong f...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Staff Machine Learning Engineer, Acceleration

    Staff Machine Learning Engineer, Acceleration

    WaymoSan Francisco, California, United States
    Full-time
    Staff Machine Learning Engineer, Optimization.Staff Machine Learning Engineer, Optimization.Waymo Staff Machine Learning Engineer, Optimization. Be among the first 25 applicants Join to apply for th...Show moreLast updated: 14 hours ago
    • Promoted
    Staff Machine Learning Engineer, ML Performance & Optimization

    Staff Machine Learning Engineer, ML Performance & Optimization

    WaymoSan Francisco, CA, United States
    Full-time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...Show moreLast updated: 1 day ago
    • Promoted
    Senior / Staff Machine Learning Engineer

    Senior / Staff Machine Learning Engineer

    DexterityRedwood City, CA, United States
    Full-time
    At Dexterity, we believe robots can positively transform the world.Our breakthrough technology frees people to do the creative, inspiring, problem-solving jobs that humans do best by enabling robot...Show moreLast updated: 30+ days ago
    • Promoted
    AI & Machine Learning Engineer - Senior - Consulting - Open Location

    AI & Machine Learning Engineer - Senior - Consulting - Open Location

    EYSan Mateo, CA, United States
    Full-time
    At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Machine Learning Engineer, Audio Perception

    Senior Machine Learning Engineer, Audio Perception

    WaymoSan Francisco, CA, United States
    Full-time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...Show moreLast updated: 30+ days ago
    • Promoted
    AIML - Sr. / Staff Machine Learning Engineer, Machine Learning Platform Technologies

    AIML - Sr. / Staff Machine Learning Engineer, Machine Learning Platform Technologies

    AppleSan Francisco, CA, United States
    Full-time
    Imagine what you could do here.At Apple, great ideas quickly become extraordinary products, services, and customer experiences. Bring passion and dedication to your work, and there’s no telling what...Show moreLast updated: 1 day ago