VR Teleoperation UI / UX Engineer, Large Behavior Models

At Toyota Research Institute (TRI), we're on a mission to improve the quality of human life. We're developing new tools and capabilities to amplify the human experience. To lead this progressive shift in mobility, we've built a world-class team in Automated Driving, Energy & Materials, Human-Centered AI, Human Interactive Driving, Large Behavior Models, and Robotics.

The Mission

Make general-purpose robots a reality.

The Challenge

We envision a future where robots assist with household chores and cooking, aid the older population in maintaining their independence, and enable people to spend more time on the activities they enjoy most. To achieve this, robots need to be able to operate reliably in messy, unstructured environments. Our mission is to answer the question "What will it take to create truly general-purpose robots that can accomplish a wide variety of tasks in settings like human homes with minimal human supervision?". We believe that the answer lies in cultivating large-scale datasets of physical interaction from a variety of sources and building on the latest advances in machine learning to learn general-purpose robot behaviors from this data.

Robotics

The mission of TRI Robotics is to invent and prove new robotic capabilities required to enable home robots to solve the challenges faced by an aging society. As part of that mission, we are developing a sophisticated suite of open source robotics software called Drake ( ()), for use in our internal robotics projects and the wider community of advanced robotics researchers.

The Team

Join Toyota Research Institute's LBM-C division to change the world by creating and shipping useful general-purpose AI-driven robots. Lead the teleoperation experience and turn pioneering R&D into real-world products that empower human-robot collaboration.

The Opportunity

As a VR Teleoperation UI / UX Engineer, you'll be instrumental in designing and implementing the user interface and experience for our groundbreaking VR teleoperation system. Your work will enable intuitive and immersive control of dexterous humanoid robots, transforming live camera and sensor feeds into low-latency, natural control interfaces. You will be responsible for the end-to-end user-facing pipeline, ensuring remote operators can fully use our robots' physical capabilities with ease and precision.

Responsibilities

• Design and Implement VR UI / UX : Create and refine intuitive user interfaces, control schemes (controllers, hand-tracking, gestures), and interactive elements within the VR environment specifically for robotic teleoperation.
• Develop Immersive Experiences : Build VR / XR systems that provide high situational awareness and intuitive control, minimizing operator fatigue during extended teleoperation sessions.
• User Research & Iteration : Conduct user research, gather feedback from operators, and rapidly iterate on design and implementation to optimize the teleoperation experience.
• Front-End Engineering : Develop robust and performant front-end code for the VR application, ensuring seamless integration with real-time data streams and robot command relays.
• Collaborate Cross-Functionally : Partner closely with hardware, AI, robot control, and deployment teams to ensure the UI / UX aligns with system capabilities and overall product goals.

Qualifications

Bonus Qualifications

The pay range for this position at commencement of employment is expected to be between $162,000 and $243,000 / year for Massachusetts-based roles. Base pay offered will depend on multiple individualized factors, including, but not limited to, business or organizational needs, market location, job-related knowledge, skills, and experience. TRI offers a generous benefits package including medical, dental, and vision insurance, 401(k) eligibility, paid time off benefits (including vacation, sick time, and parental leave), and an annual cash bonus structure. Additional details regarding these benefit plans will be provided if an employee receives an offer of employment.

Please reference this Candidate Privacy Notice to inform you of the categories of personal information that we collect from individuals who inquire about and / or apply to work for Toyota Research Institute, Inc. or its subsidiaries, including Toyota A.I. Ventures GP, L.P., and the purposes for which we use such personal information.

TRI is fueled by a diverse and inclusive community of people with unique backgrounds, education and life experiences. We are dedicated to fostering an innovative and collaborative environment by living the values that are an essential part of our culture. We believe diversity makes us stronger and are proud to provide Equal Employment Opportunity for all, without regard to an applicant's race, color, creed, gender, gender identity or expression, sexual orientation, national origin, age, physical or mental disability, medical condition, religion, marital status, genetic information, veteran status, or any other status protected under federal, state or local laws.

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records for employment.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.