Talent.com
Principal Engineer, Behavior Understanding and Evaluation
Principal Engineer, Behavior Understanding and EvaluationMotional • Boston, MA, United States
No longer accepting applications
Principal Engineer, Behavior Understanding and Evaluation

Principal Engineer, Behavior Understanding and Evaluation

Motional • Boston, MA, United States
26 days ago
Job type
  • Full-time
Job description

Mission Summary :

The AV Behavior Design and Evaluation Team is responsible for owning the design and assessment of the AV behavior utilizing the concept of AV behavior competencies. The team relies on systematic decomposition of AV behavior along with data driven assessment utilizing data from on-road and simulation test modalities. We are responsible for building and operating robust, large-scale evaluation systems, alongside sophisticated simulation workflows and insightful diagnostic tools. By combining expert human judgment with advanced data driven techniques, we evaluate the system behavior performance.

As the team is looking to scale to support more and more behavioral competencies, we are looking for passionate Engineers to help build a robust framework to leverage the best of agile systems engineering and data driven performance assessment to achieve our ambitious goals in scaling our system design and evaluation processes. We are looking to work with people who are driven to design robust systems and transform complex data into measurable progress toward a safer, smarter transportation future.

This person will get to build relationships with the team as well cross-functional across organization to help build a cohesive understanding AV performance as applicable to the Behavioral Competencies.

What you'll do :

  • Decompose AV operational design domain (ODD) into AV capabilities
  • Define precise atomic system and subsystem behaviors and interfaces required to realize these capabilities.
  • Collaborate extensively with development teams (Autonomy, Infrastructure, Cloud Applications) to drive the design and implementation of new features that enable defined AV capabilities and enhance the overall product experience.
  • Strategically plan and execute system-level testing campaigns. This includes leveraging advanced simulation tools and coordinating tests on closed course tracks and proving grounds to ensure the system meets functional and performance requirements.
  • Effectively utilize existing metrics and propose new metrics to evaluate AV performance via simulation and on-road testing modalities.
  • Pioneer the definition and implementation of key evaluation metrics and reward functions, driving autonomy performance across safety, comfort, and assertiveness
  • Leverage a combination of learned methods and metrics along with classical metrics to stretch the horizon of performance evaluation
  • Characterize the performance target against parameters used to define AV capabilities to provide nuance in performance evaluation
  • Deliver strategic insights and recommendations based on AV capability testing by building meaningful visualizations
  • Develop and maintain comprehensive dashboards and reporting tools. Distill on-road performance data into actionable feedback for engineering teams and create high-level, insightful summaries for executive leadership.
  • Focus on automating simulation result analysis processes and gaps, removing manual processes where applicable
  • Partner cross-functionally with Behaviors, Actions, Simulation, System Engineering, Research, and other Onboard / Offboard Software Teams on evaluation strategies

What we're looking for :

  • Bachelor's degree and 7+ years of experience in one of Systems Eng, Data Science, Statistics or Computer Science with some form of experience in rest of the domains
  • At least 5 years of experience in leading and scaling data driven evaluation of autonomous driving behavior or similar safety critical emerging technology
  • Proven technical experience in establishing and executing evaluation strategies
  • A strong foundation in scientific and statistical methodologies
  • Fluency in SQL or similar query languages
  • Fluency in data visualization techniques
  • Fluency in Python
  • Proficiency in crafting data-driven reports and technical strategy documents for executive decision-making
  • Excellent interpersonal skills to build relationships with other teams
  • Excellent communication skills; effective in communicating complex concepts and driving resolutions
  • Self-starter who is motivated to set and achieve goals and takes initiative to drive ambiguous tasks / projects to completion
  • I deally, you also have :

  • Masters degree in Data Science or Computer Science
  • Experience in mentoring and leadership development
  • Experience collaborating in an agile development environment
  • A background in shaping product roadmaps
  • Familiarity with Reinforcement Learning (RL) with Human Feedback
  • Specialized expertise in creating expansive datasets
  • Experience collaborating in an agile development environment
  • Working with a global workforce that spans multiple timezones
  • We encourage a hybrid schedule with in-office time at one of our locations in Boston, Pittsburgh, or Las Vegas to support collaboration, or this role can be fully remote.

    The salary range for this role is an estimate based on a wide range of compensation factors including but not limited to specific skills, experience and expertise, role location, certifications, licenses, and business needs. The estimated compensation range listed in this job posting reflects base salary only. This role may include additional forms of compensation such as a bonus or company equity. The recruiter assigned to this role can share more information about the specific compensation and benefit details associated with this role during the hiring process.

    Candidates for certain positions are eligible to participate in Motional's benefits program. Motional's benefits include but are not limited to medical, dental, vision, 401k with a company match, health saving accounts, life insurance, pet insurance, and more.

    Salary Range

    $175,000-$234,250 USD

    Motional is a driverless technology company making autonomous vehicles a safe, reliable, and accessible reality. We're driven by something more.

    Our journey is always people first.

    We aren't just developing driverless cars; we're creating safer roadways, more equitable transportation options, and making our communities better places to live, work, and connect. Our team is made up of engineers, researchers, innovators, dreamers and doers, who are creating a technology with the potential to transform the way we move.

    Higher purpose, greater impact.

    We're creating first-of-its-kind technology that will transform transportation. To do so successfully, we must design for everyone in our cities and on our roads. We believe in building a great place to work through a progressive, global culture that is diverse, inclusive, and ensures people feel valued at every level of the organization. Diversity helps us to see the world differently; it's not only good for our business, it's the right thing to do.

    Scale up, not starting up.

    Our team is behind some of the industry's largest leaps forward, including the first fully-autonomous cross-country drive in the U.S, the launch of the world's first robotaxi pilot, and operation of the world's longest-standing public robotaxi fleet. We're driven to scale; we're moving towards commercialization of our technology, and we need team members who are ready to embrace change and challenges.

    Formed as a joint venture between Hyundai Motor Group and Aptiv, Motional is fundamentally changing how people move through their lives. Headquartered in Boston, Motional has operations in the U.S and Asia. For more information, visit www.Motional.com and follow us on Twitter, LinkedIn, Instagram and YouTube.

    Motional AD Inc. is an EOE. We celebrate diversity and are committed to creating an inclusive environment for all employees. To comply with Federal Law, we participate in E-Verify. All newly-hired employees are queried through this electronic system established by the DHS and the SSA to verify their identity and employment eligibility.

    Create a job alert for this search

    Principal Engineer Behavior Understanding and Evaluation • Boston, MA, United States

    Similar jobs
    Principal Solutions Engineer

    Principal Solutions Engineer

    PTC • Boston, MA, United States
    Full-time
    Our world is transforming, and PTC is leading the way.Our software brings the physical and digital worlds together, enabling companies to improve operations, create better products, and empower peo...Show more
    Last updated: 18 days ago • Promoted
    Principal Engineer, AutoQC and Data Consumption Solutions

    Principal Engineer, AutoQC and Data Consumption Solutions

    Vertex Pharmaceuticals • Boston, MA, United States
    Full-time
    Principal Engineer, AutoQC and Data Consumption Solutions.Principal Engineer, AutoQC and Data Consumption Solutions.Vertex is a global biotechnology company that invests in scientific innovation.Th...Show more
    Last updated: 20 days ago • Promoted
    Principal Machine Learning Engineer

    Principal Machine Learning Engineer

    Red Hat, Inc. • Boston, MA, United States
    Full-time +1
    At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. Inference team accelerates AI for the enterprise and bring...Show more
    Last updated: 15 days ago • Promoted
    Principal Mechanical Engineer

    Principal Mechanical Engineer

    QuEra Computing Inc. • Boston, MA, United States
    Full-time
    Principal Mechanical Engineer – QuEra Computing Inc.We are building scalable, fault‑tolerant neutral atom quantum computers that harness the power of atomic physics, precision engineering, and adva...Show more
    Last updated: 30+ days ago • Promoted
    Senior / Staff / Principal Engineer

    Senior / Staff / Principal Engineer

    Canonical • Boston, MA, United States
    Full-time
    Senior / Staff / Principal Engineer.Be among the first 25 applicants.Senior / Staff / Principal Engineer.Get AI-powered advice on this job and more exclusive features. Canonical is a leading provider of ope...Show more
    Last updated: 30+ days ago • Promoted
    Principal Engineer, Enterprise Scalability

    Principal Engineer, Enterprise Scalability

    Klaviyo Inc. • Boston, MA, United States
    Full-time
    Principal Engineer, Enterprise Scalability.At Klaviyo, we value the unique backgrounds, experiences and perspectives each Klaviyo (we call ourselves Klaviyos) brings to our workplace each and every...Show more
    Last updated: 30+ days ago • Promoted
    Principal Machine Learning Engineer

    Principal Machine Learning Engineer

    Red Hat • Boston, MA, United States
    Permanent
    At Red Hat we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. The Red Hat AI Inference team accelerates AI for the enter...Show more
    Last updated: 7 days ago • Promoted
    Principal Engineer, AI Systems

    Principal Engineer, AI Systems

    OneStudyTeam • Boston, MA, United States
    Full-time
    Principal Engineer, AI Systems.At OneStudyTeam (a Reify Health company), we specialize in speeding up clinical trials and increasing the chance of new therapies being approved with the ultimate goa...Show more
    Last updated: 30+ days ago • Promoted
    Principal Engineer, AutoQC and Data Consumption Solutions

    Principal Engineer, AutoQC and Data Consumption Solutions

    Vertex Pharmaceuticals (San Diego) LLC • Boston, MA, United States
    Full-time
    Job Description • •Vertex is a global biotechnology company that invests in scientific innovation.The Data, Technology and Engineering (DTE) Research, Pre-Clinical, Manufacturing & Supply (RPMS) Grou...Show more
    Last updated: 20 days ago • Promoted
    Principal System Planning and Studies Engineer

    Principal System Planning and Studies Engineer

    Arcadis • Boston, MA, United States
    Full-time +1
    Principal System Planning and Studies Engineer.Principal System Planning and Studies Engineer.Principal System Planning and Studies Engineer. Be among the first 25 applicants.Principal System Planni...Show more
    Last updated: 30+ days ago • Promoted
    Principal Product Development Engineer (Hybrid, Boston)

    Principal Product Development Engineer (Hybrid, Boston)

    Haemonetics Corp • Boston, MA, United States
    Full-time
    We are constantly looking to add to our core talent.If you are seeking a career that is challenging and rewarding, a work environment that is diverse and dynamic, look no further - Haemonetics is y...Show more
    Last updated: 30+ days ago • Promoted
    Technical Leader - Human Factors Engineering (Remote Eligible, U.S.)

    Technical Leader - Human Factors Engineering (Remote Eligible, U.S.)

    GE Vernova • Boston, MA, United States
    Remote
    Permanent
    The Human Factors Engineer (HFE) Technical Leader will implement, plan, manage and / or establish HFE processes in compliance with corporate and regulatory requirements to provide high quality human-...Show more
    Last updated: 6 days ago • Promoted
    Senior Principal Research Engineer

    Senior Principal Research Engineer

    Autodesk • Boston, MA, United States
    Full-time
    Senior Principal Research Engineer.Senior Principal Research Engineer.You will work collaboratively to create and interpret design data that enhances design and engineering workflows, while providi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Principal System Engineer

    Senior Principal System Engineer

    Cubic Corporation • Boston, MA, United States
    Full-time +1
    Senior Principal System Engineer page is loaded## Senior Principal System Engineerlocations : Boston, Massachusetts : United Statestime type : Full timeposted on : Posted Yesterdayjob requisiti...Show more
    Last updated: 30+ days ago • Promoted
    Principal Systems Engineer – Quantum Computing Systems

    Principal Systems Engineer – Quantum Computing Systems

    QuEra Computing • Boston, MA, United States
    Full-time
    Principal Systems Engineer – Quantum Computing Systems.We are seeking a Principal Systems Engineer to play a critical role in aligning engineering execution with scientific and machine-level progre...Show more
    Last updated: 18 days ago • Promoted
    Principal Supplier Engineer

    Principal Supplier Engineer

    Boston Scientific Gruppe • Boston, MA, United States
    Full-time
    The Principal Supplier Engineer, External Operations, Global sourcing APAC, will lead the SFMD(Sourced Finished Medical Device) products on-boarding process in BSC and manage the engineering change...Show more
    Last updated: 30+ days ago • Promoted
    Principal Product Development Engineer (Hybrid, Boston)

    Principal Product Development Engineer (Hybrid, Boston)

    Haemonetics Software Solutions • Boston, MA, United States
    Full-time
    Principal Product Development Engineer to join a team of scientists and engineers located in our Boston, MA Research and Development Systems Engineering Laboratory contributing to the design and de...Show more
    Last updated: 30+ days ago • Promoted
    Principal Engineer

    Principal Engineer

    Sunrise Technologies, Inc. • Raynham, Massachusetts, United States
    Full-time
    Quick Apply
    Reporting to the Engineering Manager, this position is responsible for promoting company growth through the design, development, and introduction of new products to the market by developing the eng...Show more
    Last updated: 30+ days ago