Talent.com
Research Engineer / Scientist, Safety Oversight
Research Engineer / Scientist, Safety OversightOpenai • San Francisco, CA, United States
Research Engineer / Scientist, Safety Oversight

Research Engineer / Scientist, Safety Oversight

Openai • San Francisco, CA, United States
2 days ago
Job type
  • Full-time
Job description

About the Team

The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society, and is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency.

The Safety Oversight Research team aims to fundamentally advance our capabilities to maintain oversight over frontier AI models, and leverage these advances to ensure OpenAI's deployed models are safe and beneficial. This requires a breadth of new ML research in the areas of human-AI collaboration, reasoning, robustness, and scalable oversight to keep pace with model capabilities. We invest heavily in developing novel model and system-level methods of identifying and mitigating AI misuse and misalignment.

Our goal is to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely.

About the Role

OpenAI is seeking a senior researcher with a passion for AI safety and experience in safety research. Your role will set directions for research to maintain effective oversight of safe AGI and work on research projects to identify and mitigate misuse and misalignment in our AI systems. You will play a critical role in defining how a safe AI system should look in the future at OpenAI, making a significant impact on our mission to build and deploy safe AGI.

In this role, you will :

Develop and refine AI monitor models to detect and mitigate known and emerging patterns of misuse and misalignment.

Set research directions and strategies to make our AI systems safer, more aligned, and more robust.

Evaluate and design effective red-teaming pipelines to examine the end-to-end robustness of our safety systems, and identify areas for future improvement.

Conduct research to improve models' ability to reason about questions of human values, and apply these improved models to practical safety challenges.

Coordinate and collaborate with cross-functional teams, including T&S, legal, policy and other research teams, to ensure that our products meet the highest safety standards.

You might thrive in this role if you :

Are excited about OpenAI's mission of building safe, universally beneficial AGI and are aligned with OpenAI's charter

Show enthusiasm for AI safety and dedication to enhancing the safety of cutting-edge AI models for real-world use.

Bring 4+ years of experience in the field of AI safety, especially in areas like RLHF, human-AI collaboration, fairness & biases.

Hold a Ph.D. or other degree in computer science, machine learning, or a related field.

Thrive in environments involving large-scale AI systems.

Possess 4+ years of research engineering experience and proficiency in Python or similar languages.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI's Affirmative Action and Equal Employment Opportunity Policy Statement.

Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act. For unincorporated Los Angeles County workers : we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment : protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Compensation Range : $310K - $460K

Create a job alert for this search

Research Scientist • San Francisco, CA, United States

Related jobs
Safety Engineer

Safety Engineer

Clark Construction Group • San Francisco, CA, United States
Full-time
As a Safety Engineer, you will ensure the safety of employees, trade partners, and the general public on our world class projects. The Safety Engineer is responsible for creating a culture of care w...Show more
Last updated: 2 days ago • Promoted
Research Engineer / Scientist, Safety Oversight

Research Engineer / Scientist, Safety Oversight

OpenAI • San Francisco, CA, United States
Full-time
Research Engineer / Scientist, Safety Oversight.The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the soci...Show more
Last updated: 19 days ago • Promoted
Research Engineer / Scientist, Robustness & Safety Training

Research Engineer / Scientist, Robustness & Safety Training

Openai • San Francisco, CA, United States
Full-time
The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society and is at the forefront of OpenAI's mission ...Show more
Last updated: 2 days ago • Promoted
Research Engineer / Scientist, Memory

Research Engineer / Scientist, Memory

Letta • San Francisco, CA, United States
Full-time
Solving Self-Improving Superintelligence.Today's AI brains are brittle and rigid.At Letta, we're building self-improving artificial intelligence : creating agents that continually learn from experie...Show more
Last updated: 2 days ago • Promoted
Research Engineer, Retrieval & Search, Applied Engineering

Research Engineer, Retrieval & Search, Applied Engineering

Openai • San Francisco, CA, United States
Full-time
We bring OpenAI's technology to the world through products like ChatGPT and the OpenAI API.We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool...Show more
Last updated: 2 days ago • Promoted
Research Engineer / Scientist, Interpretability

Research Engineer / Scientist, Interpretability

Openai • San Francisco, CA, United States
Full-time
The Interpretability team studies internal representations of deep learning models.We are interested in using representations to understand model behavior, and in engineering models to have more un...Show more
Last updated: 2 days ago • Promoted
Research Engineer / Scientist

Research Engineer / Scientist

DYNA Robotics Inc • Redwood City, CA, United States
Full-time
Dyna Robotics makes general-purpose robots powered by a proprietary embodied AI foundation model that generalizes and self-improves across varied environments with commercial-grade performance.Dyna...Show more
Last updated: 2 days ago • Promoted
Research and Development Scientist and Engineer (1 Year Fixed-Term)

Research and Development Scientist and Engineer (1 Year Fixed-Term)

Stanford University • Stanford, CA, US
Full-time +1
Stanford University, the Personalized Integrative Medicine Laboratory in the Radiology Department ( https : / / pimed.Urologic Cancer Innovation Laboratory ( http : / / ucil. Research and Development Scient...Show more
Last updated: 19 days ago • Promoted
Research Engineer / Scientist, Trustworthy AI

Research Engineer / Scientist, Trustworthy AI

Openai • San Francisco, CA, United States
Full-time
The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society and is at the forefront of OpenAI's mission ...Show more
Last updated: 2 days ago • Promoted
Research Engineer / Research Scientist - Foundations Retrieval Lead

Research Engineer / Research Scientist - Foundations Retrieval Lead

Openai • San Francisco, CA, United States
Full-time
The Foundations Research team works on high-risk, high-reward ideas that could shape the next decade of AI.Our goal is to advance the science and data that enable our training and scaling efforts, ...Show more
Last updated: 2 days ago • Promoted
Sr. Systems Safety Engineer

Sr. Systems Safety Engineer

Reliable Robotics • Mountain View, CA, United States
Permanent
We're building safety-enhancing technology for aviation that will save lives.Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally tra...Show more
Last updated: 30+ days ago • Promoted
Senior Deep Learning Research Engineer, Risk Labs

Senior Deep Learning Research Engineer, Risk Labs

Block USA • Albany, CA, United States
Full-time
Block is one company built from many blocks, all united by the same purpose of economic empowerment.The blocks that form our foundational teams - People, Finance, Counsel, Hardware, Information Sec...Show more
Last updated: 2 days ago • Promoted
Research Engineer, AI Safety & Alignment

Research Engineer, AI Safety & Alignment

Character • Menlo Park, CA, United States
Full-time
Joining us as a Research Engineer, you'll be at the forefront of tackling one of the most critical challenges in AI today : safety and alignment. Your work will be pivotal in understanding and mitiga...Show more
Last updated: 1 day ago • Promoted
Senior / Staff Safety Research Engineer, Crash and Injury Modeling

Senior / Staff Safety Research Engineer, Crash and Injury Modeling

Zoox • Foster City, CA, United States
Full-time
Zoox is on an ambitious journey to develop a full-stack autonomous mobility solution for cities and safely deploy such a robotaxi solution. You will be part of the SDMA Safety Research team which is...Show more
Last updated: 30+ days ago • Promoted
Research Engineer / Scientist, Alignment Science

Research Engineer / Scientist, Alignment Science

Anthropic • San Francisco, CA, United States
Full-time
Anthropics mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group o...Show more
Last updated: 2 days ago • Promoted
Lead Research Engineer / Scientist, Chemical & Biological Risk

Lead Research Engineer / Scientist, Chemical & Biological Risk

OpenAI • San Francisco, CA, United States
Full-time
The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit society and is at the forefront of OpenAI's mission to b...Show more
Last updated: 30+ days ago • Promoted
Research Engineer / Scientist, Post-Training

Research Engineer / Scientist, Post-Training

Letta • San Francisco, CA, United States
Full-time
Solving Self-Improving Superintelligence.Todays AI brains are brittle and rigid.At Letta, were building self-improving artificial intelligence : creating agents that continually learn from experienc...Show more
Last updated: 2 days ago • Promoted
Research Engineer / Scientist, Robustness & Safety Training

Research Engineer / Scientist, Robustness & Safety Training

OpenAI • San Francisco, CA, United States
Full-time
Research Engineer / Scientist, Robustness & Safety Training.Safety Systems - San Francisco.The Safety Systems team is responsible for various safety work to ensure our best models can be safely dep...Show more
Last updated: 19 days ago • Promoted