Talent.com
Research Engineer / Scientist, Pretraining Safety

Research Engineer / Scientist, Pretraining Safety

OpenAISan Francisco, CA, United States
6 days ago
Job type
  • Full-time
Job description

About the Team

The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society and is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency.

The Pretraining Safety team's goal is to build safer, more capable base models and enable earlier, more reliable safety evaluation during training. We aim to :

Develop upstream safety evaluations that to monitor how and when unsafe behaviors and goals emerge;

Create safer priors through targeted pretraining and mid-training interventions that make downstream alignment more effective and efficient

Design safe-by-design architectures that allow for more controllability of model capabilities

In addition, we will conduct the foundational research necessary for understanding how behaviors emerge, generalize, and can be reliably measured throughout training.

About the Role

The Pretraining Safety team is pioneering how safety is built into models before they reach post-training and deployment. In this role, you will work throughout the full stack of model development with a focus on pre-training :

Identify safety-relevant behaviors as they first emerge in base models

Evaluate and reduce risk without waiting for full-scale training runs

Design architectures and training setups that make safer behavior the default

Strengthen models by incorporating richer, earlier safety signals

We collaborate across OpenAI's safety ecosystem-from Safety Systems to Training-to ensure that safety foundations are robust, scalable, and grounded in real-world risks.

In this role, you will :

Develop new techniques to predict, measure, and evaluate unsafe behavior in early-stage models

Design data curation strategies that improve pretraining priors and reduce downstream risk

Explore safe-by-design architectures and training configurations that improve controllability

Introduce novel safety-oriented loss functions, metrics, and evals into the pretraining stack

Work closely with cross-functional safety teams to unify pre- and post-training risk reduction

You might thrive in this role if you :

Have experience developing or scaling pretraining architectures (LLMs, diffusion models, multimodal models, etc.)

Are comfortable working with training infrastructure, data pipelines, and evaluation frameworks (e.g., Python, PyTorch / JAX, Apache Beam)

Enjoy hands-on research - designing, implementing, and iterating on experiments

Enjoy collaborating with diverse technical and cross-functional partners (e.g., policy, legal, training)

Are data-driven with strong statistical reasoning and rigor in experimental design

Value building clean, scalable research workflows and streamlining processes for yourself and others

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI's Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers : we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment : protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Compensation Range : $310K - $460K

Create a job alert for this search

Research Scientist • San Francisco, CA, United States

Related jobs
  • Promoted
Research Engineer / Scientist, Robustness & Safety Training

Research Engineer / Scientist, Robustness & Safety Training

OpenAISan Francisco, CA, United States
Full-time
The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society and is at the forefront of OpenAI's mission ...Show moreLast updated: 6 days ago
  • Promoted
Research Engineer / Scientist, Safety Oversight

Research Engineer / Scientist, Safety Oversight

OpenAISan Francisco, CA, United States
Full-time
Research Engineer / Scientist, Safety Oversight.The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the soci...Show moreLast updated: 26 days ago
  • Promoted
Machine Learning Research Scientist / Engineer, Agents

Machine Learning Research Scientist / Engineer, Agents

Scale AI, Inc.San Francisco, CA, United States
Full-time
At Scale AI, our mission is to accelerate the development of AI applications.For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including : g...Show moreLast updated: 30+ days ago
  • Promoted
Research Engineer / Research Scientist, Alignment

Research Engineer / Research Scientist, Alignment

OpenAISan Francisco, CA, United States
Full-time
Research Engineer / Research Scientist, Alignment | OpenAI.Research Engineer / Research Scientist, Alignment.Apply now (opens in a new window). The Alignment team at OpenAI is dedicated to ensuring ...Show moreLast updated: 26 days ago
  • Promoted
Research Scientist / Engineer - Training Infrastructure

Research Scientist / Engineer - Training Infrastructure

IntelliPro Group Inc.Palo Alto, CA, US
Full-time
Research Scientist / Engineer – Training Infrastructure.Palo Alto, CA • Remote - US • Remote - International.We believe that multimodality is critical for intelligence.To go beyond ...Show moreLast updated: 30+ days ago
  • Promoted
Lead Research Engineer / Scientist, Chemical & Biological Risk

Lead Research Engineer / Scientist, Chemical & Biological Risk

OpenAISan Francisco, CA, United States
Full-time
The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society and is at the forefront of OpenAI's mission ...Show moreLast updated: 6 days ago
  • Promoted
Research Engineer

Research Engineer

OpenAISan Francisco, CA, United States
Full-time
By applying to this role, you will be considered for Research Engineer roles across all teams at OpenAI.As a Research Engineer here, you will be responsible for building AI systems that can perform...Show moreLast updated: 6 days ago
  • Promoted
Research Engineer / Scientist, Health AI

Research Engineer / Scientist, Health AI

OpenAISan Francisco, CA, United States
Full-time
AI models towards their deployment in the real world.Our Health AI team is focused on enabling universal access to high-quality medical information. We work at the intersection of AI safety research...Show moreLast updated: 21 days ago
  • Promoted
Research Engineer, Retrieval & Search, Applied Engineering

Research Engineer, Retrieval & Search, Applied Engineering

OpenAISan Francisco, CA, United States
Full-time
We bring OpenAI's technology to the world through products like ChatGPT and the OpenAI API.We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool...Show moreLast updated: 6 days ago
Research Scientist / Engineer – Training Infrastructure

Research Scientist / Engineer – Training Infrastructure

IntelliPro Group Inc.Palo Alto, CA, US
Full-time
Quick Apply
Research Scientist / Engineer – Training Infrastructure Position Type : Full time Location : Palo Alto, CA • Remote - US • Remote - International Salary Range : $220,000 - $300...Show moreLast updated: 30+ days ago
  • Promoted
Research and Development Scientist and Engineer (1 Year Fixed-Term)

Research and Development Scientist and Engineer (1 Year Fixed-Term)

Stanford UniversityStanford, California, United States
Temporary
Stanford University, the Personalized Integrative Medicine Laboratory in the Radiology Department (.Urologic Cancer Innovation Laboratory (. Research and Development Scientist and Engineer 1 with an...Show moreLast updated: 28 days ago
  • Promoted
Research Engineer, Safety Engineering

Research Engineer, Safety Engineering

OpenAISan Francisco, CA, United States
Full-time
The Safety Systems team is dedicated to ensuring the safety, robustness, and reliability of AI models and their deployment in the real world. Building on the many years of our practical alignment wo...Show moreLast updated: 6 days ago
  • Promoted
Research Engineer / Scientist, Trustworthy AI

Research Engineer / Scientist, Trustworthy AI

OpenAISan Francisco, CA, United States
Full-time
The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit society and is at the forefront of OpenAI's mission to b...Show moreLast updated: 30+ days ago
  • Promoted
Research Engineer / Scientist, Alignment Science

Research Engineer / Scientist, Alignment Science

AnthropicSan Francisco, CA, United States
Full-time
Anthropic's mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...Show moreLast updated: 9 days ago
  • Promoted
Researcher Engineer / Scientist, Training

Researcher Engineer / Scientist, Training

OpenAISan Francisco, CA, United States
Full-time
OpenAI's Training team is responsible for producing the large language models that power our research, our products, and ultimately bring us closer to AGI. Achieving this goal requires combining dee...Show moreLast updated: 27 days ago
  • Promoted
Research Engineer / Scientist, Strategic Deployment

Research Engineer / Scientist, Strategic Deployment

OpenAISan Francisco, CA, United States
Full-time
The Strategic Deployment team makes frontier models more capable, reliable, and aligned to transform high-impact domains. On one hand, this involves deploying models in real-world, high-stakes setti...Show moreLast updated: 6 days ago
  • Promoted
Machine Learning Research Lead, Security & Policy Research Lab

Machine Learning Research Lead, Security & Policy Research Lab

Scale AI, Inc.San Francisco, CA, United States
Full-time
As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems.Building on this expertis...Show moreLast updated: 25 days ago
  • Promoted
Research Engineer / Scientist, Post-Training

Research Engineer / Scientist, Post-Training

LettaSan Francisco, CA, United States
Full-time
Solving Self-Improving Superintelligence.Today's AI brains are brittle and rigid.At Letta, we're building self-improving artificial intelligence : creating agents that continually learn from experie...Show moreLast updated: 9 days ago