Talent.com
OpenAI
Researcher, Alignment TrainingOpenAI • San Francisco, CA, United States
No longer accepting applications
Researcher, Alignment Training

Researcher, Alignment Training

OpenAI • San Francisco, CA, United States
30+ days ago
Job type
  • Full-time
Job description

About The Team The Alignment Training team studies how frontier models acquire durable behavioral tendencies across the training stack. We work on identifying which behaviors can be shaped through pre-training, mid-training, and post-training; building the data, objectives, and evaluations needed to influence them; and determining whether the resulting behavior reflects a general learned tendency or a narrow artifact of the training distribution. Our work spans synthetic data, pre-training, mid-training, post-training, model behavior, and evaluation. We study how models learn to interpret intent, follow instructions, reason through tasks, express uncertainty, act honestly, and remain reliable under new conditions. The goal is to make desirable tendencies emerge early, strengthen throughout training, and appear robustly in deployed systems. About The Role We’re looking for a senior researcher with exceptional technical depth in large-scale model training, synthetic data, or evaluation who is excited to study how training choices shape aligned behavior in frontier models. You will help shape the research agenda for alignment training: defining the behaviors we want models to learn, designing data and training interventions to teach them, and building the evaluation loops needed to tell whether those behaviors are broad, robust, and durable. The strongest candidates will be able to move from an ambiguous behavioral question to a concrete experimental program: formulate the hypothesis, design the intervention, build the pipeline, run the experiment, and decide whether the result is real. This role is especially well suited for someone who wants to work close to the core model training loop, where choices about data, objectives, and evaluation directly shape how aligned deployed systems are. In this role, you’ll Develop synthetic data methods that teach models higher-level behavioral tendencies, such as understanding user intent, following instructions reliably, reasoning clearly, being honest, and acting consistently with intended goals and constraints. Study how pre-training, mid-training, and post-training each shape downstream model behavior, and which interventions are best applied at which stage. Build evaluation loops that connect model behavior back to training data and training objectives, so the team can iterate faster and with clearer signal. Design reusable data generation and filtering pipelines that improve the quality, diversity, and robustness of training data. Create experiments that distinguish durable learned behavior from benchmark gains, distribution-specific effects, or evaluation artifacts. Collaborate across pre-training, post-training, alignment, and product-facing teams to translate research insights into better model behavior. Help define the research agenda for alignment training: which behaviors should remain invariant across settings, which should adapt, and how to measure whether models have learned an underlying principle rather than a surface pattern. You might thrive in this role if you Have a strong record of technically excellent work in large-scale ML, especially in pre-training, post-training, synthetic data, model evaluation, or training infrastructure. Are comfortable designing experiments where the signal is subtle, noisy, or indirect. Can move between research taste and engineering execution: forming hypotheses, building pipelines, running experiments, analyzing results, and turning findings into the next iteration. Have unusually good judgment about which research questions are worth pursuing and which signals are strong enough to trust. Care about making models more useful, honest, steerable, and reliable for real users. Are excited by alignment problems, even if you have not worked in alignment before. Communicate clearly across research, engineering, and product contexts. Prefer practical, evidence-driven work grounded in experiments. Equal Opportunity Statement We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. #J-18808-Ljbffr

Create a job alert for this search

Researcher, Alignment Training • San Francisco, CA, United States

Similar jobs

Consumer Opinion Research Participant

GL IncOrinda, California
$15.00 hourly
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Member of Technical Staff, Applied Research

Fireworks AISan Mateo, CA, United States
Full-time

About Us:At Fireworks, we're building the future of generative AI infrastructure.Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry.We've ... Show more

 • Promoted

Associate Director, Oncology Digital and Omnichannel Marketing

Corcept TherapeuticsRedwood City, CA, United States
Full-time

Associate Director, Oncology Digital and Omnichannel Marketing.Redwood City, California, United States.For more than 25 years, Corcept has been singularly focused on the science of cortisol, a powe... Show more

 • Promoted

AI Research Lead - Pre-training (100% Remote)

Tether Operations LimitedSan Francisco, CA, United States
Remote
Full-time

OverviewJoin Tether and Shape the Future of Digital FinanceAt Tether, we're not just building products, we're pioneering a global financial revolution.Our cutting-edge solutions empower businesses-... Show more

 • Promoted

Associate Director, Medical Affairs Content and Training

REVOLUTION MedicinesRedwood City, CA, United States
Full-time

Revolution Medicines is a clinical-stage precision oncology company focused on developing novel targeted therapies to inhibit frontier targets in RAS-addicted cancers.The company's R&D pipeline... Show more

 • Promoted

Research Lead

FAR.AIBerkeley, CA, United States
Full-time

AI is hiring a Research Lead to develop and lead a research agenda that reduces catastrophic risks from advanced AI.You'll build and lead a team executing this agenda setting research direction, m... Show more

 • Promoted

Member of Technical Staff - AI Research

Gimlet LabsSan Francisco, CA, United States
Full-time

Gimlet Labs is building the first heterogeneous neocloud for AI workloads.As AI systems scale, the industry is hitting fundamental limits in power, capacity, and cost with today's homogeneous, vert... Show more

 • Promoted

Associate Director of Research & Assessment

University of San FranciscoSan Francisco, CA, United States
Full-time +1

Associate Director of Research & Assessment.The Associate Director will work closely with the Assistant Vice Provost for Educational Effectiveness to support the assessment of student learning at t... Show more

 • Promoted

Founder in Residence

Convergent ResearchSan Francisco, CA, United States
Full-time

Atlas Computing is looking to incubate a cohort of founders to each scope a different potential intervention and exit Atlas (with support) to lead it.That's why Atlas Computing is launching a selec... Show more

 • Promoted

Applied AI Researcher, Benchmarking

Distyl AISan Francisco, CA, United States
Full-time

About Distyl AI Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect critical operations for the frontier of AI.Our customers include th... Show more

 • Promoted

Lead Research- Pre-training (100% Remote)

Tether Operations LimitedSan Francisco, CA, United States
Remote
Full-time

Join Tether and Shape the Future of Digital FinanceAt Tether, we're not just building products, we're pioneering a global financial revolution.Our cutting-edge solutions empower businesses--from ex... Show more

 • Promoted

Venture Research Intern

SonySan Mateo, CA, United States
Full-time

Sony Corporation of America Ventures Research InternSony Corporation of America (SCA) is seeking a Ventures Research Intern within the Sony Ventures team.As the global corporate Venture Capital (VC... Show more

 • Promoted

Associate Director, Immunoassay Critical Reagents and Reference Materials

VaxcyteSan Carlos, CA, United States
Full-time

Associate Director, Immunoassay Critical Reagents and Reference Materials.Vaxcyte is seeking an accomplished Associate Director, Immunoassay Critical Reagents and Reference Materials to join the Gl... Show more

 • Promoted

Trilogy Interactive: Associate Director, Paid Media

ArenaBerkeley, CA, United States
Full-time

Associate Director, Paid Media.Trilogy Interactive is a full-service digital agency.For over a decade, we have stood at the forefront of the digital revolution in the Democratic political and nonpr... Show more

 • Promoted

Training Lead

Omni InclusiveSan Francisco, CA, United States
Full-time

Slack GTM Excellence Enablement Business Partner.Reporting into the Slack GTM Excellence organization, this person will act as one of the key enablement business partners, aligned to Slack Sellers.... Show more

 • Promoted

Strategic Projects Associate

HandshakeSan Francisco, CA, United States
Full-time

Handshake is expanding into cutting-edge AI research and development.We're building a world-class network of expert Fellows including PhDs, researchers, and specialists who drive forward the next... Show more

 • Promoted

Applied Research Intern

LabelboxSan Francisco, CA, United States
Full-time

Applied Research InternAt Labelbox, we're building the critical infrastructure that powers breakthrough AI models at leading research labs and enterprises.Since 2018, we've been pioneering data-cen... Show more

 • Promoted

Technical Recruiter, Research

CartesiaSan Francisco, CA, United States
Full-time

Our mission is to architect AI that learns from and interacts with the world like humans do.We're pioneering the model architectures that will make this possible.Our founding team met as PhDs at th... Show more

 • Promoted

Eikon Research Talent Community

Eikon TherapeuticsMillbrae, CA, United States
Full-time

Eikon Research Talent Community.Eikon Therapeutics is a new biopharmaceutical company employing revolutionary technology at the intersection of chemistry, engineering, computation, and biology to d... Show more

 • Promoted

Senior Prospect Research Analyst (Advancement Professional III, Range 1) - Development Office

San Francisco State UniversitySan Francisco, CA, United States
Full-time

Senior Prospect Research Analyst.San Francisco State is an Equal Opportunity Employer and does not discriminate against persons on the basis of race, religion, color, ancestry, age, disability, gen... Show more