Talent.com
Threat Modeler Lead
Threat Modeler LeadOpenAI • San Francisco, CA, United States
Threat Modeler Lead

Threat Modeler Lead

OpenAI • San Francisco, CA, United States
13 hours ago
Job type
  • Full-time
Job description

About the Team

The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society and is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency.

About the Role

The Threat Modeling Lead will own OpenAI's holistic approach to identifying, modeling, and forecasting frontier risks from frontier AI systems. This role ensures that our evaluation frameworks, safeguards, and taxonomies are robust, high-coverage, and forward-looking. This leader will help the company answer the "why" behind our most stringent risk-prevention efforts, shaping the rationale for prioritizing and mitigating risks across domains. They will serve as the central node connecting technical, governance, and policy perspectives on prioritization, focus and rationale on our approach to frontier risks from AI.

In this role, you will :

  • Develop and maintain comprehensive threat models across all misuse areas (bio, cyber, attack planning, etc.).
  • Develop plausible and convincing threat models across loss of control, self-improvement, and other possible alignment risks from frontier ai systems
  • Forecast risks by combining technical foresight, adversarial simulation, and emerging trends.
  • Pair closely with technical partners on capability evaluations to ensure these map to and cover the gambit of severe risks differentially enabled by frontier AI systems.
  • Pair closely with Bio and Cyber Leads to size the remaining risk of the designed safeguards and translate threat models into actionable mitigation designs.
  • Act as the thought partner and explainer of "why" and "when" for high-investment mitigation efforts-helping stakeholders understand the rationale behind prioritization.
  • Serve as the central node connecting technical, governance, and policy perspectives on prioritization, focus and rationale on our approach to misuse risk.

You might thrive in this role if you :

  • Understand risks from frontier AI systems and have a strong grasp of AI alignment literature.
  • Bring deep experience in threat modeling, risk analysis, or adversarial thinking (e.g., security, national security, or safety).

  • Know how AI evaluations work and can connect eval results to both capability testing and safeguard sufficiency.
  • Enjoy working across technical and policy domains to drive rigorous, multidisciplinary risk assessments.
  • Communicate complex risks clearly and compellingly to both technical and non-technical audiences.
  • Think in systems and naturally anticipate second-order and cascading risks.
  • About OpenAI

    OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

    We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

    For additional information, please see OpenAI's Affirmative Action and Equal Employment Opportunity Policy Statement.

    Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers : we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment : protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

    To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

    We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

    OpenAI Global Applicant Privacy Policy

    At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

    Create a job alert for this search

    Lead • San Francisco, CA, United States

    Related jobs
    In-Home Product Tester – No Fees, No Experience, $25-$45 / hr

    In-Home Product Tester – No Fees, No Experience, $25-$45 / hr

    OCPA • Montara, California, us
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show more
    Last updated: 30+ days ago • Promoted
    Threat Intelligence Lead

    Threat Intelligence Lead

    Canonical • San Jose, CA, United States
    Full-time
    Be among the first 25 applicants.Get AI-powered advice on this job and more exclusive features.The Threat Intelligence Lead will own Canonical's threat intelligence strategy and execution, includin...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Security Architect — Threat Modeling & Secure Cloud Design

    Cloud Security Architect — Threat Modeling & Secure Cloud Design

    Compunnel Inc. • San Francisco, CA, United States
    Full-time
    A leading IT services company based in San Francisco is seeking a Mid-Senior Level Security Architect to lead the integration of secure cloud architectures into their platforms.The ideal candidate ...Show more
    Last updated: 6 hours ago • Promoted • New!
    Target Security Specialist

    Target Security Specialist

    Target • Sausalito, California, United States of America
    Part-time
    Starting Hourly Rate / Salario por Hora Inicial : $23.Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture.They ...Show more
    Last updated: 2 days ago • Promoted
    Work From Home Product Tester – $25-$45 / hr – No Experience Needed

    Work From Home Product Tester – $25-$45 / hr – No Experience Needed

    OCPA • Montara, California, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show more
    Last updated: 30+ days ago • Promoted
    Test Products from Home – $25-$45 / hr + Freebies

    Test Products from Home – $25-$45 / hr + Freebies

    OCPA • Moss Beach, California, us
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show more
    Last updated: 30+ days ago • Promoted
    Transfer List

    Transfer List

    City of Vallejo • Vallejo, CA, United States
    Permanent
    ONLY PERMANENT CITY OF VALLEJO EMPLOYEES WHO HAVE COMPLETED PROBATION MAY REQUEST TO BE PLACED ON THE TRANSFER LIST.The Transfer List is a way for current City of Vallejo employees to be able to ex...Show more
    Last updated: 30+ days ago • Promoted
    Compliance Test EngineerCompliance & Certification • Berkeley, CA • Full time

    Compliance Test EngineerCompliance & Certification • Berkeley, CA • Full time

    Form Energy • Berkeley, CA, United States
    Full-time
    Are you ready to build America's energy future? Form Energy is an American manufacturing and energy technology company.We're revolutionizing energy storage with cost-effective, multi-day technology...Show more
    Last updated: 2 days ago • Promoted
    Pharmaceutical Manufacturing Associate

    Pharmaceutical Manufacturing Associate

    Intelliswift Software, Inc • Novato, CA, US
    Full-time
    Our team of rich experts from diverse backgrounds contributes to making Intelliswift one of the most reliable partners in IT and Talent solutions. We specialize in delivering world-class Digital Pro...Show more
    Last updated: 21 days ago • Promoted
    Remote ML Modeling Engineer – Risk & Fraud

    Remote ML Modeling Engineer – Risk & Fraud

    Square • San Francisco, CA, United States
    Remote
    Full-time
    A leading financial technology company in San Francisco seeks a Machine Learning Engineer (Modeling) to enhance its fraud detection systems. The ideal candidate has over 3 years of machine learning ...Show more
    Last updated: 5 days ago • Promoted
    Senior Product Manager, AI-Driven Security Operations

    Senior Product Manager, AI-Driven Security Operations

    Anomali • Redwood City, CA, United States
    Full-time
    Anomali is headquartered in Silicon Valley and is the Leading AI-Powered Security Operations Platform that is modernizing security operations. At the center of it is an omnipresent, intelligent, and...Show more
    Last updated: 2 days ago • Promoted
    Research Scientist, Tech Lead Manager, Model Threat Mitigation

    Research Scientist, Tech Lead Manager, Model Threat Mitigation

    Google DeepMind • Mountain View, CA, United States
    Full-time
    Artificial Intelligence could be one of humanity’s most useful inventions.At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance t...Show more
    Last updated: 7 days ago • Promoted
    Casework and Millwork Designer

    Casework and Millwork Designer

    38° North Latitude Builders, Inc. • San Rafael, CA, US
    Full-time +1
    Degrees North Latitude Builders, Inc.Degrees specializes in residential remodels and high end custom cabinetry.Extensive experience using Microvellum. Convert DWG files to DXF files.Ability to inter...Show more
    Last updated: 30+ days ago • Promoted
    Tech Lead Manager- MLRE, ML Systems

    Tech Lead Manager- MLRE, ML Systems

    Scale AI, Inc. • San Francisco, CA, United States
    Full-time
    Scale's LLM post-training platform team builds our internal distributed framework for large language model training.The platform powers MLEs, researchers, data scientists, and operators for fast an...Show more
    Last updated: 30+ days ago • Promoted
    Category Lead

    Category Lead

    Axelon Services Corporation • San Ramon, CA, US
    Full-time
    San Ramon or Oakland, CA - Hybrid.The ideal candidate will have : .Experience sourcing or leading a category strategy for large consulting services agreements. The suppliers are firms like PwC, EY, Cl...Show more
    Last updated: 30+ days ago • Promoted
    Machine Learning Research Lead, Security & Policy Research Lab

    Machine Learning Research Lead, Security & Policy Research Lab

    Scale AI, Inc. • San Francisco, CA, United States
    Full-time
    As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems.Building on this expertis...Show more
    Last updated: 30+ days ago • Promoted
    Casework and Millwork Designer

    Casework and Millwork Designer

    38 North Latitude Builders, Inc. • San Rafael, CA, United States
    Full-time +1
    Degrees North Latitude Builders, Inc.Degrees specializes in residential remodels and high end custom cabinetry.Extensive experience using Microvellum. Convert DWG files to DXF files.Ability to inter...Show more
    Last updated: 30+ days ago • Promoted
    Remote Product Tester – $45 / hr + Free Products – Start Now!

    Remote Product Tester – $45 / hr + Free Products – Start Now!

    OCPA • Moss Beach, California, us
    Remote
    Part-time +1
    Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies. We guarantee 15-25 hours per week with an hourly pay of bet...Show more
    Last updated: 30+ days ago • Promoted