Talent.com
Policy Design Manager, User Well-being
Policy Design Manager, User Well-beingAnthropic • San Francisco, CA, US
Policy Design Manager, User Well-being

Policy Design Manager, User Well-being

Anthropic • San Francisco, CA, US
30+ days ago
Job type
  • Full-time
Job description

Policy Design Manager, User Well-being

Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the Role :

As a Safeguards Policy Design Manager, you will be responsible for developing usage policies, clarifying enforcement guidelines, and advising on safety interventions for our products and services. Your core focus will be on mitigating potential risks related to user well-being, including concerns regarding mental health, sycophancy, delusions, and emotional attachment. In addition, you will advise teams on opportunities for promoting well-being, including potential intervention development and supporting beneficial use cases. Safety is core to our mission and you'll help shape policy creation and development so that our users can safely interact with and build on top of our products in a harmless, helpful and honest way.

  • Important context for this role : In this position you may be exposed to and engage with explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature.

Responsibilities :

Serve as an internal subject matter expert, leveraging deep expertise in mental health and well-being to :

  • Draft new policies that help govern the responsible use of our models for emerging capabilities and use cases
  • Design evaluation frameworks for testing model performance in areas of expertise
  • Conduct regular reviews and testing of existing policies to identify and address gaps and ambiguities
  • Review flagged content to drive enforcement and policy improvements
  • Update our usage policies based on feedback collected from external experts, our enforcement team, and edge cases that you will review
  • Work with safeguards product teams to identify and mitigate concerns, and collaborate on designing appropriate interventions
  • Educate and align internal stakeholders around our policies and our approach to safety in your focus area(s)
  • Keep up to date with new and existing AI policy norms and standards, and use these to inform our decision-making on policy areas
  • You May Be a Good Fit If You Have Experience :

  • As a researcher, subject matter expert, clinician, or trust & safety professional working in one or more of the following focus areas : psychology, mental health, developmental science, or human-AI interaction. Note : For this role, an advanced degree in clinical psychology, counseling psychology, psychiatry, social work, or a related field is preferred.
  • Drafting or updating product and / or user policies, with the ability to effectively bridge technical and policy discussions
  • Crafting evidence-based and psychometrically valid definitions for emerging phenomena
  • Working with generative AI products, including writing effective prompts for policy evaluations
  • Aligning product policy decisions between diverse sets of stakeholders, such as Product, Engineering, Public Policy, and Legal teams
  • Understanding the challenges that exist in developing and implementing product policies at scale, including in the content moderation space
  • Thinking creatively about the risks and benefits of new technologies, and leverage data and research to inform policy recommendations
  • Navigating and prioritizing work efforts amidst ambiguity
  • Deadline to apply : None. Applications will be reviewed on a rolling basis.

    The expected salary range for this position is :

    Annual Salary : $190,000 - $220,000 USD

    Logistics

    Education requirements : We require at least a Bachelor's degree in a related field or equivalent experience. Location-based hybrid policy : Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

    Visa sponsorship : We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

    We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.

    How We're Different

    We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact advancing our long-term goals of steerable, trustworthy AI rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.

    The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including : GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

    Come Work With Us!

    Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage : Learn about our policy for using AI in our application process

    Create a job alert for this search

    Policy Manager • San Francisco, CA, US

    Related jobs
    Design Program Manager

    Design Program Manager

    Meta Platforms • Menlo Park, CA, US
    Full-time
    We're inspired by what's possible.At Meta, we're designing technologies that help people connect, find communities and grow businesses. And we are committed to designing and building these Meta tech...Show more
    Last updated: 30+ days ago • Promoted
    Staff Design Program Manager (Growth Design)

    Staff Design Program Manager (Growth Design)

    Grammarly • San Francisco, CA, US
    Full-time
    Staff Design Program Manager (Growth Design).Grammarly offers a dynamic hybrid working model for this role.This flexible approach gives team members the best of both worlds : plenty of focus time al...Show more
    Last updated: 30+ days ago • Promoted
    Senior Product Manager, User Engagement

    Senior Product Manager, User Engagement

    NimbleRx • Redwood City, CA, United States
    Full-time
    We are starting by building the largest, most loved pharmacy business in the world.We are a fast-growing, technology-first startup driven by perfecting the patient and pharmacist experience.Nimble ...Show more
    Last updated: 10 days ago • Promoted
    Product Manager (Digital Risk Prevention, Incident Response & Pen Test)

    Product Manager (Digital Risk Prevention, Incident Response & Pen Test)

    Fortinet • Sunnyvale, CA, United States
    Full-time
    Fortinet is looking for a Product Manager (Digital Risk Prevention, Incident Response & Pen Test) to assist our FortiRecon Team. Fortinet is the world's leading security vendor trusted by over 500,0...Show more
    Last updated: 5 days ago • Promoted
    Senior Product Design Manager, Growth & Safety

    Senior Product Design Manager, Growth & Safety

    King River Capital Group • San Francisco, CA, United States
    Full-time
    Discord is used by over 200 million people every month for many different reasons, but there’s one thing that nearly everyone does on our platform : play video games. Over 90% of our users play games...Show more
    Last updated: 9 days ago • Promoted
    Anthropic is hiring : Policy Design Manager, User Well-being in San Francisco

    Anthropic is hiring : Policy Design Manager, User Well-being in San Francisco

    Mediabistro • San Francisco, CA, United States
    Full-time
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...Show more
    Last updated: 28 days ago
    Group Product Manager, Compliance and Policy, Generative AI

    Group Product Manager, Compliance and Policy, Generative AI

    Google • Sunnyvale, CA, US
    Full-time
    Group Product Manager, Compliance And Policy, Generative AI.At Google, we put our users first.The world is always changing, so we need Product Managers who are continuously adapting and excited to ...Show more
    Last updated: 5 days ago • Promoted
    Inclusive Design Operations Manager

    Inclusive Design Operations Manager

    Yahoo! • Mountain View, CA, US
    Full-time
    Inclusive Design Operations Manager.We are seeking an experienced and passionate operations manager to join Yahoo's Inclusive Design Team. In this role, you will be pivotal in fostering a culture of...Show more
    Last updated: 30+ days ago • Promoted
    Head of UX / UI – Product Design & Experience (Philanthropic Tech) | San Francisco, CA

    Head of UX / UI – Product Design & Experience (Philanthropic Tech) | San Francisco, CA

    OSI Engineering • San Francisco, CA, United States
    Full-time
    Head of UX / UI – Product Design & Experience, Philanthropic Tech, San Francisco, CA.This role leads the creation of every interaction, screen, and emotional cue across the platform, shaping how user...Show more
    Last updated: 30+ days ago • Promoted
    Policy Design Manager, User Well-being Job at Anthropic in San Francisco

    Policy Design Manager, User Well-being Job at Anthropic in San Francisco

    Mediabistro • San Francisco, CA, United States
    Full-time
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...Show more
    Last updated: 28 days ago
    Senior Product Manager, User Data & Privacy Experience

    Senior Product Manager, User Data & Privacy Experience

    TikTok • San Jose, CA, United States
    Full-time
    Senior Product Manager, User Data & Privacy Experience.Lead the product vision and roadmap for TikTok's user-facing data subject right tools, enabling users to manage their data securely and effici...Show more
    Last updated: 30+ days ago • Promoted
    Senior Program Manager, Policy Implementation

    Senior Program Manager, Policy Implementation

    Discord • San Francisco, CA, US
    Full-time
    Senior Program Manager, Policy Implementation.Discord is used by over 200 million people every month for many different reasons, but there's one thing that nearly everyone does on our platform : pla...Show more
    Last updated: 10 days ago • Promoted
    Product Manager -?Digital Health Team

    Product Manager -?Digital Health Team

    FocusKPI • Mountain View, CA, US
    Temporary
    Product Manager - Digital Health Team.FocusKPI is seeking a Product Manager to join one of our clients, a high-tech SaaS company. Work Location : Mountain View, CA (Hybrid role, 4 days / week onsite) D...Show more
    Last updated: 11 days ago • Promoted
    Manager 3, Product Design

    Manager 3, Product Design

    Intuit Inc. • San Francisco, CA, United States
    Full-time
    The Global Business Solutions Group (GBSG) Product Growth team has expertise in anddrives impact through product-led growth. With a focus on rapid experimentation, funnel optimization, and data-driv...Show more
    Last updated: 1 day ago • Promoted
    UX Design Manager, PSS UX, Technical Risk Management

    UX Design Manager, PSS UX, Technical Risk Management

    Google Inc. • San Francisco, CA, United States
    Full-time
    UX Design Manager, PSS UX, Technical Risk Management.Google is seeking a UX Design Manager to lead a distributed team of UX Designers in the Technical Risk Management (TRM) organization.The ideal c...Show more
    Last updated: 8 days ago • Promoted
    Product Design Manager - Monetization

    Product Design Manager - Monetization

    Meta • San Francisco, CA, US
    Full-time
    Meta is seeking a Product Design Manager to lead a team of designers in creating exceptional experiences that meet the needs of our users. As a key member of our leadership team, you will collaborat...Show more
    Last updated: 1 day ago • Promoted
    Senior Manager, Product Design (Foundations)

    Senior Manager, Product Design (Foundations)

    Behavioral Health Tech, Inc. • San Francisco, CA, United States
    Full-time
    At Headway, our mission is to build a new mental healthcare system that everyone can access.Behind the magic for patients to find right and predictable care is our robust design system, insurance p...Show more
    Last updated: 10 days ago • Promoted
    Senior Product Design Manager, Growth & Safety

    Senior Product Design Manager, Growth & Safety

    Discord • San Francisco, CA, United States
    Full-time
    Discord is used by over 200 million people every month for many different reasons, but there’s one thing that nearly everyone does on our platform : . Over 90% of our users play games, spending a comb...Show more
    Last updated: 6 days ago • Promoted