Talent.com
Research Stream Lead
Research Stream LeadMetr • Berkeley, CA, United States
Research Stream Lead

Research Stream Lead

Metr • Berkeley, CA, United States
24 days ago
Job type
  • Full-time
Job description

Referral Bonus

We are offering a $21k referral bonus for this role. You can refer people through our form, and it lists the terms of this bonus.

About METR

We are a nonprofit research organization that develops scientific methods to assess AI capabilities, risks and mitigations, with a specific focus on threats related to autonomy, AI R&D automation, and alignment.

We believe it is robustly good for civilization to have a clearer understanding of what dangers AI systems pose, and we are extremely excited to find ambitious, excellent people to join our team and tackle one of the most important challenges of our time.

We evaluate candidates primarily through (paid) work tests. We usually do an in-person trial as well but can be flexible about this.

Role Mission : Lead a team and own one of the key areas needed to understand the level of risk from future models

Example research areas :

  • How can we tell models aren’t undermining our evaluations by sandbagging or alignment faking?
  • How much cognition can models do without revealing it in their reasoning traces?
  • How close are models to being able to sabotage research at AI companies or at METR?
  • How reliable are safety claims made by AI developers based on new techniques, e.g. activation steering?
  • What egregiously misaligned behaviors do models display? How good are monitors at picking up on this, or do they tend to collude with (or get exploited by) the agents?
  • Build model organisms or red-teaming approaches to test the robustness of METR’s or external evaluations and safety measures

What the job involves

  • Collaborate with other research streams to identify the questions that need to be answered for METR to be able to accurately assess catastrophic risk from models in the near and longer-term future.
  • Lead research to answer these questions as cheaply and effectively as possible, trading off between being scrappy and careful in the right places.
  • Significantly improve METR's risk reports based on the research your team has done.
  • Publish 'fundamental' research that’s similarly impactful to the time horizon methodology. Your team's work makes foundational progress, improves collective understanding of the relevant phenomena, and becomes the standard way to think and talk about it, for METR and our target audience (highly informed and engaged people but who may be skeptical of AI risk or of METR).
  • Maintain METR’s high-integrity culture - communicate research accurately and don’t overhype - even critics or skeptics generally praise the work's quality.
  • Build a strong team, identify talent needs and be an effective hiring manager, maintain high standards of performance on your team, grow and empower top performers.
  • Lead team effectively, get people excited about and bought into goals, maintain motivation and momentum.
  • Maintain high research velocity : we're generally learning meaningful new things every week or two (unless we're explicitly investing in a large high-payoff project we've derisked).
  • The ideal candidate has experience leading high-performing research teams working with frontier ML systems, such as alignment, post-training, interpretability, or frontier evaluations. Other promising candidate profiles

  • Experience as a research manager in an ML related area (or a technical non-ML field like quantitative trading while also keeping up with relevant ML / AI safety literature)
  • Experience as a technical engineering manager, including with some experience with fast-moving / scrappy research workflows
  • Track record of high-quality ML research, with clear evidence of multiple impactful research outputs (such as papers, blog-posts, etc.) where you are a key contributor. These works feature well-designed methodology or experiments, are well-written, and clearly and carefully communicated without overstating results.
  • High quality output that's highly relevant to METR's work. You have public research, writing, code or some other artifact that demonstrates your careful thinking, deep understanding of and ability to make progress on METR’s research directions.
  • Evidence of outstanding achievement. You have some other impressive achievement that demonstrates you have the relevant skills or can learn very quickly, such as founding a successful startup, having widely-used open-source projects, or having made scientific contributions outside your area of expertise. These are not exhaustive and we'd be excited to hear about other evidence of outstanding achievements!
  • Salary range : $250,000 - $450,000 a year (base)

    Benefits

  • The office : Catered lunch and dinner daily; in-office gym and shower
  • Relocation support : Stipend for moving to the Bay Area
  • Time-off and leave : Unlimited PTO and 21-week parental leave for new parents
  • Commuter benefit : Monthly transit / parking stipend and an annual Uber budget
  • Professional development benefit : for training, courses, conferences, and AI safety education
  • Mental health benefit : for therapy, medication, and other mental health expenses
  • Wellness benefit : for gym memberships and other wellness expenses
  • Work equipment benefit : for home office and workstation equipment expenses
  • Our Culture

    METR is a mission-driven organization. We believe our work can meaningfully shape humanity's future for the better, and we want to be the best people in the world doing this work. We have a tight-knit, collaborative research culture rooted in truth-seeking and integrity. We're fiercely committed to producing high-quality, trustworthy science. We're honest and transparent about our results, especially when they may go against the grain. We've earned trust as reliable partners who handle confidential information with care. We maintain a low-ego, drama-free environment focused on what matters.

    Hybrid Requirements

    Our technical team members are in our office in Berkeley 3-5 days / week. Please let us know in your application if this is a constraint. If you lack US work authorization and would like to work in-person (strongly preferred), we can likely sponsor a cap-exempt H-1B visa for this role.

    We encourage you to apply even if your background may not seem like the perfect fit! We would rather review a larger pool of applications than risk missing out on a promising candidate for the position.

    We are committed to diversity and equal opportunity in all aspects of our hiring process. We do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We welcome and encourage all qualified candidates to apply for our open positions.

    #J-18808-Ljbffr

    Create a job alert for this search

    Research Lead • Berkeley, CA, United States

    Similar jobs
    Epic Decision Tree Analyst

    Epic Decision Tree Analyst

    VirtualVocations • Oakland, California, United States
    Full-time
    A company is looking for an Epic Decision Tree Analyst to join their team.Key Responsibilities Drive strategic process improvement and manage complex projects Provide clients with straightforwar...Show more
    Last updated: 2 days ago • Promoted
    Senior Director, Data and AI Architecture Leader

    Senior Director, Data and AI Architecture Leader

    Dynavax Technologies • Emeryville, CA, United States
    Full-time
    This position can be 100% remote, but must be located in the United States.Dynavax is a commercial-stage biopharmaceutical company developing and commercializing novel vaccines to help protect the ...Show more
    Last updated: 30+ days ago • Promoted
    Research Stream Lead

    Research Stream Lead

    Metr • Berkeley, California, United States
    Full-time
    Referral Bonus We are offering a $21k referral bonus for this role.You can refer people through our form, and it lists the terms of this bonus. About METR We are a nonprofit research organization th...Show more
    Last updated: 24 days ago • Promoted
    Science Editor

    Science Editor

    Bio-Rad Laboratories • Hercules, CA, United States
    Full-time
    Bio-Rad is seeking a Science Editor to join its global Brand and Marketing Communications Department.The Technical Editor will play a key role in ensuring consistency and quality of materials (prim...Show more
    Last updated: 30+ days ago • Promoted
    Senior Institutional Research Analyst (5876U), Planning & Analysis Office - 83533

    Senior Institutional Research Analyst (5876U), Planning & Analysis Office - 83533

    InsideHigherEd • Berkeley, California, United States
    Full-time
    Senior Institutional Research Analyst (5876U), Planning & Analysis Office - 83533.At the University of California, Berkeley, we are dedicated to fostering a community where everyone feels welcome a...Show more
    Last updated: 2 days ago • Promoted
    Data Analyst

    Data Analyst

    Quality Talent Group • Napa, California, United States
    Full-time
    Our client is a leading force in advancing safer, smarter AI technology.Their work has been featured in.They have built a global community of expert contributors and have paid more than.No contract...Show more
    Last updated: 20 days ago • Promoted
    Travel Clinical Lab Scientist (CLS) - $2,120 to $2,280 per week in Napa, CA

    Travel Clinical Lab Scientist (CLS) - $2,120 to $2,280 per week in Napa, CA

    AlliedTravelCareers • Napa, CA, US
    Full-time
    AlliedTravelCareers is working with Acruex Health to find a qualified CLS in Napa, California, 94558!.The Clinical Laboratory Scientist performs complex laboratory testing and analysis to assist in...Show more
    Last updated: 11 days ago • Promoted
    Pathology opportunity at our Regional Laboratory Berkeley

    Pathology opportunity at our Regional Laboratory Berkeley

    Kaiser Permanente - The Permanente Medical Group, Inc. -Northern California • Berkeley, US
    Full-time
    Reduced schedules (with pro-rated compensation) may be available.Some incentive opportunities are estimates based on potential premium pay. The Permanente Medical Group, Inc.American Medical Special...Show more
    Last updated: 30+ days ago • Promoted
    Compliance Analyst I

    Compliance Analyst I

    VOLEON • Berkeley, CA, United States
    Full-time
    Voleon is a technology company that applies state-of-the-art AI and machine learning techniques to real-world problems in finance. For nearly two decades, we have led our industry and worked at the ...Show more
    Last updated: 2 days ago • Promoted
    Associate Researcher

    Associate Researcher

    SPECTRAFORCE • South San Francisco, CA, US
    Full-time
    The contractor Research Associate will work closely with the Analytical Development team in the Tech Dev department to help methods development and test samples utilizing PCR, ELISA, Gel Electropho...Show more
    Last updated: 1 day ago • Promoted
    Head of Research

    Head of Research

    Sankhara • Sonoma, CA, US
    Full-time
    Sankhara is a groundbreaking private equity fund dedicated to collecting, protecting and preserving the human experience through extraordinary physical assets. Rare books, maps, religious artifacts,...Show more
    Last updated: 1 day ago • Promoted
    Research Scientist

    Research Scientist

    Goliath Partners • Sonoma, CA, US
    Full-time
    Goliath has partnered with a firm specializing in inference for AI generation (focus on AI Video).They have opened a requirement in San Francisco for a 1-2 day hybrid Research.Working with pretrain...Show more
    Last updated: 18 days ago • Promoted
    AI & Biosecurity Research Resident

    AI & Biosecurity Research Resident

    RAND Corporation • San Francisco, CA, United States
    Temporary
    Center on AI, Security, and Technology (CAST).Global and Emerging Risks (GER) Division conducts cutting-edge research on transformative, high-impact technologies-including artificial intelligence a...Show more
    Last updated: 4 hours ago • Promoted • New!
    Travel Clinical Lab Scientist (CLS)

    Travel Clinical Lab Scientist (CLS)

    LanceSoft • Napa, CA, US
    Permanent
    LanceSoft is seeking a travel Clinical Lab Scientist (CLS) for a travel job in Napa, California.Job Description & Requirements. Mid 5x8-hour (14 : 30 – 22 : 00).ASCP-MLS • and State license req...Show more
    Last updated: 14 days ago • Promoted
    AI Research Lead

    AI Research Lead

    Pantera Capital • San Francisco, CA, United States
    Full-time
    Perplexity is seeking an exceptional AI Research Tech Lead to drive our research strategy and lead the development of our in-house Online LLMs, the Sonar models. In this leadership role, you will se...Show more
    Last updated: 30+ days ago • Promoted
    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Remote Investment Analyst – AI Trainer ($50-$60 / hour)

    Data Annotation • Napa, California
    Remote
    Full-time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more
    Last updated: 30+ days ago • Promoted
    Travel Nurse - RN - Infection Control - $2777 / Week - Hiring Now

    Travel Nurse - RN - Infection Control - $2777 / Week - Hiring Now

    Fusion Medical Staffing • Sonoma, CA, US
    Full-time
    Fusion Medical Staffing is seeking an experienced Infection Control Registered Nurse for an exciting Travel Nursing job in Sonoma, CA. Shift : Inquire Start Date : 01 / 05 / 2026 Duration : 13 weeks Pay : $...Show more
    Last updated: 23 days ago • Promoted
    Machine Learning Research Lead, Security & Policy Research Lab

    Machine Learning Research Lead, Security & Policy Research Lab

    Scale AI, Inc. • San Francisco, CA, United States
    Full-time
    As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems.Building on this expertis...Show more
    Last updated: 30+ days ago • Promoted