Human Data Lead

About METR

We are a nonprofit research organization that develops scientific methods to assess AI capabilities, risks and mitigations, with a specific focus on threats related to autonomy, AI R&D automation, and alignment. Our work advances the science of AI measurement by understanding frontier AI systems' ability to complete complex tasks without human input, and directly executing those measurements to inform risk assessments and consensus within the AI industry, among policymakers, and the public. Our work has been cited by NIST, a previous US President, the UK Government, Nature, The New York Times, and Time Magazine. Through our work with leading AI labs, governments, and academia, we ensure that our insights can quickly be leveraged to promote the safe development of increasingly powerful AI systems. We believe it is robustly good for civilization to have a clear understanding of what types of danger AI systems pose and how high the risk is, and we are extremely excited to find ambitious, excellent people to join our team and tackle one of the most important challenges of our time.

What We\'re Looking For

We\'re seeking a Human Data Lead to lead our various human data collection efforts. Systems you build will be critical for generating high-quality evidence about AI progress – in the past, related efforts were crucial for our work on developer productivity and autonomous AI agent capabilities. This role requires someone with strong operational and project management capabilities, Python fluency, and excellent communication skills for managing diverse stakeholders. You will need strong drive as well as the ability to put together solid, well-documented systems that are not overly-engineered.

What You\'ll Do

• Work with researchers to write clear specifications and data analysis plans for research involving human data.
• Design, build, and maintain end-to-end processes for human data collection and analysis.
• Strategize between METR\'s many competing human data needs.
• Build and manage external partnerships.
• Manage participant recruitment, coordination, and experience.
• Use the systems you build to execute human data campaigns.

Bonus Skills

What you will accomplish in your first 3 months

Salary $257,795 - $296,464 a year

Our Culture

METR is a mission-driven organization. We believe our work can meaningfully shape humanity\'s future for the better, and we want to be the best people in the world doing this work. We have a tight-knit, collaborative research culture rooted in truth-seeking and integrity. We\'re fiercely committed to producing high-quality, trustworthy science. We\'re honest and transparent about our results, especially when they may go against the grain. We\'ve earned trust as reliable partners who handle confidential information with care. We maintain a low-ego, drama-free environment focused on what matters.

Onsite Requirements

This role is onsite in our office in Berkeley 5 days / week. Please let us know in your application if this is a constraint. If you lack US work authorization and would like to work in-person (strongly preferred), we can likely sponsor a cap-exempt H-1B visa for this role.

Diversity and Equal Opportunity

We encourage you to apply even if your background may not seem like the perfect fit! We would rather review a larger pool of applications than risk missing out on a promising candidate for the position. We are committed to diversity and equal opportunity in all aspects of our hiring process. We do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We welcome and encourage all qualified candidates to apply for our open positions.

#J-18808-Ljbffr