About METR
Model Evaluation and Threat Research

What we do

METR (pronounced “meter”) is a nonprofit that studies the most advanced AI agents to understand whether their developers are on track to lose control of them. We publish measurement research and applied assessments so that the public, governments, and companies can make informed decisions.

Our research has historically focused on measuring agent capabilities: what agents can do on a computer, from suggesting small code edits to fully autonomous AI research. More recently, we have also researched ways to assess whether agents might take actions no human intended, and whether those actions could be detected and contained.

We work with AI developers to apply these methods in evaluations, incident investigations, and other published assessments. Previously, we prototyped an approach for developers to scale their planned safeguards based on empirical capability measures. Many AI developers have since adopted policies built on this idea.

Our mission

METR’s mission is to discover and publish evidence about the capabilities of advanced AI systems, the associated risks, and the effectiveness of mitigations, so the world can avoid catastrophic mistakes.

At some point, AI systems will probably be able to do most of what humans can do, from running profitable businesses to developing entirely new technologies.1 The development of such systems could change the world quickly and drastically, with potential for both enormous good and enormous harm.

In particular, humanity could lose control of AI systems that are broadly more capable than us and pursue goals that conflict with our interests.2 Most people don’t want this outcome, but it could still happen unintentionally: decision-makers might not see danger coming, or some might see danger but fail to coordinate on averting it.

It’s hard to predict exactly when or how this could happen, and events could unfold too quickly for people to respond once danger is obvious. Given this, the world needs evidence-backed early warnings, along with ways to verify what AI developers are doing to reduce risk. That depends on visibility into AI development and on independent institutions that can analyze the evidence. We hope to help provide both.

COI policy

It is our highest priority that our assessments of companies are accurate and impartial. We are committed to mitigating conflicts of interest where possible, and disclosing any unmitigated conflicts in our reports for these assessments. Read our full conflict of interest policy here.

Partnerships

We have previously partnered with OpenAI, Anthropic, Google DeepMind, Meta and Amazon to pilot frontier risk assessments. For our current principles for these engagements, see our approach to working with AI companies. These companies have also provided access and tokens, which we use for evaluations, research, and engineering.

We are also part of the NIST AI Safety Institute Consortium and California Cybersecurity Task Force, are partnering with the AI Security Institute, and provide technical assistance to the European AI Office.

Funding

METR is funded by donations. We are grateful to METR’s many supporters: from METR’s first institutional-scale funding through The Audacious Project (a funding initiative housed at TED); to individuals from Jane Street; foundations such as the Sijbrandij Foundation, The Pew Charitable Trusts, Schmidt Sciences, the Packard Foundation, LaCentra-Sumerlin Foundation, Astralis Foundation and Expa.org; the AI Security Institute; pooled funds such as those of Longview Philanthropy and Effektiv Spenden; recommendations by the Survival and Flourishing Fund; and many others, such as David Farhi, Geoff Ralston, Dylan Field and Steve Newman.

Please consider joining them here. (Note: METR cannot accept donations made by or at the direction of frontier AI company employees.)

Additionally, a small part of our income is from a technical assistance contract with the European AI Office, supporting their approach and technical methods for assessing loss of control risks. METR has not accepted funding from AI companies, though we make use of significant free tokens, which we use for evaluations, research, and engineering, as noted above. Independent funding has been crucial for our ability to pursue the most promising research directions and set standards for evidence-based understanding of risks from AI. It is also part of how we ensure that our research is as accurate as possible.

Leadership

Technical Staff

Ajeya Cotra
Ajeya Cotra
Technical Staff
Bruce Lee
Bruce Lee
Technical Staff
David Rein
David Rein
Technical Staff
Dmitrii Calzago
Dmitrii Calzago
Technical Staff
Jean-Stanislas Denain
Jean-Stanislas Denain
Technical Staff
Jonathan Gabor
Jonathan Gabor
Technical Staff
Josh Engels
Josh Engels
Technical Staff
Lena Hickson Long
Lena Hickson Long
Technical Staff
Lev McKinney
Lev McKinney
Technical Staff
Lucas Sato
Lucas Sato
Technical Staff
Manish Shetty
Manish Shetty
Technical Staff
Matt Putz
Matt Putz
Technical Staff
Megan Kinniment
Megan Kinniment
Technical Staff
Oscar Sykes
Oscar Sykes
Technical Staff
Paarth Shah
Paarth Shah
Technical Staff
Pip Arnott
Pip Arnott
Technical Staff
Rafael Carvalho
Rafael Carvalho
Technical Staff
Reilly Haskins
Reilly Haskins
Technical Staff
Rif A. Saurous
Rif A. Saurous
Technical Staff
Rowan Huang
Rowan Huang
Technical Staff
Ryan Greenblatt
Ryan Greenblatt
Technical Staff
Spruce Bondera
Spruce Bondera
Technical Staff
Thomas Broadley
Thomas Broadley
Technical Staff
Tim Hua
Tim Hua
Technical Staff
Tom Cunningham
Tom Cunningham
Technical Staff

Operations Staff

Bhaskar Chaturvedi
Bhaskar Chaturvedi
Operations Staff
Jingyi Wang
Jingyi Wang
Operations Staff
Kris Chari
Kris Chari
Operations Staff
Parv Mahajan
Parv Mahajan
Operations Staff
Rae She
Rae She
Operations Staff
Stephanie Palla
Stephanie Palla
Director of Operations
Wilder Seitz
Wilder Seitz
Operations Staff

Policy Staff

Advisors

Research Collaborators

Specialist Partners

  1. Previous versions of this page included “finding new cybersecurity exploits and fixes” in this list. AI systems can now do this. ↩

  2. Goal-directed behavior may emerge in AI systems, and superficial attempts to align ML systems can result in sycophantic or deceptive behavior rather than successful alignment. ↩