What we do
METR (pronounced “meter”) is a nonprofit that studies the most advanced AI agents to understand whether their developers are on track to lose control of them. We publish measurement research and applied assessments so that the public, governments, and companies can make informed decisions.
Our research has historically focused on measuring agent capabilities: what agents can do on a computer, from suggesting small code edits to fully autonomous AI research. More recently, we have also researched ways to assess whether agents might take actions no human intended, and whether those actions could be detected and contained.
We work with AI developers to apply these methods in evaluations, incident investigations, and other published assessments. Previously, we prototyped an approach for developers to scale their planned safeguards based on empirical capability measures. Many AI developers have since adopted policies built on this idea.
Our mission
METR’s mission is to discover and publish evidence about the capabilities of advanced AI systems, the associated risks, and the effectiveness of mitigations, so the world can avoid catastrophic mistakes.
At some point, AI systems will probably be able to do most of what humans can do, from running profitable businesses to developing entirely new technologies.1 The development of such systems could change the world quickly and drastically, with potential for both enormous good and enormous harm.
In particular, humanity could lose control of AI systems that are broadly more capable than us and pursue goals that conflict with our interests.2 Most people don’t want this outcome, but it could still happen unintentionally: decision-makers might not see danger coming, or some might see danger but fail to coordinate on averting it.
It’s hard to predict exactly when or how this could happen, and events could unfold too quickly for people to respond once danger is obvious. Given this, the world needs evidence-backed early warnings, along with ways to verify what AI developers are doing to reduce risk. That depends on visibility into AI development and on independent institutions that can analyze the evidence. We hope to help provide both.
COI policy
It is our highest priority that our assessments of companies are accurate and impartial. We are committed to mitigating conflicts of interest where possible, and disclosing any unmitigated conflicts in our reports for these assessments. Read our full conflict of interest policy here.
Partnerships
We have previously partnered with OpenAI, Anthropic, Google DeepMind, Meta and Amazon to pilot frontier risk assessments. For our current principles for these engagements, see our approach to working with AI companies. These companies have also provided access and tokens, which we use for evaluations, research, and engineering.
We are also part of the NIST AI Safety Institute Consortium and California Cybersecurity Task Force, are partnering with the AI Security Institute, and provide technical assistance to the European AI Office.
Funding
METR is funded by donations. We are grateful to METR’s many supporters: from METR’s first institutional-scale funding through The Audacious Project (a funding initiative housed at TED); to individuals from Jane Street; foundations such as the Sijbrandij Foundation, The Pew Charitable Trusts, Schmidt Sciences, the Packard Foundation, LaCentra-Sumerlin Foundation, Astralis Foundation and Expa.org; the AI Security Institute; pooled funds such as those of Longview Philanthropy and Effektiv Spenden; recommendations by the Survival and Flourishing Fund; and many others, such as David Farhi, Geoff Ralston, Dylan Field and Steve Newman.
Please consider joining them here. (Note: METR cannot accept donations made by or at the direction of frontier AI company employees.)
Additionally, a small part of our income is from a technical assistance contract with the European AI Office, supporting their approach and technical methods for assessing loss of control risks. METR has not accepted funding from AI companies, though we make use of significant free tokens, which we use for evaluations, research, and engineering, as noted above. Independent funding has been crucial for our ability to pursue the most promising research directions and set standards for evidence-based understanding of risks from AI. It is also part of how we ensure that our research is as accurate as possible.
Leadership
Technical Staff
Operations Staff
Policy Staff
Advisors
Research Collaborators
Specialist Partners
-
Previous versions of this page included “finding new cybersecurity exploits and fixes” in this list. AI systems can now do this. ↩
-
Goal-directed behavior may emerge in AI systems, and superficial attempts to align ML systems can result in sycophantic or deceptive behavior rather than successful alignment. ↩