EvalEval Coalition

@evaluatingevals

We are a researcher community developing scientifically grounded research outputs and robust deployment infrastructure for broader impact evaluations.

evalevalai.com

Joined June 2025

Following

636

Followers

Replies Reposts Media

Pinned
EvalEval Coalition
@evaluatingevals
Feb 17
🚀 Launching Every Eval Ever: Toward a Common Language for AI Eval Reporting 🚀 A shared schema + crowdsourced repository so we can finally compare evals across frameworks and stop rerunning everything from scratch 🔧 A tale of broken AI evals 🧵👇
Every Eval Ever | EvalEval Coalition
From evalevalai.com
2
EvalEval Coalition
@evaluatingevals
Aug 14
It's time agent evals lived in one place!🏠 We’re launching Every Agent Ever (EAE), building on EveryEvalEver (EEE) to create a shared schema for reporting, storing, and analyzing agent runs. 🚀 Help us shape it! Fill out the form & join the Slack 👇
docs.google.com
[Call For Participation] Every Agent Ever
Agentic workflows are rapidly expanding across research, coding, and other domains but the metadata needed to reproduce, compare, and understand their evaluations remains fragmented. Every Agent Ever...
1
EvalEval Coalition
@evaluatingevals
Jul 29
🚀 Exciting to see Evaluating Evaluations in the media! Over the past weeks, our initiative has been featured by both @IBMResearch and @mozilla, highlighting the importance of evaluations for measuring AI progress. 📖 Mozilla: blog.mozilla.ai/from-evaluatio… 1/3
From Evaluation to Guardrails: What We Brought to ACM FAccT 2026
From blog.mozilla.ai
2
EvalEval Coalition
@evaluatingevals
Jul 8
It’s a wrap! Thanks to everyone who stopped by our posters for the questions and discussions. And to all the authors: well done! 👏👏
Avijit Ghosh
@evijit
Jul 8
3(!!!) posters down, 1 more main and 1 workshop poster to go :) #ICML2026
EvalEval Coalition
@evaluatingevals
Jul 4
🚨 Are you in San Diego for #ACL2026? So is EvalEval📍 The Second Workshop on Evaluating Evaluations is taking place today, focusing on AI evaluation in practice. ⏰ Time: 2:00 p.m 📍 Location: Harbor A
2