EvalEval Coalition (@evaluatingevals) / X

EvalEval Coalition

130 posts

EvalEval Coalition

@evaluatingevals

We are a researcher community developing scientifically grounded research outputs and robust deployment infrastructure for broader impact evaluations.

Joined June 2025

Pinned
EvalEval Coalition
@evaluatingevals
Feb 17
🚀 Launching Every Eval Ever: Toward a Common Language for AI Eval Reporting 🚀 A shared schema + crowdsourced repository so we can finally compare evals across frameworks and stop rerunning everything from scratch 🔧 A tale of broken AI evals 🧵👇
Every Eval Ever | EvalEval Coalition
From evalevalai.com
EvalEval Coalition
@evaluatingevals
Jul 29
🚀 Exciting to see Evaluating Evaluations in the media! Over the past weeks, our initiative has been featured by both @IBMResearch and @mozilla, highlighting the importance of evaluations for measuring AI progress. 📖 Mozilla: blog.mozilla.ai/from-evaluatio… 1/3
From Evaluation to Guardrails: What We Brought to ACM FAccT 2026
From blog.mozilla.ai
EvalEval Coalition
@evaluatingevals
Jul 8
It’s a wrap! Thanks to everyone who stopped by our posters for the questions and discussions. And to all the authors: well done! 👏👏
Avijit Ghosh
@evijit
Jul 8
3(!!!) posters down, 1 more main and 1 workshop poster to go :) #ICML2026
EvalEval Coalition
@evaluatingevals
Jul 4
🚨 Are you in San Diego for #ACL2026? So is EvalEval📍 The Second Workshop on Evaluating Evaluations is taking place today, focusing on AI evaluation in practice. ⏰ Time: 2:00 p.m 📍 Location: Harbor A
EvalEval Coalition
@evaluatingevals
Jul 2
Interested in the latest research on AI evaluations and heading to #ACL2026 or #ICML2026? ✈️ We went through the accepted papers and curated a selection worth checking out if you’re interested in #AI #evaluations, #benchmarking, evaluation #methodology, and #measurement. 🧵👇