Pinned
New paper from Basis' Project MARA team and collabs. The ability to learn and use world models is a key aspect of human intelligence, but evaluating this ability remains elusive. In this work we propose WorldTest, a representation-agnostic, behavior-based agent eval framework.- Our Project MARA team who led this work is looking for research scientists to join us! Link to apply below.🔥 MIT just exposed every top AI model and it’s not pretty. They built a new test called WorldTest to see if AI actually understands the world… and the results are brutal. It doesn’t just check how well a model predicts the next frame or maximizes reward it tests whether it
- New work out from our Collaborative Intelligent Systems groupNew preprint! tl;dr — We ran around late at night to record wild rats in NYC and figured out how to quantify their behavior and environment. 🧵 w/ Dima Batenkov, @zamakany, @e_mackevicius biorxiv.org/content/10.110…
