Vals AI

@ValsAI

Public LLM Evaluation // vals.ai @8vc @BloombergBeta @pearvc @a16z @HRTVentures @nextladder

San Francisco, CA

vals.ai

Replies Reposts Media

Pinned
Vals AI
@ValsAI
Sep 1
Using Fable 5.1, we’ve elicited a decoding of a cipher that has been unsolved for 373 year, and listed as #28 on Klaus Schmeh’s (the most-published cryptology author in the world) “The Top 50 unsolved encrypted messages.” The solution? Almost embarrassingly simple in hindsight.
Made with AI
44
Vals AI
@ValsAI
10h
SUPERHOT is another game in our public set of games. Astra plays surprisingly well. At around 2 hours and 7 minutes, it punches an NPC, steals their gun in mid air, then shoots them.
00:00
Vals AI
@ValsAI
10h
03:01:05
Astra began to saturate a computer-use eval we haven’t even released yet. Astra was not only able to kill several hostile mobs in Minecraft, but it made it all the way to building a Nether portal in less than three hours. We believe that if we ran it longer, it would beat the
1
Vals AI
@ValsAI
10h
Astra began to saturate a computer-use eval we haven’t even released yet. Astra was not only able to kill several hostile mobs in Minecraft, but it made it all the way to building a Nether portal in less than three hours. We believe that if we ran it longer, it would beat the
00:00
11
Vals AI
@ValsAI
10h
GPT-6 Astra lands at #3 on the Vals RSI Index, ahead of GPT-5.6 Sol but behind Fable 5.1 and Opus 5.
GIF
2
Vals AI
@ValsAI
12h
Today we are releasing Tax Agent Bench, an agentic benchmark evaluating LLMs’ ability to do professional-level US corporate tax research. It consists of 391 expert-written questions with each task evaluated with a rubric developed by tax practitioners.
9