1. X
  2. Vals AI
Log inSign up
Vals AI
1,429 posts
Image
user avatar
Vals AI
@ValsAI
Public LLM Evaluation // vals.ai @8vc @BloombergBeta @pearvc
San Francisco, CA
vals.ai
Joined March 2024
267
Following
13.7K
Followers
AffiliatesAffiliatesRepliesRepliesMediaMedia

New to X?

Sign up now to get your own personalized timeline!

Create account

By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.

TermsยทPrivacyยทCookiesยทAccessibilityยทAds Infoยทยฉ 2026 X Corp.
Don't miss what's happening
People on X are the first to know.
Log inSign up
  • user avatar
    Vals AI
    @ValsAI
    5h
    Vals was just cited in @nytimes! We were quoted on Kimi K3โ€™s capabilities and where it ranks on the Vals Index. Check it out
    The Moonshot AI booth at the World Artificial Intelligence Conference on Friday in Shanghai. The companyโ€™s Kimi K3 model performed as well at some tasks as the leading models from U.S. firms.
    Chinaโ€™s Moonshot AI Unveils Kimi Model, Threatening Americaโ€™s Lead
    From nytimes.com
    9310931
  • user avatar
    Vals AI
    @ValsAI
    10h
    When will MiniMax have a Fable level model? @olive_jy_song, research lead at @MiniMax_AI, joins The Bench to answer that question, plus M3, open source models closing the gap on Vibe Code Bench, and the truth about 996 culture. Full episode out now! 7:19 โ€“ Inside MiniMax's
    Image
    00:00
    35K035K
  • user avatar
    Vals AI
    @ValsAI
    Jul 16
    Moonshot just made history. Kimi K3 is the #2 overall model on the Vals Index, surpassing GPT 5.6 Sol and only slightly behind Fable 5 on the Vals Index.
    Image
    94K094K
    user avatar
    Vals AI
    @ValsAI
    Jul 16
    Replying to @ValsAI and @Kimi_Moonshot
    To see how it did on the Vals Index, visit
    Image
    Vals AI: Kimi K3
    From vals.ai
    2.2K02.2K
    user avatar
    Vals AI
    @ValsAI
    Jul 16
    *The quantity of cached tokens, and thus the cost, was not available at the time of eval, so costs are marked as N/A on our site
    1.6K01.6K
  • user avatar
    Vals AI
    @ValsAI
    Jul 16
    Thinking Machines just released their first model, Inkling, and it debuts at #8 among open source models on the Vals Index.
    Image
    4.2K04.2K
    user avatar
    Vals AI
    @ValsAI
    Jul 16
    Replying to @ValsAI
    Inkling supports a 256k context window, has 256k output tokens, image inputs, and tool calling. We used Thinking Machines' recommended evaluation settings: temperature 1, top-p 1, separate reasoning enabled, and reasoning effort set to 0.99.
    5980598
    user avatar
    Vals AI
    @ValsAI
    Jul 16
    Congrats to the @thinkymachines team on their first release! Full results coming soon. To see the Index results, visit
    Image
    Vals AI: Inkling
    From vals.ai
    4530453
  • Vals AI reposted
    user avatar
    Nikil Ravi
    Vals AI
    @nikilravi
    Jul 14
    Nice post discussing calling for a third party standards body! A fun thought experiment here is: suppose this magically happened tomorrow, and you were designated the third party body in charge of testing frontier models. What concrete set of benchmarks or testing framework
    user avatar
    Demis Hassabis
    @demishassabis
    Jul 14
    Article cover image
    Article
    A Framework for Frontier AI and the Dawning of a New Age
    This is a pivotal moment in human history. Artificial General Intelligence (AGI), a system that exhibits all the cognitive capabilities the brain has, is probably only a few short years away. When we...
    1.5K01.5K
  • Vals AI reposted
    user avatar
    spicylemonade
    @spicey_lemonade
    Jul 15
    One month ago I asked mythos 5 to predict the World Cup. It predicted a Spain vs Argentina final with Spain winning.
    user avatar
    spicylemonade
    @spicey_lemonade
    Jun 11
    I asked mythos 5 max to predict the entire 2026 World Cup. Here are its predictions. It predicts a Spain x Argentina Final with Spain winning. Lets see how it holds up..
    Image
    1.4K01.4K
  • user avatar
    Vals AI
    @ValsAI
    Jul 13
    We usually set the hills to climb, but sometimes we climb them ourselves ๐Ÿ”๏ธ Some of the Vals team did the Dipsea Trail this weekend. Couldn't have asked for a better crew! Want to join the team? ๐Ÿ’ผ We're hiring for: - Member of Technical Staff, Research - Member of Technical
    Image
    Image
    Image
    Image
    5.3K05.3K
  • user avatar
    Vals AI
    @ValsAI
    Jul 10
    In case you missed it, this was a big week for model releases. Grok 4.5, GPT-5.6 Sol, and Muse Spark 1.1 all landed within days of each other, and all three cracked the top 10 on the Vals Index. The pace of progress right now is hard to overstate. Here's our week in review
    Image
    6.3K06.3K
Advertisement
Advertisement