Artificial Analysis

@ArtificialAnlys

Independent analysis of AI

San Francisco

artificialanalysis.ai

Joined January 2024

Replies Articles Media

Pinned
Artificial Analysis
@ArtificialAnlys
Jul 6, 2024
Thanks for the support @AndrewYNg! Completely agree, faster token generation will become increasingly important as a greater proportion of output tokens are consumed by models, such as in multi-step agentic workflows, rather than being read by people.
Andrew Ng
@AndrewYNg
Jul 6, 2024
Shoutout to the team that built artificialanalysis.ai . Really neat site that benchmarks the speed of different LLM API providers to help developers pick which models to use. This nicely complements the LMSYS Chatbot Arena, Hugging Face open LLM leaderboards and Stanford's HELM
Artificial Analysis
@ArtificialAnlys
19h
Grok 4.6 made large gains on AA-Briefcase, our agentic knowledge work benchmark and cost substantially less than other leading models AA-Briefcase tests models on long-horizon agentic knowledge work tasks. The test set is private to prevent contamination. Grok 4.6 is neck and
Artificial Analysis
@ArtificialAnlys
19h
Korean AI lab Upstage has released Solar Pro 4, scoring 42 on the Artificial Analysis Intelligence Index, a significant increase from Solar Pro 3’s 14 Solar Pro 4 is @upstageai's new proprietary flagship reasoning model, replacing Solar Pro 3 from April 2026. At 42 on the
Artificial Analysis
@ArtificialAnlys
21h
SpaceXAI's Grok 4.6 scores 61 on the Artificial Analysis Intelligence Index, joining the frontier in line with GPT-5.6 Sol, with standout agentic performance at lower cost Grok 4.6 gains 5 points over Grok 4.5 on the Intelligence Index just over one month after its release, or
Artificial Analysis
@ArtificialAnlys
Aug 12
Ant Group has released Ling 3.0 Tiny, which scores 25 on the Artificial Analysis Intelligence Index. With just 7.9B total and 1.3B active parameters, it sits on the Pareto frontier for Intelligence vs. Active Parameters @AntLingAGI has released Ling 3.0 Tiny, an open weights