Last year, @AnthropicAI projected 2 GW for a single frontier training run in 2027, and 5 GW in 2028:
anthropic.com/news/build-ai-…
Those numbers sounded absurd at the time. Yet 400K gets it close to 1 GW. At this pace, 2 GW by 2027 no longer sounds far-fetched.
Replying to @ChaseLochmiller and @OpenAI
GPT-6 Astra, trained on ~100K+ NVIDIA Grace Blackwell NVLink72. From ChatGPT to o1 to Astra in 4 years.
AGI has arrived. Congratulations @OpenAI team.
400K GPUs coming online next.
