"OpenAI appears to be optimizing around a different scarce resource: not money, and not floor space, but electricity. Once power becomes the hard ceiling, tokens per watt starts looking like the real currency of AI infrastructure."
SemiAnalysis wrote a super long piece on OpenAI's Jalapeño chip.
Some revelations
- OpenAI may be designing infrastructure for: models measured in tens of trillions of parameters or context windows containing millions of tokens.
- They questioned if CUDA can survive when AI
"Anthropic is expected to tell IPO investors that its total addressable market exceeds $30 trillion. That's roughly the entire GDP of the United States"
#WTF
🦔Anthropic is expected to tell IPO investors that its total addressable market exceeds $30 trillion. That's roughly the entire GDP of the United States. TAM is the revenue a company could theoretically earn if it captured 100% of its market, and Anthropic is defining that market