If GenAI is going to go mainstream and not just be a bubble that helps prop up the global economy for a couple of years, AI inference is going to have to come down in price – and do so faster than it has done thus far. Token generation is …
As the year came to an end, we tore apart IDC’s assessments for server spending, including the huge jump in accelerated supercomputers for running GenAI and more traditional machine learning workloads and as this year got started, we did forensic analysis and modeling based on the company’s reckoning of Ethernet …
AI is having a seismic impact on processes across all industries, speeding things up and driving costs down. And digital twins aren’t immune to the tectonics. McKinsey & Co wrote that creating a digital twin for such specialized applications like routing vehicles or creating a production schedule for multiple machines …
But virtue of its scale out capability, which is key for driving the size of absolutely enormous AI clusters, and to its universality, Ethernet switch sales are booming, and if the recent history is any guide, we can expect Ethernet revenues will climb exponentially higher in the coming quarters as …
In the early days of D-Wave’s history, the company made a decision to pursue annealing as its first technology to build a quantum computer because it promised to offer the fastest path to commercial quantum computing. That’s what Trevor Lanting, the company’s chief development officer, reminded us this week as …
Under Lisa Su’s more than eleven years as AMD’s chief executive officer, the company has returned from Opteron exile to be a formidable CPU foe to Intel in the datacenter, due in large part to the innovation around its Zen microarchitecture and Epyc server chips driven by Su, chief technology …
Having an annual cadence for the improvement of AI systems is a great thing if you happen to be buying the newest iron at exactly the right time. But the quick pace of improvement of Nvidia’s rackscale AI systems and the scale-out networks to massively embiggen them also means that …
Featuring highlights, analysis, and stories from the week directly from us to your inbox with nothing in between.
Subscribe now
The number of AI inference chip startups in the world is gross – literally gross, as in a dozen dozens. But there is only one that is funded by two of the three biggest makers of HBM stacked memory and backed by the two biggest telecom companies in its indigenous …
If there was ever a demonstration of Jevons’ paradox, it’s the supercomputing sector. According to this law of economics, consumption rises, rather than falls, with production efficiency. William Stanley Jevons conceived it in the 1860s as developments like the Watt steam engine made coal more efficient. Attracted to cheaper energy, …
A total addressable market is a forecast of what will be sold – more precisely, what can be manufactured and sold. It is not a forecast of aggregate demand, which can be even larger as the backlogs for HBM memory and its main propellant, GPU and XPU compute for AI …
It has always been funny to us that anyone can acquire control of an open source project. But it definitely happens because, in the final analysis, people need to get paychecks to live and some company somewhere has to cut those checks. Sometimes, an open source project is supported out …
AI is changing what “good” looks like in the modern datacenter. It is not just a question of buying faster hardware. Power ceilings, rack density, cooling, and day-to-day operations are becoming first-order design constraints, especially as organizations move from pilots to always-on AI workloads. In this Video Hot Seat, Tim …
An alien flying in from space aboard a comet would look down on Earth and see that there is this highly influential and famous software company called Nvidia that just so happens to have a massively complex and ridiculously profitable hardware business running a collection of proprietary and open source …
The way that organizations plan, design and run a datacenter was already under pressure. AI has turned that pressure into a once-in-generation stress test, one that is inspiring a top-to-bottom rethink of what the datacenter does, how it does it, and where. “What we’re seeing now is seismic,” says Dave …
We can all talk until we are blue in the face about how weird it is for so much money to be spent on servers during the GenAI boom, but after reviewing the latest market report from IDC – which is one again but sporadically giving out some stats to …
While there are a lot of different file system and object storage options available for HPC and AI customers, many AI organizations and a lot of traditional HPC simulation and modeling centers choose either the open source Lustre parallel file system or the modern variants of IBM’s General Parallel File …
All Content Copyright The Next Platform
