Nvidia’s journey to forge the one CPU SKU to rule them all
Sometimes, you do have to pick between core count and core latency.” A balanced architecture With Vera, Nvidia sought to thread that needle to design a balanced architecture that maintains low latencies and high throughput even when all 88 cores are loaded.
- But if you ask Ian Finder, who heads development of Nvidia’s datacenter CPUs, for the vast majority of use cases, all those SKUs are overkill.
- “Nvidia is confident that it understands the market well enough that one chip will cover most use cases,” Cutress said.
- The company’s first part, called Grace, launched in 2023, but didn’t see widespread deployment outside AI headnodes, high-end NICs, and a handful of standalone CPU deployments by hyperscalers like Meta.
And at least on paper, a single SKU with 88 cores clocking to 3.3 GHz powers all of them.
In addition to showing up as part of Nvidia’s Vera-Rubin superchips, the CPU will also be offered in standalone CPU racks, storage, and context memory systems.
- The reason, in part, is that cloud providers don’t know exactly what their customers will actually be doing with those cores, and so it’s better to offer something that’s well-rounded than one that has the highest clocks or lowest latency.
- The processor is one of the few Arm chips that supports simultaneous multithreading (SMT), but the way it works differs wildly from what Intel would call Hyperthreading.
- Throughout much of AMD’s latest launch cycle, the House of Zen has argued its chips make for better agentic CPUs because agents aren’t one workload but many.
- “You could argue that Nvidia just wants to corner that bulk market.” Having said that, there are plenty of reasons to have multiple SKUs or product lines.
- Just this week, Nvidia announced a new rack with 192 Vera CPUs aimed at high-performance computing (HPC) workloads, which don’t translate well to GPUs.
How this summary was made: extractive summary — built from the sources' own reporting. It is drawn only from the reporting of the sources listed below — read the originals for full detail. How we summarize →