Nvidia will also offer a single rack called the GB300 NVL72 that offers 1.1 exaflops of FP4, 20TB of HBM memory, 40TB of “fast memory,” 130TB/sec of NVLink bandwidth and 14.4 TB/sec networking.

On the near horizon — H2 2025 — Nvidia will release Blackwell Ultra, a GPU that’ll come in several configurations. A single Ultra chip will offer the same 20 petaflops of AI performance as Blackwell, but with 288GB of memory — up from 192GB in vanilla Blackwell.

Its architecture is optimized for intricate AI reasoning, enabling more sophisticated and efficient processing of complex datasets. This advancement is expected to facilitate the