And just a giant GPU
Fresh flagships from NVIDIA and AMD can boast a fairly large amount of memory. But even they fade against the background of what AMD Instinct MI250 is.
The accelerator has an insane 128 GB of HBM2e video memory, while its processor area is 814 mm2. The graphics processor is even more – 1480 mm2. This is what the device itself looks like:
Among other things, it is worth noting 13,312 stream processors, 208 active computing units, as well as a 1.7 GHz GPU. In FP64 mode, the new product delivers 45.3 TFLOPS of performance, while matrix performance in FP32 mode is already 90.5 TFLOPS.
Recall that AMD Instinct MI250 was released about 6 months ago. At the same time, the device became one of the first dual-chip GPUs, which also formed the basis of the Frontier supercomputer.