AMD confirms Instinct MI300X power consumption up to 750W

During the premiere event for data center and AI technologies on June 15, AMD showcased their Instinct MI300X GPU. Although the conference made no mention of this product’s power consumption, Hoang Anh Phu subsequently discovered that the Instinct MI300X, based on the OAM (OCP Accelerator Module), has a staggering power consumption of 750W, thus surpassing the 700W of NVIDIA’s Hopper H100 and becoming the most power-hungry GPU currently available.

AMD’s Instinct MI300 series, comprising the MI300A and MI300X, has the former housing both a CPU and a GPU. The CPU component employs three Zen 4 CCDs, totaling 24 cores, whereas the GPU section incorporates the latest CDNA3 architecture, and six XCD chips, and is equipped with 128GB of HBM3 memory, shared between the CPU and GPU.

The MI300X, on the other hand, replaces the CPU module with a GPU, creating a pure GPU accelerator module. It is furnished with 192GB of HBM3 memory. As the GPU module consumes more power than the CPU module, and the HBM quantity is also larger, a single OAM module draws a whopping 750W, significantly higher compared to the 560W of the preceding CDNA2 architecture’s MI250X.

Recent years have seen a marked increase in the power consumption of data center GPUs. The NVIDIA H100 SXM GPU has a TDP (Thermal Design Power) of 700W, while the air-cooled PCI-E version still requires 350W. Even the PCI-E version of the Intel Max 1550, based on the Ponte Vecchio GPU, necessitates 600W.