AMD may bring Instinct MI350 series this year

Recently, the United States government amended its latest regulatory statutes, specifically targeting chips primarily used for Artificial Intelligence (AI) and High-Performance Computing (HPC). The APP ban, which took effect on April 4, signifies a further intensification of regulatory oversight, adopting more stringent control measures.

The models subject to export control include a plethora of data center products from Nvidia and AMD, such as the NVIDIA A100/H100/A800/H800/L40/L40S/RTX 4090, and the AMD Instinct MI250/300 series, in addition to next-generation products like the NVIDIA H200/B100/B200/GB200 and AMD Instinct MI350 series.

According to a report by TrendForce, the Instinct MI350 series, slated for release in the latter half of this year, represents an upgraded iteration of the Instinct MI300 series. These units are manufactured using TSMC’s 4nm process technology, aiming to deliver enhanced performance and reduced power consumption. The transition to HBM3E memory, from HBM3, boasts a 50% increase in speed. It’s speculated that AMD may employ a 12-layer stacking of HBM3E, augmenting both bandwidth and capacity.

During an event titled “Advancing AI” on December 6, 2023, AMD unveiled the Instinct MI300 series, initially offering two products: the Instinct MI300A (CPU+GPU) and the Instinct MI300X (GPU only). Reflecting on the period since their release, the Instinct MI300 series has seen commendable sales. Dr. Lisa Su, CEO of AMD, has projected that AMD’s AI chip sales are expected to reach $3.5 billion in 2024, surpassing the prior forecast of $2 billion.

Reports more than a month ago indicated that AMD planned to update the Instinct MI300 series, incorporating HBM3E. Despite the higher cost associated with the shift to HBM3E, the Instinct MI350 series remains competitively priced lower than Nvidia’s offerings, maintaining a cost advantage.