NVIDIA AD102 has more than 75 billion transistors

In recent days, there has been more and more news about the GeForce RTX 4090. NVIDIA will hold the NVIDIA GTC Conference from September 19th to 22nd, 2022, and there is a good chance that there will be information on GPUs involving the Ada Lovelace architecture.

GeForce RTX 40 TSMC N5
Recently, Twitter user @kopite7kimi revealed that the Nvidia AD102 on the GeForce RTX 4090 has more than 75 billion transistors, which is 2.65 times that of the current GA102, and only 5 billion less than the H100 based on the Hopper architecture, which is a new generation of flagship data center GPUs, which also use TSMC’s N4 process technology. While there is no way to directly compare the two architectures, both GPUs have large L2 cache structures.

It is rumored that AD102 is equipped with 18176 CUDA cores, and the corresponding number of SMs is 142, but the AD102 equipped with GeForce RTX 4090 will only open 128 SMs, that is, 16384 CUDA cores. It has 24GB of GDDR6X video memory, the video memory bit width is 384 bits, the video memory rate may reach 24Gbps, the TDP is 450W, and it will be equipped with a PCIe 5.0 external power supply interface.