NVIDIA Launches New Large Rack System GB200 NVL72 to Accelerate Generative AI Capabilities

2024-12-26 04:57
 84
Based on Blackwell, NVIDIA launched a new large rack system GB200 NVL72. The system has 72 Blackwell GPUs and 36 Grace GPUs, with 1.4 exaflops of AI performance and 30TB of fast memory. NVIDIA said that the system can deploy a model with 27 trillion parameters, while the current largest model GPT-4 has only about 1.7 trillion parameters, so it can accelerate the release of generative AI capabilities.