Gigabyte NVIDIA Grace Blackwell Ultra Gigabyte DLB2-CB3 GB300 NVL72 288GB NVIDIA Grace CPU (2) AI Graphics Card GPU Server module

NVIDIA GB300 NVL72: Built for the Age of AI Reasoning

The NVIDIA GB300 NVL72 features a fully liquid-cooled, rack-scale design that unifies 72 NVIDIA Blackwell Ultra GPUs and 36 Arm-based NVIDIA Grace CPUs in a single platform optimized for test-time scaling inference. AI factories powered with the GB300 NVL72 using NVIDIA Quantum-X800 InfiniBand or Spectrum-X Ethernet paired with ConnectX-8 SuperNIC provide a 50x higher output for reasoning model inference compared to the NVIDIA Hopper platform.

 Compute Tray

• 2 x NVIDIA GB300 Grace Blackwell Ultra Superchip
• 4 x 279GB HBM3E GPU memory
• 2 x 480GB LPDDR5X CPU memory
• 8 x E1.S Gen5 NVMe drive bays
• 4 x NVIDIA ConnectX-8 SuperNIC 800Gb/s OSFP ports
• 1 x NVIDIA BlueField-3 DPU

System Comparison: NVIDIA GB300 NVL72 vs. GB200 NVL72

	GB300 NVL72	GB200 NVL72
Configuration	36 Grace CPUs, 72 Blackwell Ultra GPUs	36 Grace CPUs, 72 Blackwell GPUs
FP4 Tensor Core	1,440 PFLOPS | 1,100 PFLOPS (dense)	1,440 PFLOPS | 720 PFLOPS (dense)
FP8/FP6 Tensor Core	720 PFLOPS	720 PFLOPS
INT8 Tensor Core	23 PFLOPS	720 POPS
FP16/BF16 Tensor Core	360 PFLOPS	360 PFLOPS
TF32 Tensor Core	180 PFLOPS	180 PFLOPS
FP32	5,760 TFLOPS	5,760 TFLOPS
FP64 / FP64 Tensor Core	100 TFLOPS	2,880 TFLOPS
NVLink Bandwidth	130 TB/s	130 TB/s
Fast Memory	Up to 37 TB	Up to 31 TB
GPU Memory | Bandwidth	Up to 20 TB HBM3E | Up to 576 TB/s	Up to 13.5 TB HBM3E | 576 TB/s
CPU Memory | Bandwidth	Up to 17 TB LPDDR5X | Up to 18.4 TB/s	Up to 17 TB LPDDR5X | Up to 18.4 T
CPU Cores	2,592 Arm Neoverse V2 cores	,592 Arm Neoverse V2 cores

 

Rack Specs

Dimensions	1,068L x 600W x 2,299H mm
GPU	72 x NVIDIA Blackwell Ultra GPUs
CPU	36 x NVIDIA Grace™ CPUs
Compute Tray	18 x GIGABYTE XN15-CB0-LA01
NVLink Switch Tray	9 x NVIDIA NVLink™ Switches
Management Switch	2 x OOB management switches + 1 x Optional OS switch for rack-to-rack connection
Power Shelf	6 x 1U 33kW power shelves
Bus Bar	1 x 54V DC 1400A Bus Bar
Cable Cartridge	4 x NVIDIA NVLink™ cable cartridges
CDU	Compatible with in-row or in-rack CDU

Specs

Form Factor	1U Liquid-cooled server node
Superchip	2 x NVIDIA GB300 Grace Blackwell Ultra Superchip
Storage	8 x E1.S Gen5 NVMe drive bays 1 x M.2 (2280/22110; PCIe 5.0 x4)
Networking	4 x NVIDIA ConnectX®-8 800Gb/s OSFP ports 1 x NVIDIA® BlueField®-3 DPU 1 x 1Gb/s LAN (Intel® I210-AT)
Front IO	1 x USB 3.2 Gen1, 1 x Mini-DP, 1 x RJ45, 1 x MLAN
Rear IO	4 x NVIDIA NVLink™ Switch connectors
OS Support	Ubuntu 22.04.3 arm64 Red Hat Enterprise Linux Server 9.3 aarch64 SUSE Linux Enterprise Server 15 SP5 aarch64
System Cooling	8 x 40x40x56mm fans 2 x Superchip cold plate loops