NVIDIA HGX B300 NVL8 AI Server (AMD EPYC Turin Platform)
8U ASRock Rack TRAINING / INFERENCE / LLM / HPC / AI FACTORY
The 8U16X-TURIN2 B300 is an ASRock Rack 8U rack-mount AI training server on a dual-socket AMD EPYC Turin (9005 series) platform, paired with the NVIDIA HGX B300 NVL8 GPU module and NVIDIA NVLink interconnect. The AMD platform brings higher core counts and memory bandwidth, suiting training pipelines where data pre-processing runs alongside GPU compute. With 32 DDR5 DIMM slots, front hot-swap PCIe 5.0 NVMe drive bays and 6+6 redundant 3000W 80 PLUS Titanium power supplies, it sustains long-running large language model training and generative AI inference workloads. JEI WEI ELECTRONIC is an authorised distributor providing configuration advice, complete system integration, on-site installation and ongoing support - contact us for the full datasheet and a quotation.
Specifications
| Form Factor | 8U Rackmount |
|---|---|
| Dimensions | 930 x 448 x 353.6mm (36.6'' x 17.6'' x 13.9'') |
| Support Motherboard | TURIN2D24G-2L+/500W |
| I/O Ports | 8 OSFP (800Gb/s) via NVIDIA® ConnectX®-8 SuperNIC 2 RJ45 (1GbE) by Intel i350, shared with Rear IO 1 dedicated IPMI, shares with Rear IO 4 Type-A (USB3.2 Gen1) 1 DB15 (VGA) |
| Front Side Drive Bay | 12 Hot-swap 2.5" NVMe (PCIe5.0 x4) drive bays [PCIe switch] |
| Internal Side | M2_1 (PCIe3.0 x2 or SATA 6Gb/s), supports 22110/2280 form factor [CPU0] M2_2 (PCIe3.0 x4 or SATA 6Gb/s), supports 22110/2280 form factor [CPU1] |
| Type | 6+6 CRPS |
| Output Watts | 3002.4W @ 220-240Vac input, 2900W @200-220Vac input |
| Efficiency | 80-PLUS Titanium |
| AC Input | 200-240Vrms, 50/60Hz |
| Fan | 26 PWM 80x80 mm fans, 6 PWM 60x56 mm fans |
| GPU | NVIDIA® HGX™ B300 NVL8 |
| CPU | Supports AMD EPYC™ 9005/9004 (with AMD 3D V-Cache™ Technology) and 97x4 series processors |
| Socket | Dual Socket SP5 (LGA 6096) |
| Thermal Design Power | Up to 500W |
| Chipset | System on Chip |
| Supported DIMM Quantity | 12+12 DIMM slots (1DPC) |
| Supported Type | Supports DDR5 288-pin RDIMM, RDIMM-3DS |
| Max. Capacity per DIMM | RDIMM: 128GB (2Rx4) RDIMM-3DS: 256GB (2Rx4) |
| Max. DIMM Frequency | 6400 MHz |
| Voltage | 1.1V |
| PCIe x 16 | Rear: 4 FHHL PCIe5.0 x16 [PCIe switch] |
| Additional Ethernet Controller | Intel® i350: 2 RJ45 (1GbE) NVIDIA® ConnectX®-8 SuperNIC: 8 OSFP (800Gb/s) |
| UID Button/LED | 1 UID button w/LED |
| Other Button/LED | 1 power button w/LED, 1 reset button, 1 NMI button, 1 HDD activity LED, 1 system fault LED |
| Video Port | 1 DB15 (VGA) |
| USB 3.2 Gen1 Port | 2 Type-A (USB3.2 Gen1) |
| RJ45 | 2 RJ45 (1GbE) by Intel® i350, shared with front IO 1 dedicated IPMI, shared with front IO |
| BIOS Type | AMI UEFI BIOS; 256 Mb (32MB) SPI Flash ROM |
| BIOS Features | ASRock Rack Instant Flash, ACPI 6.4 and about compliance wake up events, SMBIOS 3.5.0 and above, Plug and Play(PnP) |
| Temperature | Operating temperature: 10°C ~ 35°C / Non-operating temperature: -40°C ~ 70°C |
| Humidity | Non-operating humidity: 20% ~ 90% (non-condensing) |