NVIDIA HGX H200 8-GPU AI Server (Synthetic Mode)
6U ASRock Rack AI TRAINING / LLM / INFERENCE / HPC / GENERATIVE AI
The 6U8X-EGS2 SYN H200 is an ASRock Rack 6U air-cooled AI server with the NVIDIA HGX H200 8-GPU module and NVIDIA NVSwitch. The H200 offers 141GB of HBM3e memory and 4.8 TB/s of bandwidth, making it especially well matched to large language model inference and other workloads bound by memory capacity and bandwidth. Standard air cooling means it drops into an existing facility without changes to the cooling plant, making it the most direct route to adding AI capacity to a current data centre. It runs a dual-socket 4th/5th Gen Intel Xeon Scalable platform with 32 DDR5 DIMM slots. JEI WEI ELECTRONIC is an authorised distributor providing configuration advice, complete system integration, on-site installation and ongoing support - contact us for the full datasheet and a quotation.
Specifications
| Form Factor | 6U Rackmount |
|---|---|
| Dimensions | 930 x 448 x 264.7mm (36.6'' x 17.6'' x 10.4'') |
| Support Motherboard | SP2C741D32G-2L+ |
| I/O Ports | 2 RJ45 (1GbE) by Intel i350, shares with Rear IO 1 dedicated IPMI, shares with Rear IO 4 Type-A (USB3.2 Gen1) 1 DB15 (VGA) |
| Front Side Drive Bay | 8 Hot-swap 2.5" NVMe (PCIe5.0 x4) drive bays 2 Hot-swap 2.5" NVMe (PCIe4.0 x4)/SATA drive bays 2 Hot-swap 2.5" SATA drive bays |
| Internal Side | 1 M-key (PCIe3.0 x4 or SATA 6Gb/s), supports 2280/22110 form factor [PCH] 1 M-key (PCIe3.0 x4), supports 2280/22110 form factor [PCH] |
| Type | 4+4 CRPS |
| Output Watts | 3002.4W @ 220-240Vac input, 2900W @200-220Vac input |
| Efficiency | 80-PLUS Titanium |
| AC Input | 200-240Vrms, 50/60Hz |
| Fan | 21 PWM 80x80 mm fans |
| GPU | NVIDIA® HGX H200 8-GPU with NVIDIA® NVSwitch™ |
| CPU | Supports 5th and 4th Gen Intel® Xeon® Scalable Processors |
| Socket | Dual Socket E (LGA 4677) |
| Thermal Design Power | Up to 350W |
| Chipset | C741 |
| Switch IC | PEX89104 |
| Topology | Synthetic mode for optimized performance of GPU-to-CPU, GPUDirect RDMA NIC, and GPUDirect Storage |
| Supported DIMM Quantity | 16+16 DIMM slots (2DPC) |
| Supported Type | Supports DDR5 288-pin RDIMM, RDIMM-3DS |
| Max. Capacity per DIMM | RDIMM: 96GB RDIMM-3DS: 2H- 128 GB / 4H- 256 GB |
| Max. DIMM Frequency | 5600 MT/s (1DPC) / 4400 MT/s (2DPC) on 5th Gen Intel® Xeon® Scalable Processors 4800 MT/s (1DPC) / 4400 MT/s (2DPC) on 4th Gen Intel® Xeon® Scalable Processors *Memory speed and capacity support varies by CPU SKU |
| Voltage | 1.1V |
| PCIe x 16 | Rear: 8 HHHL PCIe5.0 x16 2 FHHL PCIe5.0 x16 |
| Additional Ethernet Controller | Intel® i350: 2 RJ45 (1GbE) |
| UID Button/LED | 1 UID button |
| Video Port | 1 DB15 (VGA) |
| USB 3.2 Gen1 Port | 2 Type-A (USB3.2 Gen1) |
| RJ45 | 2 RJ45 (1GbE) by Intel® i350, shares with Front Panel 1 dedicated IPMI, shares with Front Panel |
| BIOS Type | AMI UEFI BIOS; 256 Mb (32MB) SPI Flash ROM |
| BIOS Features | ASRock Rack Instant Flash, ACPI 6.4 and about compliance wake up events, SMBIOS 3.5.0 and above, Plug and Play(PnP) |
| Temperature | Operating temperature: 10°C ~ 35°C / Non-operating temperature: -40°C ~ 70°C |
| Humidity | Non-operating humidity: 20% ~ 90% (non-condensing) |