H100 PCIe specs
NVIDIA · Legacy · first available Oct 2022 (estimated). Dense compute, memory, bandwidth and power from the vendor's documents; each precision stays separate.
All accelerators · Compare with H100 SXM
Specifications
| Dense BF16 · FP32 accumulate | 756 TFLOPS |
|---|---|
| Dense FP8 · FP32 accumulate | 1,513 TFLOPS |
| Dense FP4 · FP32 accumulate | Not published |
| Memory | 80 GB · HBM |
| Memory bandwidth | 2 TB/s |
| Maximum chip power | 350 W |
| Interconnect | NVLink bridge · 600 GB/s |
| Process node | TSMC 4N |
| First availability | Oct 2022est — estimated / secondary-source figure |
| Availability | Legacyest — estimated / secondary-source figure |
The 350 W PCIe card on the H100 die, with HBM2e at 2 TB/s. NVIDIA's H100 page now lists only the SXM and NVL parts. Launch month is an estimate: NVIDIA began shipping H100 in October 2022 without naming the form factor.
Dense tensor rates with FP32 accumulation, never sparse or FP16-accumulate headline figures. Memory is in decimal GB. The est marker flags a value its vendor-document review did not confirm.
Rent it
No tracked rental quote. The site tracks providers' published list prices; this part may still be rentable under terms it does not record.
Value ratios
| $ per dense BF16 PFLOP-hour | No on-demand quote |
|---|---|
| Dense BF16 TFLOPS per watt | 2.16 |
| Bandwidth bytes per 1,000 BF16 FLOP | 2.65 |
| $ per dense FP8 PFLOP-hour | No on-demand quote |
| Dense FP8 TFLOPS per watt | 4.32 |
| Bandwidth bytes per 1,000 FP8 FLOP | 1.32 |
| $ per GB of memory per hour | No on-demand quote |
Prices divide the cheapest on-demand list price; theoretical ratios do not measure application speed.
Sources
Specifications reviewed . Whitepaper Table 3 PCIe column: 756 BF16 and 1,513 FP8 TFLOPS with FP32 accumulate, half the sparse figures; 350 W, 4N. Bandwidth follows the product brief's 2,000 GB/s peak (the whitepaper says 2,039). No FP4 format is listed; legacy status is editorial, as NVIDIA's H100 page now lists only SXM and NVL.