02Hardware
AI accelerator specs
The chips doing the thinking. Every accelerator that matters — specs normalized to dense FLOPS so vendors’ sparsity-inflated headlines compare honestly, plus what a FLOP actually rents for.
Accelerator database
Dense tensor throughput by precision; use each vendor’s explicit dense specification. Open a chip’s context for sources and review scope.
Selected specifications reviewed 2026-10-15 in 23 of 23 rows. Every field of every row was checked on Oct 15: technical figures against the vendor documents /hardware lists with each chip, launch months against vendor releases and filings, availability against vendor pages and press reports, and purchase-price estimates against named reports, with a price shown only where a reputable report gives one. No vendor publishes Trainium2 board power (the table keeps SemiAnalysis's estimate), a tensor BF16 rate for Maia 200 or per-chip power for Google's TPUs.
Instinct MI455X, AMDest — estimated / secondary-source figure Context for Instinct MI455XAMD · MI400 Series flagship: CDNA 5 with HBM4. AMD's 20.1 PF FP8 and 40.3 PF MXFP4 are dense rates; it lists sparsity only for FP16/BF16/INT8. Customers: OpenAI 6 GW, Meta up to 6 GW (custom MI450-based GPU), Anthropic up to 2 GW. Launch month is an estimate. Selected specs reviewed 2026-10-15. Row is the MI455X, whose dense rates AMD publishes directly (5.0 PF BF16, 20.1 PF FP8, 40.3 PF MXFP4); 23.3 TB/s HBM4 bandwidth and 2,500 W maximum board power. AMD Instinct MI455X specifications ↗AMD Instinct MI455X brochure ↗AMD Helios MI455X brief (board power) ↗ | Oct 2026 | 5.03 PF | 432 GB | 23.3 TB/s | Ramping |
Rubin GPU, NVIDIAest — estimated / secondary-source figure Context for Rubin GPUNVIDIA · NVIDIA's individual-GPU table specifies dense BF16, FP8/FP6 training and NVFP4 training directly. FP4 here uses its 35 PF dense training figure, not the separate 50 PF sparse inference claim. Bandwidth and NVLink follow the Oct 2026 NVL72 figures (19.2 TB/s, 3 TB/s); older HGX pages still say 22 and 3.6 TB/s. 1,800 W is NVIDIA's NVL4 benchmark power assumption, and launch timing is an estimate. Selected specs reviewed 2026-10-15. Rubin GPU column: 19.2 TB/s and NVLink 6 at 3 TB/s (HGX and preliminary DGX Rubin NVL8 pages still imply 22 and 3.6 TB/s). 1,800 W is the datasheet's NVL4 benchmark power; NVIDIA states no process node. NVIDIA Vera Rubin NVL72 ↗NVIDIA Vera Rubin datasheet ↗ | Aug 2026 | 4 PF | 288 GB | 19.2 TB/s | Ramping |
Maia 200, Microsoft Context for Maia 200Microsoft · Microsoft’s inference chip, live in Azure Jan 2026; serves GPT-5.x-class models at claimed 30% better perf/$. Its 1,268 TFLOPS BF16 peak runs on the vector unit (the tensor unit handles FP8/FP6/FP4), so no tensor BF16 rate is listed. Selected specs reviewed 2026-10-15. Peak-specification table: 5,072 TFLOPS FP8, 10,145 TFLOPS FP4, 750 W. BF16 (1,268 TFLOPS) is a vector-unit rate, so tf16 stays empty. Microsoft Maia 200 announcement ↗Maia 200 architecture deep dive ↗ | Jan 2026 | — | 216 GB | 7 TB/s | Shipping |
Trainium3, AWS Context for Trainium3AWS · Per-chip NeuronCore-v4 specifications: MXFP8 and MXFP4 share the published throughput; dense BF16 is lower and must not be inferred by halving FP8. Selected specs reviewed 2026-10-15. 671 TFLOPS dense BF16; 2,517 TFLOPS MXFP8 and MXFP4. Dense BF16 cannot be inferred by halving FP8; AWS publishes no per-chip power. AWS Neuron Trainium3 architecture ↗Amazon Trainium3 UltraServers launch ↗ | Dec 2025 | 671 TF | 144 GiB | 4.9 TB/s | Shipping |
TPU v7 (Ironwood), Google Context for TPU v7 (Ironwood)Google · Google Cloud TPU7x. Compute is per chip, comprising two TensorCores; memory capacity follows the documentation's GiB specification. GA since March 2026 and available on demand (quota required); Spot, Flex-start and calendar-mode reservations are allowlist-restricted. Selected specs reviewed 2026-10-15. Current TPU7x table (7,380 GB/s shown as 7.38 TB/s); GA since March 31, 2026. No FP4 rate or per-chip power is published. Google Cloud TPU7x architecture ↗Google Cloud TPU release notes ↗ | Nov 2025 | 2.31 PF | 192 GiB | 7.38 TB/s | Shipping |
Instinct MI355X, AMDest — estimated / secondary-source figureRent from $8.60/GPU-hr — MI355X rental prices Context for Instinct MI355XAMD · CDNA 4, liquid-cooled. Values use AMD's dense BF16/OCP-FP8 and MXFP4 specifications; sparse headline rates are excluded. Selected specs reviewed 2026-10-15. Use explicit dense BF16/OCP-FP8 and MXFP4 rates, not the adjacent sparse headline values. AMD MI355X specifications ↗AMD MI355X brochure ↗ | Sep 2025 | 2.5 PF | 288 GB | 8 TB/s | Shipping |
B300 (HGX Blackwell Ultra), NVIDIAest — estimated / secondary-source figureRent from $7.40/GPU-hr — B300 rental prices Context for B300 (HGX Blackwell Ultra)NVIDIA · HGX variant: dense FP4 is 108 PF per eight-GPU system divided by eight. Current datasheet specifies 270 GB and 1,100 W; GB300 NVL72 has different per-GPU specifications. Selected specs reviewed 2026-10-15. Current HGX column specifies 270 GB, 7.7 TB/s and 1,100 W; older reference tables list 288 GB. Dense FP4 is 108 PF/system ÷ 8 (the per-GPU figure is rounded to 14 PF in the PDF). NVIDIA Blackwell Ultra datasheet, page 5 ↗NVIDIA HGX specifications ↗ | Jul 2025 | 2.25 PF | 270 GB | 7.7 TB/s | Shipping |
GB200 NVL72 (per GPU), NVIDIAest — estimated / secondary-source figureRent from $10.50/GPU-hr — GB200 NVL72 rental prices Context for GB200 NVL72 (per GPU)NVIDIA · One of the 72 Blackwell GPUs in a GB200 NVL72 rack (two per Grace Blackwell superchip); rentals are priced per GPU. Launch month is an estimate: the first generally available cloud instances were announced in February 2025. Selected specs reviewed 2026-10-15. Datasheet's individual-GPU column for GB200 NVL72: its sparse FP4/FP8/BF16 figures (20/10/5 PF) halved, as its footnote directs, to 10/5/2.5 PF dense; the rack page's totals divide to the same. 186 GB HBM3E at 8 TB/s and a TDP configurable up to 1,200 W per GPU. NVIDIA Blackwell datasheet ↗NVIDIA GB200 NVL72 specifications ↗ | Feb 2025 | 2.5 PF | 186 GB | 8 TB/s | Shipping |
GeForce RTX 5090, NVIDIARent from $1.19/GPU-hr — RTX 5090 rental prices Context for GeForce RTX 5090NVIDIA · Consumer Blackwell with FP4 support. Tensor rates are NVIDIA's FP32-accumulate figures; the card's 2× FP16-accumulate rates are not comparable with data-center specifications. Selected specs reviewed 2026-10-15. Dense FP32-accumulate tensor rates: BF16 209.5 TFLOPS, FP8 419 TFLOPS, FP4 1,676 TFLOPS; process TSMC 4N. The whitepaper's 2× FP16-accumulate rates are not comparable with data-center specifications. NVIDIA RTX Blackwell GPU Architecture whitepaper V1.1, Appendix A, Table 3 ↗NVIDIA GeForce RTX 5090 ↗ | Jan 2025 | 210 TF | 32 GB | 1.79 TB/s | Shipping |
B200 (HGX), NVIDIAest — estimated / secondary-source figureRent from $6.00/GPU-hr — B200 rental prices Context for B200 (HGX)NVIDIA · Dual-die Blackwell; first NVIDIA part with FP4 tensor formats. Selected specs reviewed 2026-10-15. HGX B200 column: 7.7 TB/s per GPU (62 TB/s per board) replaces 8 TB/s, which DGX B200 pages still list. Per-GPU rates are derived from the eight-GPU table. NVIDIA HGX specifications ↗NVIDIA Blackwell datasheet ↗ | Dec 2024 | 2.25 PF | 180 GB | 7.7 TB/s | Shipping |
Instinct MI325X, AMDest — estimated / secondary-source figure Context for Instinct MI325XAMD · MI300X refresh with HBM3e. Selected specs reviewed 2026-10-15. Dense rates, 256 GB HBM3E and 6 TB/s confirmed. AMD MI325X specifications ↗AMD MI325X datasheet ↗ | Dec 2024 | 1.31 PF | 256 GB | 6 TB/s | Shipping |
Trainium2, AWSest — estimated / secondary-source figure Context for Trainium2AWS · AWS Neuron publishes dense BF16/FP16/TF32 and FP8 separately from sparse throughput. Board power remains an earlier estimate. Selected specs reviewed 2026-10-15. Dense compute and per-chip memory/interconnect; the 500 W board power remains a secondary estimate. AWS Neuron Trainium2 architecture ↗ | Dec 2024 | 667 TF | 96 GiB | 2.9 TB/s | Shipping |
TPU v6e (Trillium), GoogleRent from $2.70/chip-hr — TPU v6e rental prices Context for TPU v6e (Trillium)Google · 4.7× the peak compute of v5e. Selected specs reviewed 2026-10-15. Per-chip architecture comparison; FP8 throughput is explicitly listed, not inferred from BF16. Google Cloud TPU7x architecture ↗Google Cloud TPU v6e ↗ | Oct 2024 | 918 TF | 32 GiB | 1.64 TB/s | Shipping |
Gaudi 3, Intel Context for Gaudi 3Intel · Priced aggressively; FP8 and BF16 share the same MME throughput. Selected specs reviewed 2026-10-15. Intel's July 2025 paper gives 1,678 TFLOPS BF16/FP8 MME at 900 W; its 2024 Hot Chips deck said 1,835. Intel Gaudi 3 white paper (Rev. 3) ↗ | Sep 2024 | 1.68 PF | 128 GB | 3.7 TB/s | Shipping |
H200 SXM, NVIDIAest — estimated / secondary-source figureRent from $3.99/GPU-hr — H200 rental prices Context for H200 SXMNVIDIA · Same compute as H100; HBM3e lifts capacity 1.8× and bandwidth 1.4×. Selected specs reviewed 2026-10-15. SXM column; sparse tensor figures divided by two, with existing whole-TFLOPS rounding retained. NVIDIA H200 specifications ↗ | Jun 2024 | 989 TF | 141 GB | 4.8 TB/s | Shipping |
Instinct MI300X, AMDest — estimated / secondary-source figureRent from $3.45/GPU-hr — MI300X rental prices Context for Instinct MI300XAMD · CDNA 3 chiplet design; led on memory capacity at launch. Selected specs reviewed 2026-10-15. Dense rates confirmed; the datasheet's more precise 1,307.4/2,614.9 TFLOPS round to the table values. AMD MI300X specifications ↗AMD MI300X datasheet ↗ | Dec 2023 | 1.31 PF | 192 GB | 5.3 TB/s | Shipping |
TPU v5p, GoogleRent from $4.20/chip-hr — TPU v5p rental prices Context for TPU v5pGoogle · Announced alongside Gemini 1.0 (Dec 2023), which was trained on TPU v4 and v5e. Selected specs reviewed 2026-10-15. Per-chip table; FP8 runs at the BF16 rate and capacity is specified in GiB. Google Cloud TPU v5p ↗Google Cloud TPU7x architecture ↗ | Dec 2023 | 459 TF | 95 GiB | 2.77 TB/s | Shipping |
L40S, NVIDIAest — estimated / secondary-source figureRent from $1.09/GPU-hr — L40S rental prices Context for L40SNVIDIA · Ada Lovelace data-center card with 48 GB of GDDR6, not HBM, and no NVLink. Launch month is an estimate: NVIDIA said in August 2023 that it would be available from that fall. Selected specs reviewed 2026-10-15. Dense tensor rates are the unstarred figures (BF16 362.05, FP8 733 TFLOPS); the starred sparse ones are excluded, and no FP4 format is listed. 48 GB GDDR6 at 864 GB/s, 350 W, PCIe Gen4 x16 without NVLink. The page states no process node. NVIDIA L40S specifications ↗ | Oct 2023 | 362 TF | 48 GB | 0.86 TB/s | Shipping |
TPU v5e, GoogleRent from $1.20/chip-hr — TPU v5e rental prices Context for TPU v5eGoogle · Efficiency-tier TPU; INT8 393 TOPS. Selected specs reviewed 2026-10-15. 197 TFLOPS BF16 and 393 INT8 TOPS per chip; no FP8, FP4 or power figure is published. 0.82 TB/s follows Google's Trillium comparison; the v5e table's 800 GiBps would read 0.86. Google Cloud TPU v5e ↗ | Aug 2023 | 197 TF | 16 GB | 0.82 TB/s | Shipping |
H100 SXM, NVIDIAest — estimated / secondary-source figureRent from $1.99/GPU-hr — H100 rental prices Context for H100 SXMNVIDIA · Defined the 2023–25 training buildout; the market’s reference chip. Selected specs reviewed 2026-10-15. SXM column; sparse tensor figures divided by two, with existing whole-TFLOPS rounding retained. NVIDIA H100 specifications ↗NVIDIA Hopper architecture whitepaper ↗ | Oct 2022 | 989 TF | 80 GB | 3.35 TB/s | Shipping |
GeForce RTX 4090, NVIDIARent from $0.89/GPU-hr — RTX 4090 rental prices Context for GeForce RTX 4090NVIDIA · Consumer anchor with no NVLink, out of production since late 2024 by press reports (NVIDIA has published no end-of-life notice). Tensor rates are NVIDIA's FP32-accumulate figures; the card's 2× FP16-accumulate rates are not comparable with data-center specifications. Selected specs reviewed 2026-10-15. Dense FP32-accumulate tensor rates: BF16 165.2 TFLOPS, FP8 330.3 TFLOPS; no FP4 tensor format. The whitepaper's 2× FP16-accumulate rates are not comparable with data-center specifications. NVIDIA Ada GPU Architecture whitepaper V2.02, Appendix A, Table 2 ↗NVIDIA GeForce RTX 4090 ↗ | Oct 2022 | 165 TF | 24 GB | 1.01 TB/s | Legacy |
A100 SXM 80GB, NVIDIAest — estimated / secondary-source figureRent from $1.35/GPU-hr — A100 80GB rental prices Context for A100 SXM 80GBNVIDIA · Workhorse of the GPT-3→GPT-4 era. Selected specs reviewed 2026-10-15. 80GB SXM column; process TSMC N7. NVIDIA A100 specifications ↗NVIDIA Ampere architecture whitepaper ↗ | Nov 2020 | 312 TF | 80 GB | 2.04 TB/s | Legacy |
V100 SXM2, NVIDIAest — estimated / secondary-source figureRent from $0.79/GPU-hr — V100 rental prices Context for V100 SXM2NVIDIA · First tensor-core GPU; FP16 only (no BF16). Selected specs reviewed 2026-10-15. SXM2 column; FP16 tensor only (no BF16, FP8 or FP4). NVIDIA V100 datasheet ↗NVIDIA Volta architecture whitepaper ↗ | Jun 2017 | 125 TF | 32 GB | 0.9 TB/s | Legacy |
Chips announced but not yet in this table, with each one’s stated availability, are on the accelerator roadmap.
What a PFLOP-hour rents for
Lowest specialist-cloud on-demand list price ÷ dense BF16 throughput
Rental quotes as of Oct 2026, compared as the chip pages compare them; dense BF16 (FP32 accumulate) from vendor specs. GB200 row uses per-GPU rack pricing.
Exact values for What a PFLOP-hour rents for
| Chip | $/PFLOP·hr | Rental $/hr | Dense BF16 |
|---|---|---|---|
| H100 | $2.01 | $1.99 | 989 TF |
| MI300X | $2.64 | $3.45 | 1,307 TF |
| B200 | $2.67 | $6.00 | 2,250 TF |
| L40S | $3.01 | $1.09 | 362.05 TF |
| B300 | $3.29 | $7.40 | 2,250 TF |
| H200 | $4.03 | $3.99 | 989 TF |
| GB200 NVL72 | $4.20 | $10.50 | 2,500 TF |
| A100 80GB | $4.33 | $1.35 | 312 TF |
| RTX 4090 | $5.39 | $0.89 | 165.2 TF |
| RTX 5090 | $5.68 | $1.19 | 209.5 TF |
The memory-bandwidth race
HBM bandwidth by launch date
Vendor spec sheets; HBM parts only (L40S, GeForce RTX 4090 and GeForce RTX 5090 use GDDR and are not plotted). Launch months are estimates of first availability.
Memory cost context
Public $/GB estimate points — memory estimates through Jun 2026
Context estimates, not an index: sparse points compiled from public press summaries of TrendForce/DRAMeXchange data and analyst compilations — never interpolated, and the two series (contract HBM3e vs spot DDR5 per-chip conversions) are not comparable to each other.
Energy-cost floor
Static estimate · EIA data through May 2026
≥$0.05/GPU·hr (est)B200 (HGX) · electricity alone
≥$0.07/GPU·hr (est)Instinct MI355X · electricity alone
Electricity alone sets a floor under the rent: ≥$0.05/GPU·hr for B200 (HGX) and ≥$0.07/GPU·hr for Instinct MI355X — TDP (1 kW / 1.4 kW) × PUE 1.2 × $0.0445/kWh industrial power in New Mexico, the cheapest tracked-cluster state (EIA ELEC.PRICE.NM-IND.M, est). A lower bound: assumes full-TDP draw for the rented hour and excludes capital, cooling capex, networking, and margin.