GeForce RTX 4090 specs
NVIDIA · Legacy · first available Oct 2022. Dense compute, memory, bandwidth and power from the vendor's documents; each precision stays separate.
All accelerators · Compare with L4
Specifications
| Dense BF16 · FP32 accumulate | 165.2 TFLOPS |
|---|---|
| Dense FP8 · FP32 accumulate | 330.3 TFLOPS |
| Dense FP4 · FP32 accumulate | Unsupported |
| Memory | 24 GB · GDDR |
| Memory bandwidth | 1.01 TB/s |
| Maximum chip power | 450 W |
| Interconnect | PCIe 4.0 |
| Process node | TSMC 4N |
| First availability | Oct 2022 |
| Availability | Legacyest — estimated / secondary-source figure |
| Est. purchase price | ~$1,599est — estimated / secondary-source figureLaunch list price (MSRP) |
Consumer anchor with no NVLink, out of production since late 2024 by press reports (NVIDIA has published no end-of-life notice). Tensor rates are NVIDIA's FP32-accumulate figures; the card's 2× FP16-accumulate rates are not comparable with data-center specifications.
Dense tensor rates with FP32 accumulation, never sparse or FP16-accumulate headline figures. Memory is in decimal GB. The est marker flags a value its vendor-document review did not confirm.
Rent it
$0.69/GPU-hrServerless / per-second · Beam · observed
No on-demand quote is tracked; this price is a different billing model and is not compared with on-demand rates.
RTX 4090 rental prices →Value ratios
| $ per dense BF16 PFLOP-hour | No on-demand quote |
|---|---|
| Dense BF16 TFLOPS per watt | 0.37 |
| Bandwidth bytes per 1,000 BF16 FLOP | 6.11 |
| $ per dense FP8 PFLOP-hour | No on-demand quote |
| Dense FP8 TFLOPS per watt | 0.73 |
| Bandwidth bytes per 1,000 FP8 FLOP | 3.06 |
| $ per GB of memory per hour | No on-demand quote |
Prices divide the cheapest on-demand list price; theoretical ratios do not measure application speed.
Sources
Specifications reviewed . Dense FP32-accumulate tensor rates: BF16 165.2 TFLOPS, FP8 330.3 TFLOPS; no FP4 tensor format. The whitepaper's 2× FP16-accumulate rates are not comparable with data-center specifications.
First availability: NVIDIA: GeForce RTX 4090 out now ↗ (2022-10-12): “available now”
Purchase price: NVIDIA GeForce RTX 40 Series launch ↗ (2022-09-20): “starting at $1,599”
Rental price: Beam published pricing ↗ (RTX 4090 PCIe 24 GB serverless GPU task; one GPU; rate published per second, billed by the millisecond).