The NVIDIA H200 (Hopper, 141 GB HBM3e) rents from $2.98/hr, averaged across 10 cloud providers, updated 2026-08-14. On-demand pricing has risen 12% over the past 70 days.
An H100 with ~1.8× the memory and bandwidth — same core compute, but fits larger models and serves long-context inference more efficiently. Hopper · 141 GB HBM3e · 4.8 TB/s memory bandwidth · launched 2024.
▮ on-demand /hr · ▮ spot /hr
| Date | On-demand | Spot |
|---|---|---|
| 2026-08-14 | $4.37 | $2.98 |
| 2026-08-13 | $4.42 | $2.87 |
| 2026-08-12 | $4.46 | $3.18 |
| 2026-08-11 | $4.48 | $3.15 |
| 2026-08-10 | $4.49 | $2.99 |
| 2026-08-09 | $4.45 | $2.93 |
| 2026-08-08 | $4.42 | $2.96 |
| 2026-08-07 | $4.46 | $2.94 |
| 2026-08-05 | $4.45 | $2.98 |
| 2026-08-04 | $4.46 | $3.10 |
| 2026-08-03 | $4.46 | $3.31 |
| 2026-08-02 | $4.32 | $2.98 |
| 2026-08-01 | $4.37 | $3.12 |
| 2026-07-31 | $4.34 | $3.17 |
| GPU | On-demand /hr | Spot /hr | Memory | |
|---|---|---|---|---|
| H200 | $4.37 | $2.98 | 141 GB HBM3e | |
| B200 | $6.84 | $3.74 | 192 GB HBM3e | H200 vs B200 → |
| H100 | $4.00 | $1.71 | 80 GB HBM3 | H200 vs H100 → |
| MI355X | $8.60 | $5.29 | 288 GB HBM3e | H200 vs MI355X → |
| MI325X | $3.18 | $2.00 | 256 GB HBM3e | H200 vs MI325X → |
| MI300X | $3.56 | $1.65 | 192 GB HBM3 | H200 vs MI300X → |
The H200 averages $4.37/hr on-demand, $2.98/hr spot, and $3.72/hr reserved across 10 cloud providers (updated 2026-08-14).
The lowest tier is spot at about $2.98/hr on average; reserved (1–3 year commitment) runs ~$3.72/hr. Compare live per-provider rates on the Bargo GPU price tracker.
At on-demand $4.37/hr, one H200 runs about $3,190/month (730 hours); reserved pricing lowers that to roughly $2,716/month.
On-demand, the H200 is $4.37/hr vs the H100 at $4.00/hr — pricier per hour. See the full H200 vs H100 comparison for specs and cost-per-job context.
Spot ($2.98/hr) is interruptible spare capacity at a discount to on-demand ($4.37/hr); use spot for checkpointed or fault-tolerant jobs and on-demand or reserved for long, uninterrupted runs.
Cross-provider averages from public cloud GPU listings. Informational only.