On-demand, the H200 rents for $5.27/hr and the H100 for $4.02/hr — the H100 is ~31% cheaper per hour, averaged across cloud providers.
| H200 | H100 | |
|---|---|---|
| On-demand /hr | $5.27 | $4.02 |
| Spot /hr | $3.33 | $2.49 |
| Reserved /hr | $3.62 | $3.26 |
| Per month (on-demand) | $3,847 | $2,935 |
| H200 | H100 | |
|---|---|---|
| Vendor | NVIDIA | NVIDIA |
| Architecture | Hopper | Hopper |
| Memory | 141 GB HBM3e | 80 GB HBM3 |
| Memory bandwidth | 4.8 TB/s | 3.35 TB/s |
| Launched | 2024 | 2022 |
On-demand, the H200 averages $5.27/hr vs the H100 at $4.02/hr — the H100 is about 31% cheaper per hour. Spot rates are $3.33/hr vs $2.49/hr.
H200 costs more per hour but offers 141 GB HBM3e memory and newer architecture — for large-model training the higher hourly rate often yields a lower cost-per-job. For memory-bound inference or budget runs, the H100 is usually the better value.
At on-demand rates that's about $3,847/mo for the H200 and $2,935/mo for the H100 (730 hours).
See full pricing & history: H200 price · H100 price · all GPUs.
Cross-provider averages from public cloud GPU listings. Informational only.