On-demand, the H100 rents for $4.01/hr and the MI300X for $2.86/hr — the MI300X is ~40% cheaper per hour, averaged across cloud providers.
| H100 | MI300X | |
|---|---|---|
| On-demand /hr | $4.01 | $2.86 |
| Spot /hr | $2.40 | $1.84 |
| Reserved /hr | $3.26 | $2.18 |
| Per month (on-demand) | $2,927 | $2,088 |
| H100 | MI300X | |
|---|---|---|
| Vendor | NVIDIA | AMD |
| Architecture | Hopper | CDNA 3 |
| Memory | 80 GB HBM3 | 192 GB HBM3 |
| Memory bandwidth | 3.35 TB/s | 5.3 TB/s |
| Launched | 2022 | 2023 |
On-demand, the H100 averages $4.01/hr vs the MI300X at $2.86/hr — the MI300X is about 40% cheaper per hour. Spot rates are $2.40/hr vs $1.84/hr.
H100 costs more per hour but offers 80 GB HBM3 memory and newer architecture — for large-model training the higher hourly rate often yields a lower cost-per-job. For memory-bound inference or budget runs, the MI300X is usually the better value.
At on-demand rates that's about $2,927/mo for the H100 and $2,088/mo for the MI300X (730 hours).
See full pricing & history: H100 price · MI300X price · all GPUs.
Cross-provider averages from public cloud GPU listings. Informational only.