On-demand, the H100 rents for $3.55/hr and the MI355X for $8.60/hr — the H100 is ~142% cheaper per hour, averaged across cloud providers.
| H100 | MI355X | |
|---|---|---|
| On-demand /hr | $3.55 | $8.60 |
| Spot /hr | $1.59 | $— |
| Reserved /hr | $3.09 | $2.29 |
| Per month (on-demand) | $2,592 | $6,278 |
| H100 | MI355X | |
|---|---|---|
| Vendor | NVIDIA | AMD |
| Architecture | Hopper | CDNA 4 |
| Memory | 80 GB HBM3 | 288 GB HBM3e |
| Memory bandwidth | 3.35 TB/s | 8 TB/s |
| Launched | 2022 | 2025 |
On-demand, the H100 averages $3.55/hr vs the MI355X at $8.60/hr — the H100 is about 142% cheaper per hour. Spot rates are $1.59/hr vs $—/hr.
MI355X costs more per hour but offers 80 GB HBM3 memory and newer architecture — for large-model training the higher hourly rate often yields a lower cost-per-job. For memory-bound inference or budget runs, the H100 is usually the better value.
At on-demand rates that's about $2,592/mo for the H100 and $6,278/mo for the MI355X (730 hours).
See full pricing & history: H100 price · MI355X price · all GPUs.
Cross-provider averages from public cloud GPU listings. Informational only.