On-demand, the H200 rents for $4.48/hr and the MI355X for $5.99/hr — the H200 is ~34% cheaper per hour, averaged across cloud providers.
| H200 | MI355X | |
|---|---|---|
| On-demand /hr | $4.48 | $5.99 |
| Spot /hr | $2.62 | $2.97 |
| Reserved /hr | $3.83 | $— |
| Per month (on-demand) | $3,270 | $4,373 |
| H200 | MI355X | |
|---|---|---|
| Vendor | NVIDIA | AMD |
| Architecture | Hopper | CDNA 4 |
| Memory | 141 GB HBM3e | 288 GB HBM3e |
| Memory bandwidth | 4.8 TB/s | 8 TB/s |
| Launched | 2024 | 2025 |
On-demand, the H200 averages $4.48/hr vs the MI355X at $5.99/hr — the H200 is about 34% cheaper per hour. Spot rates are $2.62/hr vs $2.97/hr.
MI355X costs more per hour but offers 141 GB HBM3e memory and newer architecture — for large-model training the higher hourly rate often yields a lower cost-per-job. For memory-bound inference or budget runs, the H200 is usually the better value.
At on-demand rates that's about $3,270/mo for the H200 and $4,373/mo for the MI355X (730 hours).
See full pricing & history: H200 price · MI355X price · all GPUs.
Cross-provider averages from public cloud GPU listings. Informational only.