AI hardware comparison
Bars show relative size · tap ⓘ to compare
| Hardware | Price | Compute / $1k Math capacity · TFLOPS | Bandwidth / $1k Memory supply speed · GB/s | Memory / $1k Room for models · GB | Power | 30-day electricity |
|---|---|---|---|---|---|---|
| 8× Intel Gaudi 2 server | $17,500 Unverified | 197.5 | 1,120 | 43.9 | 4,800 W | $691.23,456 kWh |
| Quoted 4× V100 32 GB server bundle | $4,700 Unverified | — | — | 27.2 | — | — |
| NVIDIA DGX Spark | $6,950 | — | 39.3 | 18.4 | 140 W | $20.16100.8 kWh |
| NVIDIA RTX 3090 | $1,600 | 44.5 | 585 | 15 | 350 W | $50.4252 kWh |
| AMD MI300X — allocated module cost | $27,400 | 47.7 | 193.4 | 7 | 750 W | $108540 kWh |
| NVIDIA RTX PRO 6000 Blackwell | $16,000 | 31.5 | 112 | 6 | 600 W | $86.4432 kWh |
| NVIDIA RTX 5090 | $7,680 | 27.3 | 233.3 | 4.2 | 575 W | $82.8414 kWh |
| HPE DL384 Gen12 — one GH200 configuration | — | — | — | — | — | — |