Best GPU Servers for LLM Training
Training large language models demands the highest memory bandwidth and NVLink interconnects. H100 SXM5 and MI300X are the gold standard. Compare live pricing across every cloud provider.
104
Options
$0.50
From /hr
16
Providers
7
GPU types
What to look for
- →H100 SXM5 delivers 3.35 TB/s HBM3 memory bandwidth — critical for large model parallelism
- →MI300X has 192 GB of unified HBM3 memory, fitting larger models on a single GPU
- →Multi-GPU NVLink (H100) or Infinity Fabric (MI300X) interconnects are required for tensor parallelism at scale
- →A100 SXM4 remains competitive for smaller runs at significantly lower cost
104 results
Density:
| Provider | GPU | GPUs↕ | VRAM↕ | Cores↕ | RAM↕ | $/mo↑ | $/hr↕ | $/GB·hr | Location | |
|---|---|---|---|---|---|---|---|---|---|---|
| MI300X | 1× | 192 GB | — | — | $365/mo | $0.50 | $0.0026 | Global | View | |
| H200 | 1× | 143 GB | — | — | $365/mo | $0.50 | $0.0035 | Global | View | |
| A100 PCIe | 1× | 80 GB | 4 | 24 GB | $569/mo | $0.78 | $0.0097 | 🇺🇸US | View | |
| A100 SXM4 | 1× | 40 GB | 30 | 200 GB | $803/mo | $1.10 | $0.028 | 🇺🇸US | View | |
| A100 | 1× | 80 GB | — | — | $869/mo | $1.19 | $0.015 | Global | View | |
| A100 SXM4 | 1× | 80 GB | 30 | 200 GB | $942/mo | $1.29 | $0.016 | 🇺🇸US | View | |
| A100 | 1× | 40 GB | 16 | 117 GB | $986/mo | $1.35 | $0.034 | 🇺🇸US | View | |
| A100 | 1× | 40 GB | 16 | 120 GB | $986/mo | $1.35 | $0.034 | 🇺🇸US | View | |
| H100 PCIe | 1× | 80 GB | 4 | 24 GB | $1007/mo | $1.38 | $0.017 | 🇺🇸US | View | |
| A100 | 1× | 80 GB | — | — | $1015/mo | $1.39 | $0.017 | Global | View | |
| A100 PCIe | 1× | 80 GB | 28 | 120 GB | $1073/mo | $1.47 | $0.018 | 🇪🇺EU | View | |
| A100 SXM4 | 1× | 80 GB | 31 | 240 GB | $1146/mo | $1.57 | $0.020 | 🇪🇺EU | View | |
| A100 PCIe | 1× | 40 GB | 8 | 45 GB | $1248/mo | $1.71 | $0.043 | 🇺🇸US | View | |
| A100 | 1× | 80 GB | 16 | 117 GB | $1307/mo | $1.79 | $0.022 | 🇺🇸US | View | |
| A100 PCIe | 1× | 40 GB | 24 | 192 GB | $1307/mo | $1.79 | $0.045 | 🇺🇸US | View | |
| A100 PCIe | 1× | 80 GB | 16 | 120 GB | $1307/mo | $1.79 | $0.022 | 🇪🇺EU | View | |
| A100 SXM4 | 1× | 80 GB | 12 | 120 GB | $1307/mo | $1.79 | $0.022 | 🇺🇸US | View | |
| A100 | 1× | 80 GB | 20 | 160 GB | $1380/mo | $1.89 | $0.024 | 🇺🇸US | View | |
| H100 PCIe | 1× | 80 GB | 28 | 180 GB | $1445/mo | $1.98 | $0.025 | 🇪🇺EU | View | |
| H100 | 1× | 80 GB | — | — | $1453/mo | $1.99 | $0.025 | Global | View | |
| A100 PCIe | 1× | 80 GB | 24 | 192 GB | $1453/mo | $1.99 | $0.025 | 🇺🇸US | View | |
| A100 SXM4 | 1× | 80 GB | 20 | 180 GB | $1453/mo | $1.99 | $0.025 | 🇺🇸US | View | |
| A100 SXM4 | 1× | 80 GB | 30 | 200 GB | $1504/mo | $2.06 | $0.026 | 🇺🇸US | View | |
| H100 NVLink | 1× | 80 GB | 31 | 180 GB | $1518/mo | $2.08 | $0.026 | 🇪🇺EU | View | |
| A100 PCIe | 1× | 80 GB | 12 | 90 GB | $1679/mo | $2.30 | $0.029 | 🇺🇸US | View | |
| H100 PCIe | 1× | 80 GB | 20 | 160 GB | $1745/mo | $2.39 | $0.030 | 🇺🇸US | View | |
| H100 SXM5 | 1× | 80 GB | 26 | 200 GB | $1818/mo | $2.49 | $0.031 | 🇺🇸US | View | |
| H100 | 1× | 80 GB | 24 | 192 GB | $1818/mo | $2.49 | $0.031 | 🇺🇸US | View | |
| H100 NVL | 1× | 94 GB | 20 | 200 GB | $1818/mo | $2.49 | $0.026 | 🇺🇸US | View | |
| H100 | 1× | 80 GB | 24 | 192 GB | $1862/mo | $2.55 | $0.032 | 🇺🇸US | View | |
| A100 | 1× | 80 GB | 22 | 184 GB | $1869/mo | $2.56 | $0.032 | 🇫🇮FI-01 | View | |
| A100 SXM4 | 2× | 80 GB | 60 | 400 GB | $1883/mo | $2.58 | $0.016 | 🇺🇸US | View | |
| H100 | 1× | 94 GB | — | — | $1891/mo | $2.59 | $0.028 | Global | View | |
| H100 | 1× | 80 GB | — | — | $1964/mo | $2.69 | $0.034 | Global | View | |
| H100 SXM5 | 1× | 80 GB | 12 | 120 GB | $2037/mo | $2.79 | $0.035 | 🇺🇸US | View | |
| H100 SXM5 | 1× | 80 GB | 26 | 200 GB | $2183/mo | $2.99 | $0.037 | 🇺🇸US | View | |
| H100 SXM5 | 1× | 80 GB | 28 | 120 GB | €2183/mo | €2.99 | €0.037 | 🇫🇷EU-FR | View | |
| A100 | 1× | 80 GB | 32 | 192 GB | $2183/mo | $2.99 | $0.037 | 🇪🇺EU | View | |
| A100 SXM4 | 1× | 80 GB | 12 | 90 GB | $2321/mo | $3.18 | $0.040 | 🇺🇸US | View | |
| H100 | 1× | 80 GB | 26 | 200 GB | $2329/mo | $3.19 | $0.040 | 🇫🇮FI-01 | View | |
| MI300X | 1× | 192 GB | 24 | 384 GB | $2548/mo | $3.49 | $0.018 | 🇺🇸US | View | |
| A100 SXM4 | 2× | 80 GB | 24 | 240 GB | $2613/mo | $3.58 | $0.022 | 🇺🇸US | View | |
| H200 | 1× | 141 GB | — | — | $2621/mo | $3.59 | $0.025 | Global | View | |
| H200 SXM | 1× | 141 GB | 16 | 160 GB | $2913/mo | $3.99 | $0.028 | 🇺🇸US | View | |
| H100 NVLink | 2× | 80 GB | 63 | 360 GB | $3037/mo | $4.16 | $0.026 | 🇪🇺EU | View | |
| H200 SXM | 1× | 141 GB | 26 | 200 GB | $3103/mo | $4.25 | $0.030 | 🇺🇸US | View | |
| A100 PCIe | 4× | 40 GB | 64 | 512 GB | $3270/mo | $4.48 | $0.028 | 🇺🇸US | View | |
| H100 SXM5 | 2× | 80 GB | 52 | 400 GB | $3635/mo | $4.98 | $0.031 | 🇺🇸US | View | |
| A100 | 2× | 80 GB | 44 | 368 GB | $3738/mo | $5.12 | $0.032 | 🇫🇮FI-01 | View | |
| A100 SXM4 | 4× | 80 GB | 120 | 800 GB | $3767/mo | $5.16 | $0.016 | 🇺🇸US | View | |
| H100 SXM5 | 2× | 80 GB | 24 | 240 GB | $4073/mo | $5.58 | $0.035 | 🇺🇸US | View | |
| H100 SXM5 | 2× | 80 GB | 56 | 240 GB | €4365/mo | €5.98 | €0.037 | 🇫🇷EU-FR | View | |
| A100 PCIe | 4× | 80 GB | 64 | 480 GB | $5227/mo | $7.16 | $0.022 | 🇪🇺EU | View | |
| A100 SXM4 | 4× | 80 GB | 48 | 480 GB | $5227/mo | $7.16 | $0.022 | 🇺🇸US | View | |
| H100 NVLink | 4× | 80 GB | 126 | 720 GB | $6074/mo | $8.32 | $0.026 | 🇪🇺EU | View | |
| B200 | 1× | 192 GB | 32 | 256 GB | $6205/mo | $8.50 | $0.044 | 🇺🇸US | View | |
| H100 SXM5 | 4× | 80 GB | 104 | 800 GB | $7271/mo | $9.96 | $0.031 | 🇺🇸US | View | |
| H100 NVL | 4× | 94 GB | 80 | 800 GB | $7271/mo | $9.96 | $0.026 | 🇺🇸US | View | |
| A100 | 4× | 80 GB | 88 | 736 GB | $7475/mo | $10.24 | $0.032 | 🇫🇮FI-01 | View | |
| A100 SXM4 | 8× | 80 GB | 240 | 1800 GB | $7534/mo | $10.32 | $0.016 | 🇺🇸US | View | |
| A100 | 8× | 40 GB | 128 | 936 GB | $7884/mo | $10.80 | $0.034 | 🇪🇺EU | View | |
| H100 SXM5 | 4× | 80 GB | 48 | 480 GB | $8147/mo | $11.16 | $0.035 | 🇺🇸US | View | |
| A100 PCIe | 8× | 80 GB | 128 | 1024 GB | $8176/mo | $11.20 | $0.017 | 🇺🇸US | View | |
| A100 PCIe | 8× | 80 GB | 252 | 1440 GB | $8585/mo | $11.76 | $0.018 | 🇪🇺EU | View | |
| H100 SXM5 | 4× | 80 GB | 112 | 480 GB | €8731/mo | €11.96 | €0.037 | 🇫🇷EU-FR | View | |
| A100 SXM4 | 8× | 80 GB | 252 | 1920 GB | $9169/mo | $12.56 | $0.020 | 🇪🇺EU | View | |
| A100 | 8× | 80 GB | 128 | 936 GB | $10,453.6/mo | $14.32 | $0.022 | 🇺🇸US | View | |
| A100 SXM4 | 8× | 80 GB | 96 | 960 GB | $10,453.6/mo | $14.32 | $0.022 | 🇺🇸US | View | |
| A100 PCIe | 8× | 80 GB | 32 | 192 GB | $10,453.6/mo | $14.32 | $0.022 | 🇺🇸US | View | |
| A100 | 8× | 80 GB | 160 | 1280 GB | $11,037.6/mo | $15.12 | $0.024 | 🇺🇸US | View | |
| H100 PCIe | 8× | 80 GB | 192 | 1536 GB | $11,446.4/mo | $15.68 | $0.025 | 🇺🇸US | View | |
| H100 PCIe | 8× | 80 GB | 252 | 1440 GB | $11,563.2/mo | $15.84 | $0.025 | 🇪🇺EU | View | |
| A100 SXM4 | 8× | 80 GB | 160 | 1440 GB | $11,621.6/mo | $15.92 | $0.025 | 🇺🇸US | View | |
| MI300X | 8× | 192 GB | 160 | 1920 GB | $11,621.6/mo | $15.92 | $0.010 | 🇺🇸US | View | |
| A100 SXM4 | 8× | 80 GB | 240 | 1600 GB | $12,030.4/mo | $16.48 | $0.026 | 🇺🇸US | View | |
| H100 NVLink | 8× | 80 GB | 252 | 1440 GB | $12,147.2/mo | $16.64 | $0.026 | 🇪🇺EU | View | |
| MI325X | 8× | 256 GB | 160 | 1920 GB | $12,264/mo | $16.80 | $0.0082 | 🇺🇸US | View | |
| A100 PCIe | 8× | 80 GB | 96 | 720 GB | $13,432/mo | $18.40 | $0.029 | 🇺🇸US | View | |
| H100 PCIe | 8× | 80 GB | 160 | 1280 GB | $13,957.6/mo | $19.12 | $0.030 | 🇺🇸US | View | |
| H100 SXM5 | 8× | 80 GB | 192 | 1536 GB | $14,308/mo | $19.60 | $0.031 | 🇺🇸US | View | |
| H100 SXM5 | 8× | 80 GB | 208 | 1800 GB | $14,541.6/mo | $19.92 | $0.031 | 🇺🇸US | View | |
| H100 | 8× | 80 GB | 192 | 1536 GB | $14,541.6/mo | $19.92 | $0.031 | 🇺🇸US | View | |
| H100 NVL | 8× | 94 GB | 160 | 1600 GB | $14,541.6/mo | $19.92 | $0.026 | 🇪🇺EU | View | |
| H100 PCIe | 8× | 80 GB | 32 | 192 GB | $14,541.6/mo | $19.92 | $0.031 | 🇺🇸US | View | |
| H100 | 8× | 80 GB | 192 | 1536 GB | $14,892/mo | $20.40 | $0.032 | 🇺🇸US | View | |
| A100 | 8× | 80 GB | 176 | 1472 GB | $14,950.4/mo | $20.48 | $0.032 | 🇫🇮FI-01 | View | |
| MI355X | 1× | 2304 GB | 128 | 3072 GB | $15,125.6/mo | $20.72 | $0.0090 | — | View | |
| H100 SXM5 | 8× | 80 GB | 96 | 960 GB | $16,293.6/mo | $22.32 | $0.035 | 🇺🇸US | View | |
| H100 SXM5 | 8× | 80 GB | 192 | 1800 GB | $17,169.6/mo | $23.52 | $0.037 | 🇪🇺EU | View | |
| H100 SXM5 | 8× | 80 GB | 208 | 1600 GB | $17,461.6/mo | $23.92 | $0.037 | 🇺🇸US | View | |
| H100 SXM5 | 8× | 80 GB | 160 | 1600 GB | $17,461.6/mo | $23.92 | $0.037 | 🇺🇸US | View | |
| H100 SXM5 | 8× | 80 GB | 224 | 960 GB | €17,461.6/mo | €23.92 | €0.037 | 🇫🇷EU-FR | View | |
| H100 | 8× | 80 GB | 208 | 1600 GB | $18,629.6/mo | $25.52 | $0.040 | 🇫🇮FI-01 | View | |
| H100 SXM5 | 8× | 80 GB | 160 | 1920 GB | $19,797.6/mo | $27.12 | $0.042 | 🇺🇸US | View | |
| H200 SXM | 8× | 141 GB | 192 | 1920 GB | $20,089.6/mo | $27.52 | $0.024 | 🇺🇸US | View | |
| H200 SXM | 8× | 141 GB | 208 | 1800 GB | $20,148/mo | $27.60 | $0.024 | 🇺🇸US | View | |
| MI300X | 8× | 192 GB | 192 | 3072 GB | $20,381.6/mo | $27.92 | $0.018 | 🇺🇸US | View | |
| MI300X | 1× | 1536 GB | 128 | 2048 GB | $21,450.24/mo | $31.92 | $0.021 | — | View | |
| H200 SXM | 8× | 141 GB | 128 | 1280 GB | $23,301.6/mo | $31.92 | $0.028 | 🇺🇸US | View | |
| H200 SXM | 8× | 141 GB | 224 | 1536 GB | $23,301.6/mo | $31.92 | $0.028 | 🇪🇺EU | View | |
| MI325X | 1× | 2048 GB | 128 | 3072 GB | $24,810.24/mo | $36.92 | $0.018 | — | View | |
| H200 SXM | 8× | 141 GB | 208 | 1600 GB | $24,820/mo | $34.00 | $0.030 | 🇺🇸US | View | |
| H200 SXM | 8× | 141 GB | 192 | 1600 GB | $26,280/mo | $36.00 | $0.032 | 🇺🇸US | View | |
| B200 | 8× | 192 GB | 256 | 2048 GB | $49,640/mo | $68.00 | $0.044 | 🇺🇸US | View |