Best GPU Servers for Embeddings & RAG
Generating embeddings and running RAG pipelines is memory-bandwidth-bound, not compute-bound. Smaller, cheaper GPUs handle it well. Find the best price-per-query options.
145
Options
$0.05
From /hr
18
Providers
5
GPU types
What to look for
- →Embedding models (e.g. text-embedding-3, BGE, E5) are lightweight — L4 and A10 are overkill-priced efficiently
- →RAG retrieval is CPU/memory bound; GPU is only needed for the embedding step
- →T4 and A10 hit the best $/million-tokens for embedding workloads
- →For high-concurrency embedding APIs, multiple small GPUs beat one large one
145 results
Density:
| Provider | GPU | GPUs↕ | VRAM↕ | Cores↕ | RAM↕ | $/mo↑ | $/hr↕ | $/GB·hr | Location | |
|---|---|---|---|---|---|---|---|---|---|---|
| A40 | 1× | 48 GB | 6 | 24047 GB | $38/mo | $0.05 | $0.0011 | 🇵🇱PL | View | |
| A40 | 1× | 48 GB | 6 | 24047 GB | $38/mo | $0.05 | $0.0011 | 🇵🇱PL | View | |
| A40 | 1× | 48 GB | 6 | 24047 GB | $38/mo | $0.05 | $0.0011 | 🇵🇱PL | View | |
| A40 | 1× | 48 GB | 6 | 24046 GB | $38/mo | $0.05 | $0.0011 | 🇵🇱PL | View | |
| A40 | 1× | 48 GB | 6 | 24047 GB | $38/mo | $0.05 | $0.0011 | 🇵🇱PL | View | |
| A40 | 1× | 48 GB | 6 | 24046 GB | $38/mo | $0.05 | $0.0011 | 🇵🇱PL | View | |
| A40 | 2× | 48 GB | 12 | 48094 GB | $75/mo | $0.10 | $0.0011 | 🇵🇱PL | View | |
| A40 | 2× | 48 GB | 12 | 48093 GB | $75/mo | $0.10 | $0.0011 | 🇵🇱PL | View | |
| A40 | 2× | 48 GB | 12 | 48094 GB | $75/mo | $0.10 | $0.0011 | 🇵🇱PL | View | |
| A40 | 2× | 48 GB | 12 | 48094 GB | $75/mo | $0.10 | $0.0011 | 🇵🇱PL | View | |
| RTX 4090 | 1× | 24 GB | 48 | 32190 GB | $99/mo | $0.14 | $0.0056 | 🇨🇳CN | View | |
| A4000 | 1× | 16 GB | — | — | $102/mo | $0.14 | $0.0088 | Global | View | |
| A40 | 2× | 48 GB | 4 | 15943 GB | $105/mo | $0.14 | $0.0015 | 🇯🇵JP | View | |
| A10 | 1× | 24 GB | 16 | 64448 GB | $108/mo | $0.15 | $0.0062 | 🇺🇸US | View | |
| A40 | 1× | 16 GB | — | — | $124/mo | $0.17 | $0.011 | Global | View | |
| A10 | 1× | 24 GB | 32 | 85785 GB | $148/mo | $0.20 | $0.0084 | 🇳🇱NL | View | |
| A40 | 3× | 48 GB | — | 64131 GB | $148/mo | $0.20 | $0.0014 | 🇧🇬BG | View | |
| A100 | 1× | 24 GB | 20 | 95930 GB | $187/mo | $0.26 | $0.011 | 🇨🇦CA | View | |
| L4 | 1× | 24 GB | 128 | 64239 GB | $196/mo | $0.27 | $0.011 | 🇩🇪DE | View | |
| A100 | 1× | 24 GB | 20 | 128690 GB | $196/mo | $0.27 | $0.011 | 🇨🇦CA | View | |
| RTX 4090 | 2× | 24 GB | 96 | 64380 GB | $196/mo | $0.27 | $0.0056 | 🇨🇳CN | View | |
| A4000 | 1× | 16 GB | 6 | 32 GB | $204/mo | $0.28 | $0.018 | 🇺🇸US | View | |
| A40 | 4× | 48 GB | 4 | 32019 GB | $235/mo | $0.32 | $0.0017 | 🇯🇵JP | View | |
| A40 | 4× | 48 GB | 1 | 5302 GB | $235/mo | $0.32 | $0.0017 | 🇯🇵JP | View | |
| L40 | 1× | 48 GB | 48 | 192716 GB | $246/mo | $0.34 | $0.0070 | 🇻🇳VN | View | |
| RTX 4090 | 1× | 24 GB | — | — | $248/mo | $0.34 | $0.014 | Global | View | |
| RTX 4090 | 1× | 24 GB | — | — | $248/mo | $0.34 | $0.014 | Global | View | |
| A40 | 1× | 48 GB | — | — | $256/mo | $0.35 | $0.0073 | Global | View | |
| A10 | 2× | 24 GB | 64 | 171571 GB | $294/mo | $0.40 | $0.0084 | 🇳🇱NL | View | |
| L4 | 1× | 24 GB | — | — | $321/mo | $0.44 | $0.018 | Global | View | |
| A40 | 3× | 48 GB | 40 | 64199 GB | $349/mo | $0.48 | $0.0033 | 🇳🇴NO | View | |
| L4 | 1× | 24 GB | 8 | 60 GB | $358/mo | $0.49 | $0.020 | 🇺🇸US | View | |
| RTX 4090 | 1× | 24 GB | 8 | 48 GB | $365/mo | $0.50 | $0.021 | 🇺🇸US | View | |
| L40 | 1× | 48 GB | — | 72355 GB | $380/mo | $0.52 | $0.011 | 🇺🇸US | View | |
| A100 | 2× | 24 GB | 40 | 257381 GB | $391/mo | $0.54 | $0.011 | 🇨🇦CA | View | |
| RTX 4090 | 4× | 24 GB | 192 | 128761 GB | $391/mo | $0.54 | $0.0056 | 🇨🇳CN | View | |
| L40S | 1× | 48 GB | 32 | 128936 GB | $412/mo | $0.56 | $0.012 | 🇺🇸US | View | |
| A10 | 1× | 24 GB | 30 | 200 GB | $438/mo | $0.60 | $0.025 | 🇺🇸US | View | |
| L40S | 1× | 48 GB | 32 | 128891 GB | $439/mo | $0.60 | $0.013 | 🇯🇵JP | View | |
| L40S | 1× | 48 GB | 32 | 128891 GB | $439/mo | $0.60 | $0.013 | 🇯🇵JP | View | |
| A10 | 3× | 24 GB | 96 | 257357 GB | $440/mo | $0.60 | $0.0084 | 🇳🇱NL | View | |
| A40 | 5× | 48 GB | 48 | 193005 GB | $440/mo | $0.60 | $0.0025 | 🇺🇸US | View | |
| L40S | 1× | 48 GB | 16 | 120901 GB | $441/mo | $0.60 | $0.013 | 🇫🇮FI | View | |
| L40S | 1× | 48 GB | 16 | 128965 GB | $441/mo | $0.60 | $0.013 | 🇫🇮FI | View | |
| RTX 4090 | 1× | 24 GB | 12 | 70 GB | $467/mo | $0.64 | $0.027 | 🇪🇺EU | View | |
| A40 | 8× | 48 GB | 1 | 10604 GB | $469/mo | $0.64 | $0.0017 | 🇯🇵JP | View | |
| A40 | 8× | 48 GB | 1 | 10604 GB | $469/mo | $0.64 | $0.0017 | 🇯🇵JP | View | |
| A100 | 2× | 24 GB | 48 | 386319 GB | $487/mo | $0.67 | $0.014 | 🇺🇸US | View | |
| L40 | 1× | 48 GB | — | — | $504/mo | $0.69 | $0.014 | Global | View | |
| L4 | 1× | 24 GB | 8 | 48 GB | €548/mo | €0.75 | €0.031 | 🇫🇷EU-FR | View | |
| A100 PCIe | 1× | 80 GB | 4 | 24 GB | $569/mo | $0.78 | $0.0097 | 🇺🇸US | View | |
| L40S | 1× | 48 GB | — | — | $577/mo | $0.79 | $0.016 | Global | View | |
| A40 | 1× | 48 GB | 8 | 64 GB | $577/mo | $0.79 | $0.016 | 🇺🇸US | View | |
| A40 | 1× | 48 GB | 10 | 80 GB | $577/mo | $0.79 | $0.016 | 🇺🇸US | View | |
| RTX 4090 | 1× | 24 GB | 8 | 48 GB | $584/mo | $0.80 | $0.033 | 🇪🇺EU | View | |
| RTX 4090 | 4× | 24 GB | 72 | 515876 GB | $586/mo | $0.80 | $0.0084 | 🇭🇰HK | View | |
| A40 | 1× | 48 GB | 10 | 80 GB | $621/mo | $0.85 | $0.018 | 🇪🇺EU | View | |
| L40S | 2× | 48 GB | 48 | 515971 GB | $683/mo | $0.94 | $0.0097 | 🇹🇼TW | View | |
| A40 | 6× | 48 GB | 64 | 257629 GB | $702/mo | $0.96 | $0.0033 | 🇮🇸IS | View | |
| A40 | 12× | 48 GB | 2 | 15906 GB | $702/mo | $0.96 | $0.0017 | 🇯🇵JP | View | |
| A40 | 1× | 48 GB | 16 | 128 GB | $723/mo | $0.99 | $0.021 | 🇺🇸US | View | |
| RTX 4090 | 3× | 24 GB | 110 | 442241 GB | $733/mo | $1.00 | $0.014 | 🇸🇪SE | View | |
| L40 | 2× | 48 GB | — | 144710 GB | $760/mo | $1.04 | $0.011 | 🇺🇸US | View | |
| L40 | 1× | 48 GB | 28 | 58 GB | $767/mo | $1.05 | $0.022 | 🇪🇺EU | View | |
| A100 SXM4 | 1× | 40 GB | 30 | 200 GB | $803/mo | $1.10 | $0.028 | 🇺🇸US | View | |
| A40 | 1× | 48 GB | 8 | 45 GB | $803/mo | $1.10 | $0.023 | 🇺🇸US | View | |
| A100 | 1× | 80 GB | — | — | $869/mo | $1.19 | $0.015 | Global | View | |
| L40S | 1× | 48 GB | 16 | 100 GB | $913/mo | $1.25 | $0.026 | 🇺🇸US | View | |
| A100 | 1× | 80 GB | — | — | $934/mo | $1.28 | $0.016 | Global | View | |
| L40S | 1× | 48 GB | 16 | 120 GB | $942/mo | $1.29 | $0.027 | 🇺🇸US | View | |
| L40 | 1× | 48 GB | 12 | 96 GB | $942/mo | $1.29 | $0.027 | 🇺🇸US | View | |
| A100 SXM4 | 1× | 80 GB | 30 | 200 GB | $942/mo | $1.29 | $0.016 | 🇺🇸US | View | |
| A100 | 1× | 40 GB | 16 | 117 GB | $986/mo | $1.35 | $0.034 | 🇺🇸US | View | |
| A100 | 1× | 40 GB | 16 | 120 GB | $986/mo | $1.35 | $0.034 | 🇺🇸US | View | |
| A100 | 1× | 80 GB | — | — | $1015/mo | $1.39 | $0.017 | Global | View | |
| A100 PCIe | 1× | 80 GB | 28 | 120 GB | $1073/mo | $1.47 | $0.018 | 🇪🇺EU | View | |
| L40S | 1× | 48 GB | 16 | 120 GB | $1088/mo | $1.49 | $0.031 | 🇺🇸US | View | |
| L40S | 1× | 48 GB | 12 | 96 GB | €1088/mo | €1.49 | €0.031 | 🇫🇷EU-FR | View | |
| L4 | 2× | 24 GB | 16 | 96 GB | €1095/mo | €1.50 | €0.031 | 🇫🇷EU-FR | View | |
| L40S | 1× | 48 GB | 8 | 64 GB | $1146/mo | $1.57 | $0.033 | 🇺🇸US | View | |
| A100 SXM4 | 1× | 80 GB | 31 | 240 GB | $1146/mo | $1.57 | $0.020 | 🇪🇺EU | View | |
| L4 | 2× | 24 GB | — | 192 GB | $1204/mo | — | — | 🇺🇸US | View | |
| L40S | 1× | 48 GB | 16 | 120 GB | $1234/mo | $1.69 | $0.035 | 🇺🇸US | View | |
| L4 | 2× | 24 GB | — | 192 GB | $1241/mo | — | — | 🇺🇸US | View | |
| A100 PCIe | 1× | 40 GB | 8 | 45 GB | $1248/mo | $1.71 | $0.043 | 🇺🇸US | View | |
| L4 | 2× | 24 GB | — | 192 GB | $1279/mo | — | — | 🇺🇸US | View | |
| A100 | 1× | 80 GB | 16 | 117 GB | $1307/mo | $1.79 | $0.022 | 🇺🇸US | View | |
| A100 PCIe | 1× | 40 GB | 24 | 192 GB | $1307/mo | $1.79 | $0.045 | 🇺🇸US | View | |
| A100 PCIe | 1× | 80 GB | 16 | 120 GB | $1307/mo | $1.79 | $0.022 | 🇪🇺EU | View | |
| A100 SXM4 | 1× | 80 GB | 12 | 120 GB | $1307/mo | $1.79 | $0.022 | 🇺🇸US | View | |
| A100 | 1× | 80 GB | 20 | 160 GB | $1380/mo | $1.89 | $0.024 | 🇺🇸US | View | |
| L4 | 4× | 24 GB | 32 | 240 GB | $1431/mo | $1.96 | $0.020 | 🇺🇸US | View | |
| A100 PCIe | 1× | 80 GB | 24 | 192 GB | $1453/mo | $1.99 | $0.025 | 🇺🇸US | View | |
| A100 SXM4 | 1× | 80 GB | 20 | 180 GB | $1453/mo | $1.99 | $0.025 | 🇺🇸US | View | |
| RTX 4090 | 4× | 24 GB | 32 | 192 GB | $1460/mo | $2.00 | $0.021 | 🇺🇸US | View | |
| A100 SXM4 | 1× | 80 GB | 30 | 200 GB | $1504/mo | $2.06 | $0.026 | 🇺🇸US | View | |
| A100 PCIe | 1× | 80 GB | 12 | 90 GB | $1679/mo | $2.30 | $0.029 | 🇺🇸US | View | |
| A100 | 1× | 80 GB | 22 | 184 GB | $1869/mo | $2.56 | $0.032 | 🇫🇮FI-01 | View | |
| A100 SXM4 | 2× | 80 GB | 60 | 400 GB | $1883/mo | $2.58 | $0.016 | 🇺🇸US | View | |
| L40S | 2× | 48 GB | 24 | 192 GB | €2175/mo | €2.98 | €0.031 | 🇫🇷EU-FR | View | |
| A100 | 1× | 80 GB | 32 | 192 GB | $2183/mo | $2.99 | $0.037 | 🇪🇺EU | View | |
| L4 | 4× | 24 GB | 32 | 192 GB | €2190/mo | €3.00 | €0.031 | 🇫🇷EU-FR | View | |
| A100 SXM4 | 1× | 80 GB | 12 | 90 GB | $2321/mo | $3.18 | $0.040 | 🇺🇸US | View | |
| A40 | 4× | 48 GB | 40 | 320 GB | $2482/mo | $3.40 | $0.018 | 🇪🇺EU | View | |
| A100 SXM4 | 2× | 80 GB | 24 | 240 GB | $2613/mo | $3.58 | $0.022 | 🇺🇸US | View | |
| RTX 4090 | 4× | 24 GB | 32 | 256 GB | $2920/mo | $4.00 | $0.042 | 🇺🇸US | View | |
| L40 | 4× | 48 GB | 112 | 232 GB | $3066/mo | $4.20 | $0.022 | 🇪🇺EU | View | |
| A100 PCIe | 4× | 40 GB | 64 | 512 GB | $3270/mo | $4.48 | $0.028 | 🇺🇸US | View | |
| L40S | 2× | 48 GB | — | 384 GB | $3505/mo | — | — | 🇺🇸US | View | |
| L40S | 2× | 48 GB | — | 384 GB | $3505/mo | — | — | 🇺🇸US | View | |
| L40S | 2× | 48 GB | — | 384 GB | $3505/mo | — | — | 🇺🇸US | View | |
| A100 | 2× | 80 GB | 44 | 368 GB | $3738/mo | $5.12 | $0.032 | 🇫🇮FI-01 | View | |
| RTX 4090 | 8× | 24 GB | 120 | 706 GB | $3738/mo | $5.12 | $0.027 | 🇪🇺EU | View | |
| L40 | 4× | 48 GB | 48 | 384 GB | $3767/mo | $5.16 | $0.027 | 🇺🇸US | View | |
| A100 SXM4 | 4× | 80 GB | 120 | 800 GB | $3767/mo | $5.16 | $0.016 | 🇺🇸US | View | |
| L40S | 4× | 48 GB | 64 | 512 GB | $4088/mo | $5.60 | $0.029 | 🇺🇸US | View | |
| L40S | 4× | 48 GB | 48 | 384 GB | €4351/mo | €5.96 | €0.031 | 🇫🇷EU-FR | View | |
| L4 | 8× | 24 GB | 64 | 384 GB | €4380/mo | €6.00 | €0.031 | 🇫🇷EU-FR | View | |
| A40 | 8× | 48 GB | 64 | 512 GB | $4614/mo | $6.32 | $0.016 | 🇺🇸US | View | |
| A40 | 8× | 48 GB | 80 | 640 GB | $4614/mo | $6.32 | $0.016 | 🇺🇸US | View | |
| RTX 4090 | 8× | 24 GB | 64 | 384 GB | $4672/mo | $6.40 | $0.033 | 🇪🇺EU | View | |
| A100 PCIe | 4× | 80 GB | 64 | 480 GB | $5227/mo | $7.16 | $0.022 | 🇪🇺EU | View | |
| A100 SXM4 | 4× | 80 GB | 48 | 480 GB | $5227/mo | $7.16 | $0.022 | 🇺🇸US | View | |
| A40 | 8× | 48 GB | 128 | 1024 GB | $5782/mo | $7.92 | $0.021 | 🇺🇸US | View | |
| RTX 4090 | 8× | 24 GB | 64 | 512 GB | $5840/mo | $8.00 | $0.042 | 🇺🇸US | View | |
| L40 | 8× | 48 GB | 252 | 464 GB | $6132/mo | $8.40 | $0.022 | 🇪🇺EU | View | |
| L40S | 8× | 48 GB | 128 | 800 GB | $7300/mo | $10.00 | $0.026 | 🇺🇸US | View | |
| A100 | 4× | 80 GB | 88 | 736 GB | $7475/mo | $10.24 | $0.032 | 🇫🇮FI-01 | View | |
| A100 SXM4 | 8× | 80 GB | 240 | 1800 GB | $7534/mo | $10.32 | $0.016 | 🇺🇸US | View | |
| A100 | 8× | 40 GB | 128 | 936 GB | $7884/mo | $10.80 | $0.034 | 🇪🇺EU | View | |
| L40S | 8× | 48 GB | 128 | 1024 GB | $8176/mo | $11.20 | $0.029 | 🇺🇸US | View | |
| A100 PCIe | 8× | 80 GB | 128 | 1024 GB | $8176/mo | $11.20 | $0.017 | 🇺🇸US | View | |
| A100 PCIe | 8× | 80 GB | 252 | 1440 GB | $8585/mo | $11.76 | $0.018 | 🇪🇺EU | View | |
| L40S | 8× | 48 GB | 128 | 960 GB | $8702/mo | $11.92 | $0.031 | 🇺🇸US | View | |
| L40S | 8× | 48 GB | 96 | 768 GB | €8702/mo | €11.92 | €0.031 | 🇫🇷EU-FR | View | |
| A100 SXM4 | 8× | 80 GB | 252 | 1920 GB | $9169/mo | $12.56 | $0.020 | 🇪🇺EU | View | |
| L40S | 8× | 48 GB | 128 | 960 GB | $9870/mo | $13.52 | $0.035 | 🇺🇸US | View | |
| A100 | 8× | 80 GB | 128 | 936 GB | $10,453.6/mo | $14.32 | $0.022 | 🇺🇸US | View | |
| A100 SXM4 | 8× | 80 GB | 96 | 960 GB | $10,453.6/mo | $14.32 | $0.022 | 🇺🇸US | View | |
| A100 PCIe | 8× | 80 GB | 32 | 192 GB | $10,453.6/mo | $14.32 | $0.022 | 🇺🇸US | View | |
| A100 | 8× | 80 GB | 160 | 1280 GB | $11,037.6/mo | $15.12 | $0.024 | 🇺🇸US | View | |
| A100 SXM4 | 8× | 80 GB | 160 | 1440 GB | $11,621.6/mo | $15.92 | $0.025 | 🇺🇸US | View | |
| A100 SXM4 | 8× | 80 GB | 240 | 1600 GB | $12,030.4/mo | $16.48 | $0.026 | 🇺🇸US | View | |
| A100 PCIe | 8× | 80 GB | 96 | 720 GB | $13,432/mo | $18.40 | $0.029 | 🇺🇸US | View | |
| A100 | 8× | 80 GB | 176 | 1472 GB | $14,950.4/mo | $20.48 | $0.032 | 🇫🇮FI-01 | View |