AI Hardware

26 GPUs & accelerators · self-host price guide · cloud rates

Live

Tier

All Edge / On-device Consumer GPUs Workstation Datacenter

Sort

Cheapest first Most VRAM Fastest Newest

8 hardware items · Workstation

RTX A4000 (16GB)
NVIDIA · 2021 · 19 TFLOPS · 448 GB/s
16 GB
GDDR6 ECC
$650 used
$0.17/hr live
▾
Fits: 13B FP16 / 30B 4-bit
Price (new): $1,100
Price (used): $650
Cloud on-demand: $0.17/hr · RunPod (live)
Cloud spot: $0.09/hr · RunPod (live)
FP16 compute: 19 TFLOPS
Memory BW: 448 GB/s
Power: 140W TDP
Single-slot, low-power. Good for quiet homelab servers. ECC VRAM is nice for long runs.
RTX A6000 (48GB)
NVIDIA · 2020 · 39 TFLOPS · 768 GB/s
48 GB
GDDR6 ECC
$3,500 used
$0.33/hr live
▾
Fits: 30B FP16 / 70B 4-bit / 120B 2-bit
Price (new): $4,500
Price (used): $3,500
Cloud on-demand: $0.33/hr · RunPod (live)
Cloud spot: $0.25/hr · RunPod (live)
FP16 compute: 39 TFLOPS
Memory BW: 768 GB/s
Power: 300W TDP
Best 'fits in a desktop' workstation card. 48GB VRAM without datacenter cost.
RTX 6000 Ada (48GB)
NVIDIA · 2022 · 91 TFLOPS · 960 GB/s
48 GB
GDDR6 ECC
$6,800
$0.74/hr live
▾
Fits: 30B FP16 / 70B 4-bit
Price (new): $6,800
Cloud on-demand: $0.74/hr · RunPod (live)
Cloud spot: $0.40/hr · RunPod (live)
FP16 compute: 91 TFLOPS
Memory BW: 960 GB/s
Power: 300W TDP
Ada gen of A6000. 2x faster. Worth it only if you need the speed and have budget.
A100 SXM 40GB
NVIDIA · 2026
40 GB
VRAM
rent only
▾
Fits: 40GB VRAM — 13B-70B quantized
Auto-discovered via RunPod live pricing.
L40
NVIDIA · 2026
48 GB
VRAM
rent only
▾
Fits: 48GB VRAM — 13B-70B quantized
Auto-discovered via RunPod live pricing.
L40S
NVIDIA · 2026
48 GB
VRAM
rent only
▾
Fits: 48GB VRAM — 13B-70B quantized
Auto-discovered via RunPod live pricing.
RTX 5000 Ada
NVIDIA · 2026
32 GB
VRAM
rent only
▾
Fits: 32GB VRAM — 13B-70B quantized
Auto-discovered via RunPod live pricing.
RTX PRO 4500
NVIDIA · 2026
32 GB
VRAM
rent only
▾
Fits: 32GB VRAM — 13B-70B quantized
Auto-discovered via RunPod live pricing.