AI Hardware

26 GPUs & accelerators · self-host price guide · cloud rates

Tier

All Edge / On-device Consumer GPUs Workstation Datacenter

Sort

Cheapest first Most VRAM Fastest Newest

1 hardware item · Consumer GPUs

RTX 3090 (24GB, used)Best value
NVIDIA · 2020 · 36 TFLOPS · 936 GB/s
24 GB
GDDR6X
$700 used
$0.22/hr live
▾
Fits: 14B FP16 / 30-34B 4-bit / 70B 2-bit
Price (used): $700
Cloud on-demand: $0.22/hr · RunPod (live)
Cloud spot: $0.11/hr · RunPod (live)
FP16 compute: 36 TFLOPS
Memory BW: 936 GB/s
Power: 350W TDP
The undisputed used-market champion. 24GB VRAM at $700 beats almost everything new under $2000.