AI Hardware

26 GPUs & accelerators · self-host price guide · cloud rates

1 hardware item

  • RTX 3090 (24GB, used)Best value

    NVIDIA · 2020 · 36 TFLOPS · 936 GB/s

    24 GB
    GDDR6X
    $700 used
    $0.22/hr live

    Fits: 14B FP16 / 30-34B 4-bit / 70B 2-bit

    Price (used): $700
    Cloud on-demand: $0.22/hr · RunPod (live)
    Cloud spot: $0.11/hr · RunPod (live)
    FP16 compute: 36 TFLOPS
    Memory BW: 936 GB/s
    Power: 350W TDP

    The undisputed used-market champion. 24GB VRAM at $700 beats almost everything new under $2000.