NVIDIA RTX A5000
Compare NVIDIA RTX A5000 against another machine in the Arena
Reference: Nvidia RTX on Wikipedia
- Class
- GPU
- Memory
- 24 GB GDDR6
- Runs (Q4_K_M)
- —
- Bandwidth
- 768 GB/s
- TDP
- 230 W
- Released
- 2021-04-01
- Price (US)
- $2000 used · $2400 new as of 2026-08
- Price (Canada)
- CA$2639.52 used sourced, as of 2026-08
Sourcing and disambiguation notes
Dual-slot workstation card, blower cooled, single 8-pin power connector. Ampere generation, flash-attention supported. New price of $2,400 (Amazon/Newegg) is now available via the same gpudojo.com tracker cited above (used $2,000 via eBay). Canadian price: eBay.ca active listing, pre-owned 24GB, plus ~$107 CAD shipping (price given is pre-tax item price only).
Specification sources
- https://gpudojo.com/a5000 — press, 2026-08-22
- https://cputronic.com/en/gpu/nvidia-rtx-a5000 — press, 2026-08-22
Measurements
Decode is token generation — the speed you feel while an answer streams. Prefill is prompt processing — the wait before it starts. Why bandwidth predicts decode speed.
No records yet for this hardware. Know of a published benchmark on it? Submit the link.
What verified, single-source and estimated mean, and the same rows with every filter and sort in the benchmarks explorer.
Speed over time
What it can run
Fit is arithmetic, not a measurement — how it is computed. Against 24 GB; models that fit are listed largest first.
No modeled quant fits in 24 GB.