NVIDIA RTX A4000
Compare NVIDIA RTX A4000 against another machine in the Arena
Reference: Nvidia RTX on Wikipedia
- Class
- GPU
- Memory
- 16 GB GDDR6
- Runs (Q4_K_M)
- —
- Bandwidth
- 448 GB/s
- TDP
- 140 W
- Released
- 2021-04-01
- Price (US)
- $800 used · $1149 new as of 2026-08
- Price (Canada)
- CA$1049.99 used sourced, as of 2026-08
Sourcing and disambiguation notes
Single-slot, blower-cooled workstation card; low 140W TDP means it needs no extra PCIe power connector on many builds. Full ECC GDDR6, ampere generation so flash-attention kernels are supported. New price of $1,149 (current new retail) is now available via the same gpudojo.com tracker cited above (used $800 via Amazon). Canadian price: eBay.ca active listing, PNY RTX A4000 16GB, pre-owned, free shipping, pre-tax.
Specification sources
- https://gpudojo.com/a4000 — press, 2026-08-22
- https://cputronic.com/en/gpu/nvidia-rtx-a4000 — press, 2026-08-22
Measurements
Decode is token generation — the speed you feel while an answer streams. Prefill is prompt processing — the wait before it starts. Why bandwidth predicts decode speed.
No records yet for this hardware. Know of a published benchmark on it? Submit the link.
What verified, single-source and estimated mean, and the same rows with every filter and sort in the benchmarks explorer.
Speed over time
What it can run
Fit is arithmetic, not a measurement — how it is computed. Against 16 GB; models that fit are listed largest first.
No modeled quant fits in 16 GB.