NVIDIA RTX A6000

Compare NVIDIA RTX A6000 against another machine in the Arena

Class: GPU
Memory: 48 GB GDDR6
Runs (Q4_K_M): —
Bandwidth: 768 GB/s
TDP: 300 W
Released: 2020-10-01
Price (US): $3600 used · $4850 new as of 2026-08
Price (Canada): CA$5386.87 used sourced, as of 2026-08

Sourcing and disambiguation notes

48GB on a single PCIe card is the main draw versus the 24/16GB A4000/A5000 — enough to run 32-70B-class models quantized without splitting across cards. Ampere generation, flash-attention supported. Do not confuse with the older Turing-based "Quadro RTX 6000" (24GB) in used listings. New price of $4,850 (Newegg) is now available via the same gpudojo.com tracker cited above (used $3,600 via eBay). Canadian price: eBay.ca active listings, pre-owned 48GB, pre-tax, representative of a $5,387-6,195 CAD cluster. Consistent with current US secondary market (~US$2,600-3,800+) at a normal ~1.4-1.6x ratio.

Specification sources

https://gpudojo.com/a6000 — press, 2026-08-22
https://cputronic.com/en/gpu/nvidia-rtx-a6000 — press, 2026-08-22

Measurements

Decode is token generation — the speed you feel while an answer streams. Prefill is prompt processing — the wait before it starts. Why bandwidth predicts decode speed.

What verified, single-source and estimated mean, and the same rows with every filter and sort in the benchmarks explorer.

Speed over time

What it can run

Fit is arithmetic, not a measurement — how it is computed. Against 48 GB; models that fit are listed largest first.