AMD Instinct MI300X

Compare AMD Instinct MI300X against another machine in the Arena

Class
GPU
Memory
192 GB HBM3
Runs (Q4_K_M)
Bandwidth
5300 GB/s
TDP
750 W
Released
2023-12-06
Price (US)
$24554 used as of 2026-07
Sourcing and disambiguation notes

OAM module requiring a dedicated 8-GPU baseboard (e.g. Lenovo/Supermicro universal baseboard server), not a PCIe slot card -- form_factor: server to match how the published SXM4 A100 is categorized. AMD never published an MSRP; leaked/reported per-unit prices ($10k-$15k) vary too much between sources to record as a fact, so price is omitted. 2026-08 METHODOLOGY UPGRADE: the previous $20,000 came from GPUDojo aggregating a SINGLE eBay listing, and was flagged here as "a single listing is not a market". It is replaced by GPU Poet's July-2026 tracker, which averages the three lowest-priced listings across major marketplaces daily: $24,554, range $23,000-$27,000 over the month. Still ultimately eBay-derived, but a multi-listing method rather than one data point. Broker quotes for MI300X-class hardware remain wildly inconsistent (gpucost.org showed 9 active listings spanning $21,333-$448,000, the top end clearly bundled multi-GPU systems), so treat this as directional, not a precise market price. No new price exists (enterprise-quote only).

Specification sources

Measurements

Decode is token generation — the speed you feel while an answer streams. Prefill is prompt processing — the wait before it starts. Why bandwidth predicts decode speed.

What verified, single-source and estimated mean, and the same rows with every filter and sort in the benchmarks explorer.

Speed over time

What it can run

Fit is arithmetic, not a measurement — how it is computed. Against 192 GB; models that fit are listed largest first.