AMD EPYC 9554 (single socket, 12-channel DDR5-5600)
Compare AMD EPYC 9554 (single socket, 12-channel DDR5-5600) against another machine in the Arena
Reference: Epyc on Wikipedia
- Class
- CPU
- Memory
- 192 GB DDR5-5600 DIMMs (12 channel, 12x16GB Samsung), CPU memory controller runs them at 4800 MT/s
- Runs (Q4_K_M)
- —
- Bandwidth
- 460.8 GB/s
- TDP
- 360 W
- Released
- 2022-11-10
- Price (US)
- $11700 used · $14550 new as of 2026-08
Sourcing and disambiguation notes
460.8 GB/s is AMD's theoretical figure for 12 channels of DDR5-5600, and the source measured about 460 GB/s with Intel MLC on this exact box, so the spec figure carries direct empirical confirmation. 64 cores. The source article quotes roughly $7,900 ex-VAT for a whole server rather than the CPU alone, so no clean CPU-only price is taken from it. The build total here breaks down as CPU ~$4,950, Supermicro H13SSL-N board ~$1,100, and 12x32GB DDR5-5600 ECC RDIMM ~$8,500. Memory dominates, at roughly 55-75% of every Genoa and Turin 12-channel build in this dataset, and a single 32GB module of the same spec was seen between $520 and $2,908 depending on vendor and OEM branding -- re-check the memory line before trusting any build total here. The used total holds the board and memory flat, since the secondary market for current-generation SP5 and DDR5 RDIMM is thin.
Specification sources
- https://ahelpme.com/ai/llm-inference-benchmarks-with-llamacpp-with-amd-epyc-9554-cpu/ — press, 2025-03-25
Measurements
Decode is token generation — the speed you feel while an answer streams. Prefill is prompt processing — the wait before it starts. Why bandwidth predicts decode speed.
No records yet for this hardware. Know of a published benchmark on it? Submit the link.
What verified, single-source and estimated mean, and the same rows with every filter and sort in the benchmarks explorer.
Speed over time
What it can run
Fit is arithmetic, not a measurement — how it is computed. Against 192 GB; models that fit are listed largest first.
No modeled quant fits in 192 GB.