AMD EPYC 9374F (single socket, 12-channel DDR5-4800, NPS2 dual-domain)
Reference: Epyc on Wikipedia
- Class
- CPU
- Memory
- 384 GB DDR5-4800 (12 channel, 1 socket, NPS2 BIOS split into 2 NUMA domains)
- Runs (Q4_K_M)
- —
- Bandwidth
- 361.5 GB/s
- TDP
- 320 W
- Released
- 2022-11-10
- Price (US)
- $11650 used · $12500 new as of 2026-08
Sourcing and disambiguation notes
Single physical socket (32-core EPYC 9374F, Asus K14PA-U12), BIOS set to NUMA NPS2 to emulate a 2-NUMA-domain system with a very fast intra-package interconnect vs a real dual-socket build - used by the source as a control case. 361.5 GB/s measured (likwid-bench, both NUMA domains) vs 460.8 GB/s theoretical (78.4%). 2026-08 build-total price (itcreations.com): single-socket SP5, 12x DIMM, NPS2 config (same physical DIMM count as full population). Breakdown: CPU EPYC 9374F (32c) ~$3,600, Supermicro H13SSL-N board ~$1,100, 12x32GB DDR5-4800 RDIMM ~$650 each (~$7,800). Memory dominates the total -- see the EPYC 9554 entry's note on the $520-$2,908 per-module spread; re-check that line first. Used total ($11,650): CPU ~$2,749, board/memory held flat.
Specification sources
- https://github.com/ggml-org/llama.cpp/discussions/11733 — forum, 2025-02-18
Measurements
Decode is token generation — the speed you feel while an answer streams. Prefill is prompt processing — the wait before it starts. Why bandwidth predicts decode speed.
No records yet for this hardware. Know of a published benchmark on it? Submit the link.
What verified, single-source and estimated mean, and the same rows with every filter and sort in the benchmarks explorer.
Speed over time
What it can run
Fit is arithmetic, not a measurement — how it is computed. Against 384 GB; models that fit are listed largest first.
No modeled quant fits in 384 GB.