Llama 3 8B Instruct
Find hardware that runs Llama 3 8B Instruct on your budget
Reference: Model card on Hugging Face · Published benchmark scores
- Parameters
- 8.03 B
- Active per token
- 8.03 B
- Architecture
- Dense
- Modality
- text
- Max context
- 8192
- Released
- 2024-04-18
- License
- llama3
Measurements
Decode is token generation — the speed you feel while an answer streams. Prefill is prompt processing — the wait before it starts. Why bandwidth predicts decode speed.
No records yet for this model. Know of a published benchmark on it? Submit the link.
What verified, single-source and estimated mean, and the same rows with every filter and sort in the benchmarks explorer.
Speed over time
Cheapest hardware by target speed
The lowest-priced entry that reaches each threshold, using the strongest evidence available. Estimated rows are marked.