LLaMA 7B
Find hardware that runs LLaMA 7B on your budget
Reference: Published benchmark scores
- Parameters
- 6.74 B
- Active per token
- 6.74 B
- Architecture
- Dense
- Modality
- text
- Max context
- 2048
- Released
- 2023-02-24
- License
- other
Measurements
Decode is token generation — the speed you feel while an answer streams. Prefill is prompt processing — the wait before it starts. Why bandwidth predicts decode speed.
No records yet for this model. Know of a published benchmark on it? Submit the link.
What verified, single-source and estimated mean, and the same rows with every filter and sort in the benchmarks explorer.
Speed over time
Cheapest hardware by target speed
The lowest-priced entry that reaches each threshold, using the strongest evidence available. Estimated rows are marked.