MMeta · Released Jul 23, 2024
Llama 3.1 8B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
- Released
- Jul 23 2024
- Context window
- 131K 118K out
- Input / 1M tokens
- $0.05 from $0.02
- Output / 1M tokens
- $0.08 from $0.025
Where to run it
20 providers compared
Cheapest: DeepInfra, NanoGPT, Kilo Gateway +1 more at $0.02 / $0.04 per 1M input / output tokens — 89% less than the priciest option.
| Provider | Input | Output | Cache read | Context | Max output | Uptime | vs. best |
|---|---|---|---|---|---|---|---|
| DeepInfraFP8 · no tool calling | $0.02 | $0.04 | — | 131K | 16K | 100%24h | Cheapest |
| NanoGPT | $0.02 | $0.04 | $0.027 | 131K | 16K | — | Cheapest |
| Kilo Gateway | $0.02 | $0.04 | — | 131K | 118K | — | Cheapest |
| Inference | $0.025 | $0.025 | — | 16K | 4K | — | Cheapest |
| NovitaFP8 · no tool calling | $0.02 | $0.05 | — | 16K | 15K | 99.9%24h | +10% |
| Novita AIno tool calling | $0.02 | $0.05 | — | 16K | 16K | — | +10% |
| Abacus | $0.02 | $0.05 | — | 128K | 4K | — | +10% |
| Groq | $0.05 | $0.08 | $0.025 | 131K | 118K | 100%24h | +130% |
| Helicone | $0.05 | $0.08 | — | 131K | 33K | — | +130% |
| Hugging Face | $0.06 | $0.06 | — | 131K | 4K | — | +140% |
| Poe | $0.10 | $0.10 | — | 128K | — | — | +300% |
| CloudflareFP8 · no tool calling | $0.15 | $0.29 | — | 32K | 29K | 99.9%24h | +643% |
| Cloudflare Workers AIno tool calling | $0.15 | $0.29 | — | 32K | 32K | — | +643% |
| DigitalOcean | $0.20 | $0.20 | — | 131K | 131K | — | +692% |
| Pioneer | $0.20 | $0.20 | $0.20 | 128K | 8K | — | +700% |
| CoreWeaveBF16 | $0.22 | $0.22 | $0.22 | 131K | 118K | 100%24h | +780% |
| Vercel AI Gateway | $0.22 | $0.22 | — | 128K | 8K | — | +780% |
| Amazon Bedrock | $0.22 | $0.22 | — | 128K | 4K | — | +780% |
| Merge Gateway | $0.22 | $0.22 | — | 128K | 2K | — | +780% |
| Neon | $0.15 | $0.45 | — | 131K | 8K | — | +800% |
Value
Price vs. performance
Llama 3.1 8B Instruct Other Meta Other labs Value frontier · GPQA Diamond vs. input price per 1M tokens (log scale) · Drag to pan, pinch or Ctrl + scroll to zoom, double-click to zoom in.
Benchmarks
5 benchmark scores
| Benchmark | Score | Rank | Leader |
|---|---|---|---|
| SciCodeSoftware engineering · Research-coding problems from the natural sciences | 13.2% | #102of 102 | Claude Opus 5.566.9% |
| GPQA DiamondReasoning & knowledge · PhD-level biology, chemistry and physics questions | 27.0% | #119of 122 | Gemini 4 Argon96.4% |
| CritPtReasoning & knowledge · Open-ended, research-level physics problems | 0.0% | #92of 111 | GPT-5.6 Sol32.3% |
| LMCAReasoning & knowledge · Judge the quality of conceptual arguments like experts | 5.4% | #121of 123 | Claude Sonnet 5.568.3% |
| OTIS Mock AIMEMaths · Competition-style problems harder than MATH Level 5 | 1.7% | #117of 120 | Gemini 4 Argon100.0% |
Specs
Details
- Model ID
meta-llama/llama-3.1-8b-instruct- Developer
- Meta
- Release date
- Jul 23, 2024 ·
- Context window
- 131,072 tokens
- Max output
- 117,964 tokens
- API price
- $0.05 / $0.08 per 1M input / output tokens
- Providers
- 20
- Input types
- text
- Reasoning
- No
- Tool calling
- Yes
- Open weights
- Yes
- Free tier
- No
Release date and prices from OpenRouter's catalog; providers from OpenRouter and models.dev. Buying directly from a provider can cost a little differently. Speed, latency and uptime are measured on OpenRouter only; uptime is the share of OpenRouter requests each provider served over the last day. Benchmark scores are the best result per benchmark from Epoch AI, licensed CC BY 4.0. Rank counts every model tracked here with a score.