Llama 3.1 70B Instruct
Meta馃嚭馃嚫
meta-llama/llama-3.1-70b-instructLlama 3.1 70B Instruct is Meta's open-weight instruction-tuned model, offering strong general reasoning, chat, and coding performance with a 128K context window. It is a popular, well-balanced choice for self-hosted deployments needing near-frontier quality at open-weight cost.
Cost rate
0.1x
Context
131K
Released
Jul 23, 2024
Input
Text
Output
Text
Support
ReasoningTool callingStructured outputs
Best at
The categories where this model ranks highest.
Legal & Government
#260 路 top 67%
Medicine & Healthcare
#276 路 top 72%
Life, Physical, & Social Science
#280 路 top 68%
Entertainment, Sports, & Media
#281 路 top 68%
Performance
Median latency and throughput measured across recent requests.
Throughput34 tok/s
Latency