Llama 3.1 70B Instruct

Mid-size Llama 3.1 with balanced performance.

llama-3.1-70b-instruct
STABLEGet Started
128,000 context
Starting at $0.72/M input tokens
Starting at $0.72/M output tokens
Streaming

All Providers for Llama 3.1 70B Instruct

LLM Gateway routes requests to the best providers that are able to handle your prompt size and parameters.

AWS Bedrock
Context: 128k
Input
$0.72
/M tokens
Cached
/M tokens
Output
$0.72
/M tokens
Get Started