Largest Llama 3.1 model with 405B parameters.
LLM Gateway routes requests to the best providers that are able to handle your prompt size and parameters.
Largest Llama 3.1 model with 405B parameters. You can access it through LLM Gateway's OpenAI-compatible API with automatic provider routing, fallback, and cost analytics.
Pricing for Llama 3.1 405B Instruct on LLM Gateway starts at $1.00 per million input tokens and $3.00 per million output tokens, depending on the provider. The pricing table above always reflects the current per-provider rates.
Llama 3.1 405B Instruct supports a context window of up to 128,000 tokens on its largest provider deployment.
Llama 3.1 405B Instruct is served by Nebius AI through LLM Gateway. Requests are automatically routed to the best available provider, with fallback when a provider has issues.
Yes. Llama 3.1 405B Instruct supports both tool (function) calling and structured JSON outputs through LLM Gateway.
Llama 3.1 405B Instruct was released on July 23, 2024.
Muse Spark 1.2
1,048,576 context$1.25 in / $4.25 out per 1M
Muse Spark 1.1
1,048,576 context$1.25 in / $4.25 out per 1M
Llama Guard 4 12B
163,840 context$0.18 in / $0.18 out per 1M
Llama 3.1 Nemotron Ultra 253B
128,000 context$0.60 in / $1.80 out per 1M
Llama 4 Scout
327,680 context$0.10 in / $0.30 out per 1M
Llama 4 Scout 17B Instruct
131,072 context$0.17 in / $0.59 out per 1M