Llama 3.1 70b Instruct API
Run nim/meta/llama-3.1-70b-instruct through FastInfra's API.
Pay per token, no subscription, routed to the cheapest available provider.
Llama 3.1 70b Instruct pricing
Billed per token used. Prices sync automatically from wholesale providers.
| Direction | Price per 1M tokens |
|---|---|
| Input | $0.42 |
| Output | $0.42 |
2 routes available
Requests route to route-07 by default (lowest cost). FastInfra fails over automatically if a route is unavailable.
| Route label | Model ID |
|---|---|
route-07 |
nim/meta/llama-3.1-70b-instruct |
route-03 |
nim/meta/llama-3.1-70b-instruct |
Call Llama 3.1 70b Instruct in 30 seconds
Works with any OpenAI SDK — change the base URL and API key only.
Python
from openai import OpenAI
client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.fastinfra.ai/v1")
response = client.chat.completions.create(
model="nim/meta/llama-3.1-70b-instruct",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)curl
curl https://api.fastinfra.ai/v1/chat/completions \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "nim/meta/llama-3.1-70b-instruct",
"messages": [{"role": "user", "content": "Hello!"}]
}'Llama 3.1 70b Instruct — common questions
How much does the nim/meta/llama-3.1-70b-instruct API cost?
On FastInfra, nim/meta/llama-3.1-70b-instruct costs $0.42/1M input, $0.42/1M output tokens. Billing is per token used, with no subscription.
Is nim/meta/llama-3.1-70b-instruct compatible with the OpenAI SDK?
Yes. FastInfra exposes nim/meta/llama-3.1-70b-instruct through an OpenAI-compatible endpoint at https://api.fastinfra.ai/v1 — point any OpenAI SDK at that base URL with a FastInfra API key and keep your existing code.
How does routing work for nim/meta/llama-3.1-70b-instruct?
nim/meta/llama-3.1-70b-instruct is available on 2 route(s): route-07, route-03. Requests use route-07 by default (lowest cost). FastInfra fails over automatically if a route is unavailable.
Related models
Compare side by side: Llama 3.1 70b Instruct vs Llama3.1:8b · Llama 3.1 70b Instruct vs Llama3.2:1b · Llama 3.1 70b Instruct vs Llama3.2:3b