Llama 3.1 8B Instruct

Metallama-3.1-8b

Context window131,072 tokens

StreamingJSON modeTool callingLong contextMultilingual

Maximum output: 32,768 tokens.

Pricing

Input	Output	Cached input	Cache write
$0.06 / MTok	$0.06 / MTok	$0.006 / MTok	$0.06 / MTok

Typical request (5K input / 1K output tokens): ~$0.0004. Live pricing.

Use this model

Set up your SDK client, then run:

const completion = await client.chat.completions.create({
  model: "llama-3.1-8b",
  messages: [{ role: "user", content: "Explain edge caching in one paragraph." }],
});

console.log(completion.choices[0].message.content);

completion = client.chat.completions.create(
    model="llama-3.1-8b",
    messages=[{"role": "user", "content": "Explain edge caching in one paragraph."}],
)

print(completion["choices"][0]["message"]["content"])

curl https://www.ninjachat.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $NINJACHAT_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"llama-3.1-8b","messages":[{"role":"user","content":"Explain edge caching in one paragraph."}]}'

Supported parameters

messagestemperaturemax_completion_tokenstop_pstopfrequency_penaltypresence_penaltyseedstreamuserroutingtoolstool_choiceresponse_format

Send only parameters from this list. routing.require_parameters (default true) skips any provider rail that cannot honor every requested parameter, so requests keep the behavior you asked for.

Routing & fallbacks

Pin llama-3.1-8b with model when you want this model’s behavior, or list it in an ordered models array. With ninja/auto first, the router’s top pick runs first and llama-3.1-8b is the explicit fallback; ninja/auto acts as the router only when it is the first entry.

{
  "models": [
    "ninja/auto",
    "llama-3.1-8b"
  ],
  "messages": [
    {
      "role": "user",
      "content": "Explain edge caching in one paragraph."
    }
  ],
  "routing": {
    "allow_fallbacks": true
  }
}

You are billed at the resolved model’s token rates, and only for the successful execution.

Check current availability and limits

TypeScript SDK

const model = await client.models.retrieve("llama-3.1-8b");

if (!model.servable) throw new Error("llama-3.1-8b is temporarily unavailable");

console.log({
  contextWindow: model.contextWindow,
  maxOutputTokens: model.maxOutputTokens,
  capabilities: model.capabilities,
  supportedParameters: model.supportedParameters,
  pricing: model.pricing,
  providers: model.providers,
});

Guides: Text generation · Fallbacks · Smart routing · Pricing · All models

Overview

Frontier Models

More Chat Models

Image Models

Video Models

Pricing

Use this model

Supported parameters

Routing & fallbacks

​Pricing

​Use this model

​Supported parameters

​Routing & fallbacks

Pricing

Use this model

Supported parameters

Routing & fallbacks