Skip to main content

Route with ninja/auto

Set your budget and routing strategy. NinjaChat selects an eligible model and provider.

Start routing
Your appninja/autoEligible model & provider

​
Routing strategies

Cost

Prefer lower-cost models that meet the task requirements.

Quality

Prioritize more capable models for demanding requests.

Latency

Prefer faster responses based on measured traffic.

Balanced

Use the router’s curated model order for each task.

​
Send a routed request

Set your model to ninja/auto. Add a routing strategy when you want to override the default.
Create client with your NinjaChat API key using the API quickstart. Each response identifies the model and provider used, the cost, and the request ID.

​
Control each request

Budgets & data policies

Limit request costs and choose eligible provider policies.

Fallbacks

Try another eligible model or provider when a request fails.

Compare responses

Run the same request across models to compare the results.

Request traces

Inspect cost, latency, selected models and request traces.
You pay the selected model and provider’s published rate for actual usage. See pricing for current rates.