model string you pass anywhere — an agent, an orchestration, an indexing job — is a LiteLLM model ID. This guide covers the two things you need to get right: registering the provider key, and formatting the model string for that provider.
Prerequisites:
- Authentication configured (see the Connect & authenticate guide)
- An API key for the upstream provider you want to use (OpenAI, Anthropic, Google, or OpenRouter)
Model-string format
The prefix tells LiteLLM which provider to route to. Bare IDs route to first-party OpenAI/Anthropic; everything else is prefixed.| Provider | Format | Example |
|---|---|---|
| OpenAI | bare ID | gpt-4o, gpt-5.4-mini, o4-mini |
| Anthropic | bare ID | claude-sonnet-4-6 |
| Google (Gemini) | gemini/<model> | gemini/gemini-2.5-pro |
| OpenRouter | openrouter/<org>/<model> | openrouter/qwen/qwen3-235b-a22b-2507 |
Which keys do you need?
Four providers accept a bring-your-own-key (BYOK) credential:openai, anthropic, google, openrouter. Register one with the AI Provider Keys API, then point your model string at it.
If a provider is also AI-on-us on your pod (the platform has a server-side key for it), you can skip BYOK and pay in credits instead. Check which providers are covered:
cURL
402 provider_key_decrypt_failed. See the billing model for how BYOK and credits interact.
Worked example: DeepSeek via OpenRouter
Register your OpenRouter key
400 and stores nothing.Create an agent pointed at the DeepSeek model
Use the
openrouter/<org>/<model> format. DeepSeek’s OpenRouter org is deepseek:openrouter/deepseek/deepseek-chat follows the documented format, but confirm the exact slug against LiteLLM’s cost map (see the warning above) — DeepSeek publishes several models (e.g. chat vs. reasoner), and the LiteLLM key is what the platform routes on. If you give the agent tools, pick a DeepSeek model that supports function calling.Related
AI provider keys reference
Store, validate, rotate, and inspect per-project provider credentials.
Build an agent
Create an agent, assign tools and a knowledge base, then stream a conversation.
Billing model
How AI-on-us credits and BYOK keys interact, and the 402/503 error shapes.
Settings reference
Defaults like
AGENT_DEFAULT_MODEL and the curated model choices.