* refactor: support explicit model list providers * fix(web): preserve explicit model providers * fix(web): preserve legacy provider prefixes on model updates fix(models): normalize explicit provider-prefixed ids fix(api): preserve legacy model updates across providers fix(agent): preserve config identity for explicit provider refs * fix ci
7.5 KiB
Migration Guide: From providers to model_list
This guide explains how to migrate from the legacy providers configuration to the new model_list format.
Why Migrate?
The new model_list configuration offers several advantages:
- Zero-code provider addition: Add OpenAI-compatible providers with configuration only
- Load balancing: Configure multiple endpoints for the same model
- Explicit provider resolution: Prefer
provider+ nativemodel, with legacyprovider/modelcompatibility when needed - Cleaner configuration: Model-centric instead of vendor-centric
Timeline
| Version | Status |
|---|---|
| v1.x | model_list introduced, providers deprecated but functional |
| v1.x+1 | Prominent deprecation warnings, migration tool available |
| v2.0 | providers configuration removed |
Before and After
Before: Legacy providers Configuration
{
"providers": {
"openai": {
"api_key": "sk-your-openai-key",
"api_base": "https://api.openai.com/v1"
},
"anthropic": {
"api_key": "sk-ant-your-key"
},
"deepseek": {
"api_key": "sk-your-deepseek-key"
}
},
"agents": {
"defaults": {
"provider": "openai",
"model": "gpt-5.4"
}
}
}
After: New model_list Configuration
{
"version": 3,
"model_list": [
{
"model_name": "gpt4",
"provider": "openai",
"model": "gpt-5.4",
"api_keys": ["sk-your-openai-key"],
"api_base": "https://api.openai.com/v1"
},
{
"model_name": "claude-sonnet-4.6",
"provider": "anthropic",
"model": "claude-sonnet-4.6",
"api_keys": ["sk-ant-your-key"]
},
{
"model_name": "deepseek",
"provider": "deepseek",
"model": "deepseek-chat",
"api_keys": ["sk-your-deepseek-key"]
}
],
"agents": {
"defaults": {
"model_name": "gpt4"
}
}
}
Note
: The
enabledfield can be omitted — during V1→V2 migration it is auto-inferred (models with API keys or thelocal-modelname are enabled by default). For new configs, you can explicitly set"enabled": falseto disable a model entry without removing it.
Provider / Model Resolution
Preferred format:
{
"provider": "openai",
"model": "gpt-5.4"
}
Legacy compatibility format:
{
"model": "openai/gpt-5.4"
}
Resolution rules:
- If
provideris set, PicoClaw sendsmodelunchanged. - If
provideris omitted, PicoClaw treats the first/segment inmodelas the provider and everything after that first/as the runtime model ID.
Examples:
| Config | Resolved Provider | Model Sent Upstream |
|---|---|---|
"provider": "openai", "model": "gpt-5.4" |
openai |
gpt-5.4 |
"model": "openai/gpt-5.4" |
openai |
gpt-5.4 |
"provider": "openrouter", "model": "google/gemini-2.0-flash-exp:free" |
openrouter |
google/gemini-2.0-flash-exp:free |
"model": "openrouter/google/gemini-2.0-flash-exp:free" |
openrouter |
google/gemini-2.0-flash-exp:free |
ModelConfig Fields
| Field | Required | Description |
|---|---|---|
model_name |
Yes | User-facing alias for the model |
provider |
No | Preferred provider identifier. When set, model is sent unchanged |
model |
Yes | Native model ID when provider is set, or legacy provider/model when provider is omitted |
api_base |
No | API endpoint URL |
api_keys |
No | API authentication keys (array; supports multiple keys for load balancing) |
enabled |
No | Whether this model entry is active. Defaults to true during migration for models with API keys or named local-model. Set to false to disable. |
proxy |
No | HTTP proxy URL |
auth_method |
No | Authentication method: oauth, token |
connect_mode |
No | Connection mode for CLI providers: stdio, grpc |
rpm |
No | Requests per minute limit |
max_tokens_field |
No | Field name for max tokens |
request_timeout |
No | HTTP request timeout in seconds; <=0 uses default 120s |
Note
:
api_key(singular) has been removed in V2 configs. Onlyapi_keys(array) is supported. During migration from V0/V1, bothapi_keyandapi_keysare automatically merged into the newapi_keysarray.
Load Balancing
There are two ways to configure load balancing:
Option 1: Multiple API Keys in api_keys (Recommended)
{
"model_list": [
{
"model_name": "gpt4",
"provider": "openai",
"model": "gpt-5.4",
"api_keys": ["sk-key1", "sk-key2", "sk-key3"],
"api_base": "https://api.openai.com/v1"
}
]
}
Or via .security.yml:
model_list:
gpt4:
api_keys:
- "sk-key1"
- "sk-key2"
- "sk-key3"
Option 2: Multiple Model Entries
{
"model_list": [
{
"model_name": "gpt4",
"provider": "openai",
"model": "gpt-5.4",
"api_keys": ["sk-key1"],
"api_base": "https://api1.example.com/v1"
},
{
"model_name": "gpt4",
"provider": "openai",
"model": "gpt-5.4",
"api_keys": ["sk-key2"],
"api_base": "https://api2.example.com/v1"
},
{
"model_name": "gpt4",
"provider": "openai",
"model": "gpt-5.4",
"api_keys": ["sk-key3"],
"api_base": "https://api3.example.com/v1"
}
]
}
When you request model gpt4, requests will be distributed across all three endpoints using round-robin selection.
Adding a New OpenAI-Compatible Provider
With model_list, adding a new provider requires zero code changes:
{
"model_list": [
{
"model_name": "my-custom-llm",
"provider": "openai",
"model": "my-model-v1",
"api_keys": ["your-api-key"],
"api_base": "https://api.your-provider.com/v1"
}
]
}
Just set provider to openai (or another supported provider), and provide your provider's API base URL.
Backward Compatibility
During the migration period, your existing V0/V1 config will be auto-migrated to V2:
- If
model_listis empty andprovidershas data, the system auto-converts internally - Both
api_key(singular) andapi_keys(array) in V0/V1 configs are merged into the newapi_keysarray - A deprecation warning is logged:
"providers config is deprecated, please migrate to model_list" - All existing functionality remains unchanged
Migration Checklist
- Identify all providers you're currently using
- Create
model_listentries for each provider - Prefer explicit
providervalues and native model IDs - Update
agents.defaults.model_nameto reference the newmodel_name - Test that all models work correctly
- Remove or comment out the old
providerssection
Troubleshooting
Model not found error
model "xxx" not found in model_list or providers
Solution: Ensure the model_name in model_list matches the value in agents.defaults.model_name.
Unknown protocol error
unknown provider "xxx" in model "xxx/model-name"
Solution: Use a supported provider value, or use the legacy provider/model compatibility form correctly. See Provider / Model Resolution.
Missing API key error
api_key or api_base is required for HTTP-based protocol "xxx"
Solution: Provide api_keys and/or api_base for HTTP-based providers.
Need Help?
- GitHub Issues
- Discussion #122: Original proposal