Before you start
Install the Continue extension and create a key in the console. New verified accounts receive $5 in starting credit.Store your key locally
Add this line to~/.continue/.env, replacing the placeholder:
.env files; exporting a key in a terminal is not sufficient. Keep this file private and restart the editor after changing it. See Continue’s secret configuration.
Add the model
Open your local Continue configuration, normally~/.continue/config.yaml. Merge the model entry below into its models list. If you are creating the file, use the full example:
apiBase selects the compatible endpoint. The explicit tool_use capability lets Continue offer Agent mode for a custom model. See the official OpenAI-compatible setup and configuration reference.
Start using it
Select your local configuration in Continue, choosederestricted-llm, and ask it to explain a selected function. Use Chat for questions, Edit for changes, or Agent mode for tasks involving tools.
If something fails
- Secret not found: check
~/.continue/.envand restart the editor. Workspace.envfiles can override the global value. - Agent mode unavailable: ensure
capabilitiesincludestool_useand the selected model isderestricted-llm. - Other model roles: this example configures chat and edits. The gateway has no embeddings or legacy
/completionsendpoint. Use another provider for embeddings and for any autocomplete model that requires/completions. - Credit, size, or rate-limit errors: see API compatibility and troubleshooting.