Docs/Editors

Continue

Use the Continue extension for VS Code and JetBrains with your Osarai GPU for chat, edits and agent mode, from one config.yaml.

Continue adds chat, inline edits and an agent to VS Code and JetBrains IDEs. Its extensions and the Continue CLI share one configuration file, so a model you add here works in all of them.

#Configure

Open Continue's panel, press the gear icon and choose Open configuration file, or edit the file directly:

name: Osarai
version: 1.0.0
schema: v1
models:
  - name: Qwen3.8 27B (Osarai)
    provider: openai
    model: qwen3.8-27b
    apiBase: https://osarai.xyz/v1
    apiKey: ${{ secrets.OSARAI_API_KEY }}
    roles:
      - chat
      - edit
      - apply
    capabilities:
      - tool_use
    defaultCompletionOptions:
      contextLength: 131072
      maxTokens: 16384

Keep the key in Continue's secrets file next to it:

OSARAI_API_KEY=qck_your_key_here

On Windows the folder is %USERPROFILE%\.continue.

• roles decides where the model appears: chat for the chat panel and agent mode, edit and apply for inline changes.
• capabilities: [tool_use] enables agent mode, which reads and edits files with tools.
• contextLength is your instance's context window.

#Embeddings for @codebase

To search your code by meaning, run qwen3-embedding-8b on a second instance and add it with the embed role:

models:
  # … the chat model above …
  - name: Qwen3 Embedding 8B (Osarai)
    provider: openai
    model: qwen3-embedding-8b
    apiBase: https://osarai.xyz/v1
    apiKey: ${{ secrets.OSARAI_API_KEY }}
    roles:
      - embed

Requests go to the instance whose model matches model. See Embeddings.

#Troubleshooting