llm-api.md

LLM API

Table of contents

• About LLM API
• LLM API key
  • <llm-api-key> placeholder
• LLM API base URL
  • <llm-api-base-url> placeholder
• LLM API model
  • <llm-api-model> placeholder

About LLM API

The LLM API is the OpenAI-compatible API that the bot uses to generate responses from an LLM.

You choose which LLM provider API to use:

• the Qwen Code API on your VM
• the OpenRouter API

LLM API key

The API key for your LLM provider API.

• For the Qwen Code API:

  the value of QWEN_CODE_API_KEY from qwen-code-api/.env.secret.

• For the OpenRouter API:

  your OpenRouter API key.

<llm-api-key> placeholder

The LLM API key (without < and >).

LLM API base URL

The base URL of the OpenAI-compatible API endpoint.

• For the Qwen Code API on your VM:

  <lms-api-url>/utils/qwen-code-api/v1.

  See <lms-api-url>.

• For the OpenRouter API:

  https://openrouter.ai/api/v1.

<llm-api-base-url> placeholder

The LLM API base URL (without < and >).

LLM API model

The name of the LLM model to use via the LLM provider API.

• For the Qwen Code API:

  coder-model.

  See View available models.

• For the OpenRouter API:

  meta-llama/llama-3.3-70b-instruct:free.

<llm-api-model> placeholder

The LLM API model (without < and >).