> ## Documentation Index
> Fetch the complete documentation index at: https://docs.aihubmix.com/llms.txt
> Use this file to discover all available pages before exploring further.

# AnythingLLM

> Connect AIHubMix in AnythingLLM with a single API key for chat and embedding models in local RAG workspaces.

AnythingLLM is an open-source AI workspace for turning documents into searchable chat knowledge bases. It supports OpenAI-compatible endpoints, so AIHubMix can be configured through **Generic OpenAI**.

## Configure AIHubMix

Download and install the desktop app from the [AnythingLLM website](https://anythingllm.com/). After opening the app, click the avatar menu in the lower-left corner and enter the settings page.

<img src="https://mintcdn.com/aihubmix/j4q_-ouc8NkeJVBQ/public/cn/AnythingLLM-new-01.png?fit=max&auto=format&n=j4q_-ouc8NkeJVBQ&q=85&s=5c90934cf3ca0a233c94b189eacfa60e" alt="AnythingLLM settings entry" width="1920" height="1002" data-path="public/cn/AnythingLLM-new-01.png" />

In settings, open the **LLM Provider** dropdown and select **Generic OpenAI**. This provider is used for OpenAI-compatible gateways such as AIHubMix.

<img src="https://mintcdn.com/aihubmix/j4q_-ouc8NkeJVBQ/public/cn/AnythingLLM-new-02.png?fit=max&auto=format&n=j4q_-ouc8NkeJVBQ&q=85&s=3c39d592689e6c72f7b430cced26ca0f" alt="AnythingLLM select Generic OpenAI" width="1920" height="1001" data-path="public/cn/AnythingLLM-new-02.png" />

Fill in the connection fields as follows:

* **Base URL**:

```text theme={null}
https://aihubmix.com/v1
```

<Note>
  If the primary API domain is unavailable, replace only the domain with `https://api.inferera.com` and keep the `/v1` path.
</Note>

* **API Key**: the key created in the [AIHubMix console](https://aihubmix.com/token).
* **Chat Model Name**: the model ID you want to use, for example `gpt-4o-mini`, `claude-haiku-4-5`, or another model copied from the AIHubMix model list.
* **Token context window** and **Max Tokens**: keep the defaults first, then adjust them after a successful test if your model needs a larger context or output limit.

<img src="https://mintcdn.com/aihubmix/j4q_-ouc8NkeJVBQ/public/cn/AnythingLLM-new-03.png?fit=max&auto=format&n=j4q_-ouc8NkeJVBQ&q=85&s=21e471c8cd64a6a8ce79fb41a576e81f" alt="AnythingLLM Base URL and API key" width="1920" height="1002" data-path="public/cn/AnythingLLM-new-03.png" />

Save the configuration, return to the chat page, select the configured model, and send a short message to verify that the model replies normally.

<img src="https://mintcdn.com/aihubmix/j4q_-ouc8NkeJVBQ/public/cn/AnythingLLM-new-04.png?fit=max&auto=format&n=j4q_-ouc8NkeJVBQ&q=85&s=b3dbfddaeb7dc883b209f4806a2366ac" alt="AnythingLLM select model" width="1920" height="1002" data-path="public/cn/AnythingLLM-new-04.png" />

You can also switch to other AIHubMix models from the same model selector after they are configured.

<img src="https://mintcdn.com/aihubmix/j4q_-ouc8NkeJVBQ/public/cn/AnythingLLM-new-05.png?fit=max&auto=format&n=j4q_-ouc8NkeJVBQ&q=85&s=f44fbf4ba8bd59271ad6ac0133a8a6b7" alt="AnythingLLM verify reply" width="1920" height="1002" data-path="public/cn/AnythingLLM-new-05.png" />

## Use Non-OpenAI Models

Keep **Generic OpenAI** selected. To use Claude, Gemini, DeepSeek, GLM, or other AIHubMix models, change **Chat Model Name** to the corresponding AIHubMix model ID. Copying the model ID from the AIHubMix model list helps avoid spelling mistakes.

## Troubleshooting

**401 or model not found**: confirm that **Generic OpenAI** is selected, the Base URL includes `/v1`, the API key starts with `sk-`, and the model ID matches AIHubMix exactly.

**Document answers are not grounded in uploaded files**: check that the embedder is configured, the documents were indexed in the current workspace, and you are chatting in the correct workspace.

**Slow replies**: reasoning models can be slower. For lightweight document Q\&A, try a faster model such as `gpt-4o-mini` or `claude-haiku-4-5`.

***

Last updated: 2026-07-03