Metadata-Version: 2.5
Name: basemode
Version: 0.1.35
Summary: Make any LLM do raw text continuation
Project-URL: Homepage, https://github.com/FergusFettes/basemode
Project-URL: Documentation, https://fergusfettes.github.io/basemode/
Project-URL: Source, https://github.com/FergusFettes/basemode
Project-URL: Issues, https://github.com/FergusFettes/basemode/issues
Project-URL: Changelog, https://github.com/FergusFettes/basemode/releases
Author-email: Fergus Fettes <fergusfettes@gmail.com>
License-Expression: Apache-2.0
License-File: LICENSE
Keywords: base-model,completion,continuation,litellm,llm,prompting
Classifier: Development Status :: 4 - Beta
Classifier: Environment :: Console
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Programming Language :: Python :: 3.14
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Typing :: Typed
Requires-Python: >=3.11
Requires-Dist: anyio>=4.0.0
Requires-Dist: litellm>=1.63.0
Requires-Dist: pydantic-settings>=2.0.0
Requires-Dist: python-dotenv>=1.0.0
Requires-Dist: rich>=13.0.0
Requires-Dist: typer>=0.12.0
Provides-Extra: server
Requires-Dist: fastapi>=0.110.0; extra == 'server'
Requires-Dist: uvicorn>=0.29.0; extra == 'server'
Description-Content-Type: text/markdown

# basemode

[![PyPI](https://img.shields.io/pypi/v/basemode.svg)](https://pypi.org/project/basemode/)
[![Python](https://img.shields.io/pypi/pyversions/basemode.svg)](https://pypi.org/project/basemode/)
[![CI](https://github.com/FergusFettes/basemode/actions/workflows/ci.yml/badge.svg)](https://github.com/FergusFettes/basemode/actions/workflows/ci.yml)
[![Docs](https://img.shields.io/badge/docs-mkdocs-blue.svg)](https://fergusfettes.github.io/basemode/)
[![License](https://img.shields.io/pypi/l/basemode.svg)](https://github.com/FergusFettes/basemode/blob/main/LICENSE)

Make any LLM do raw text continuation.

`basemode` coerces chat-tuned models into clean next-token continuation mode (instead of assistant-style replies), with strategy selection handled per model/provider.

## The problem

Ask a chat-tuned model to continue a piece of text and it answers you instead:

```
> The ship rounded the headland and

I'd be happy to help continue this passage! Here's one possibility:

"The ship rounded the headland and the harbour opened before them..."

Would you like me to continue in a different style?
```

You wanted prose. You got a customer-service interaction wrapped around it.

`basemode` gets you the prose:

```console
$ basemode "The ship rounded the headland and"
The ship rounded the headland and the wind dropped all at once, as though
the cliffs had swallowed it. Sails that had been drum-tight for three days
went slack, and in the sudden quiet the crew could hear water moving along
the hull.
```

No preamble, no offer to help, no quotation marks. Just the continuation.

## How

Base models do this natively; chat-tuned models have it trained out of them. `basemode` puts it back by wrapping the prefix in whatever prompt shape a given model will actually continue — a prefilled assistant turn, a system instruction, a few-shot frame, an FIM template — because no single trick works everywhere. Anthropic models took a prefill until they didn't; some providers reject the parameter outright.

So the strategy is per-model data, not a guess. `basemode bench` scores each strategy against a model on real continuations and pins the winner; the results ship in the [verified-model table](#verified-models) below.

```console
$ basemode info claude-opus-5
```

```
┏━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ Field                  ┃ Value                                               ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ Resolved               │ anthropic/claude-opus-5                             │
│ Strategy               │ few_shot                                            │
│ Strategy source        │ verified models registry                            │
│ Quirks                 │ no_prefill, no_temperature                          │
│ Input price            │ $5.00/1M                                            │
│ Output price           │ $25.00/1M                                           │
│ Your rating            │ unrated                                             │
│ Observed health        │ 181 attempts, 1 failed (1%); last empty_response at │
│                        │ 2026-08-24T20:49:09.033360+00:00                    │
└────────────────────────┴─────────────────────────────────────────────────────┘
```

Strategy, quirks, pricing, and your own observed success rate for that model, in
one place — so a bad continuation is diagnosable rather than mysterious.

## Install

```bash
pip install basemode
```

Set provider keys via environment variables or `.env` (for example `OPENAI_API_KEY`, `ANTHROPIC_API_KEY`, `OPENROUTER_API_KEY`, `GEMINI_API_KEY`, `GROQ_API_KEY`, `TOGETHER_API_KEY`).

## Quickstart

```bash
# Single continuation (default model if configured, else fallback)
basemode "The ship rounded the headland and"

# Parallel continuations
basemode "The ship rounded the headland and" -n 3

# Inspect selected strategy and pricing metadata
basemode info claude-sonnet-4-6

# Rank coercion strategies for a model by how cleanly they continue text
basemode bench claude-sonnet-4-6

# Show only key-configured models
basemode models --available
```

## CLI

```bash
basemode --help
basemode run --help
basemode models --help
basemode info --help
basemode strategies --help
```

Useful commands:

- `basemode run` (default): stream continuation text
- `basemode models`: list models (supports `--verified` and `--json` for picker UIs)
- `basemode providers`: list provider IDs
- `basemode info`: show normalized model + prompt strategy (and where that choice came from) + pricing metadata
- `basemode bench`: rank coercion strategies for a model, and pin the winner
- `basemode default`: get/set your default model
- `basemode keys`: manage stored API keys

## Choosing a strategy

Coercion either works or it doesn't, and `basemode` scores which. `basemode bench` runs each strategy against the model over four probe prefixes — prose, technical, poetry, dialogue — and scores every result for assistant behavior: preamble, refusal, echoed prefix, chat turns, stray formatting.

```bash
basemode bench claude-opus-5 --samples   # compare
basemode bench claude-opus-5 --save      # pin the winner for this model
```

```
┏━━━━━━━━━━┳━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━┓
┃ Strategy ┃ Score ┃ Flags / error        ┃ Mean s ┃
┡━━━━━━━━━━╇━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━┩
│ few_shot │ 0.93  │ quoted               │ 2.07   │
│ system   │ 0.75  │ empty                │ 2.24   │
│ prefill  │ 0.00  │ BadRequestError: ... │ 0.30   │
└──────────┴───────┴──────────────────────┴────────┘
```

At runtime the strategy comes from the first of: an explicit `--strategy`, a local pin, the prompt method verified for that model in the table below, then model-name heuristics. `basemode info MODEL` shows which one applied.

## Server

`basemode serve` exposes an OpenAI-completions-compatible `POST /v1/completions` endpoint backed by `continue_text`/`branch_text`, so llama.cpp-style clients (e.g. [Tapestry Loom](https://github.com/transkatgirl/Tapestry-Loom)) can drive basemode's model-coerced continuations as a local backend instead of needing a locally-hosted base model.

```bash
pip install 'basemode[server]'
basemode serve --port 8080
```

Point a client's "OpenAI-style Completions" endpoint at `http://127.0.0.1:8080/v1/completions`. Requests accept `model`, `prompt`, `max_tokens`, `temperature`, `n` (parallel branches), `echo`, and `strategy`; `stream` is not supported (responses are always synchronous JSON). No logprobs are returned, since basemode routes through chat-completion coercion rather than a real base model.

## Python API

```python
from basemode import continue_text, branch_text

async for token in continue_text(
    "The ship rounded the headland and",
    model="gpt-4o-mini",
    max_tokens=120,
):
    print(token, end="", flush=True)

async for idx, token in branch_text(
    "The ship rounded the headland and",
    model="gpt-4o-mini",
    n=3,
    max_tokens=80,
):
    print(idx, token, end="", flush=True)
```

## Docs

Full docs are in `docs/` and can be served with MkDocs:

```bash
make docs-serve
```

Then open `http://localhost:8001`.

## Integration Health Checks

Run live provider checks (real APIs, key-aware skips):

```bash
uv run pytest -m integration tests/test_integration.py -q
```

This writes a machine-readable report to `dist/integration/provider_health.json` with per-model status, latency, token estimates, and estimated USD cost.

<!-- verified-models:start -->

## Verified Models

Single generated table, refreshed by CI.

| Model | Input cost (/1M) | Output cost (/1M) | Release date | Prompt method | Reliability | Quirks |
|---|---:|---:|---|---|---|---|
| `anthropic/claude-fable-5` | $10.00 | $50.00 | 2026-06-09 | `system` | ✓ | `no_prefill`, `no_temperature` |
| `anthropic/claude-haiku-4-5-20251001` | $1.00 | $5.00 | 2025-10-01 | `prefill` | ✓ |  |
| `anthropic/claude-opus-4-1-20250805` | $15.00 | $75.00 | 2025-08-05 | `prefill` | ✓ |  |
| `anthropic/claude-opus-4-20250514` | $15.00 | $75.00 | 2025-05-22 | `prefill` | ✓ |  |
| `anthropic/claude-opus-4-5-20251101` | $5.00 | $25.00 | 2025-11-24 | `prefill` | ✓ |  |
| `anthropic/claude-opus-4-6` | $5.00 | $25.00 | 2026-02-05 | `system` | ✓ | `no_prefill` |
| `anthropic/claude-opus-4-7` | $5.00 | $25.00 | 2026-04-16 | `system` | ✓ | `no_prefill`, `no_temperature` |
| `anthropic/claude-opus-4-8` | $5.00 | $25.00 | 2026-05-28 | `system` | ✓ | `no_temperature` |
| `anthropic/claude-opus-5` | $5.00 | $25.00 | 2026-07-23 | `few_shot` | ✓ | `no_prefill`, `no_temperature` |
| `anthropic/claude-sonnet-4-20250514` | $3.00 | $15.00 | 2025-05-22 | `prefill` | ✓ |  |
| `anthropic/claude-sonnet-4-5-20250929` | $3.00 | $15.00 | 2025-09-29 | `prefill` | ✓ |  |
| `anthropic/claude-sonnet-4-6` | $3.00 | $15.00 | 2026-02-17 | `system` | ✓ | `no_prefill` |
| `anthropic/claude-sonnet-5` | $2.00 | $10.00 | 2026-06-30 | `system` | ✓ | `no_prefill`, `no_temperature` |
| `cerebras/gemma-4-31b` | unknown | unknown | unknown | `system` | ⚠ |  |
| `cerebras/gpt-oss-120b` | $0.35 | $0.75 | unknown | `system` | ⚠ | `reasoning_budget` |
| `deepinfra/anthropic/claude-fable-5` | $10.00 | $50.00 | unknown | `system` | ⚠ |  |
| `deepinfra/anthropic/claude-haiku-4-5` | $1.00 | $5.00 | unknown | `prefill` | ⚠ |  |
| `deepinfra/anthropic/claude-opus-4-7` | $5.00 | $25.00 | unknown | `system` | ⚠ |  |
| `deepinfra/anthropic/claude-opus-4-8` | $5.00 | $25.00 | unknown | `system` | ⚠ |  |
| `deepinfra/anthropic/claude-opus-5` | $5.00 | $25.00 | unknown | `few_shot` | ⚠ |  |
| `deepinfra/anthropic/claude-sonnet-4-6` | $3.00 | $15.00 | unknown | `system` | ⚠ |  |
| `deepinfra/anthropic/claude-sonnet-5` | $2.00 | $10.00 | unknown | `system` | ⚠ |  |
| `deepinfra/bytedance/seed-1.8` | $0.25 | $2.00 | unknown | `system` | ⚠ |  |
| `deepinfra/bytedance/seed-2.0-code` | $0.50 | $3.00 | unknown | `system` | ⚠ |  |
| `deepinfra/bytedance/seed-2.0-mini` | $0.10 | $0.40 | unknown | `system` | ⚠ |  |
| `deepinfra/bytedance/seed-2.0-pro` | $0.50 | $3.00 | unknown | `system` | ⚠ |  |
| `deepinfra/deepseek-ai/deepseek-r1-0528` | $0.50 | $2.15 | unknown | `system` | ⚠ |  |
| `deepinfra/deepseek-ai/deepseek-v3` | $0.32 | $0.89 | unknown | `system` | ⚠ |  |
| `deepinfra/deepseek-ai/deepseek-v3-0324` | $0.24 | $0.90 | unknown | `system` | ⚠ |  |
| `deepinfra/deepseek-ai/deepseek-v3.1` | $0.25 | $0.95 | unknown | `system` | ⚠ |  |
| `deepinfra/deepseek-ai/deepseek-v3.2` | $0.26 | $0.38 | unknown | `system` | ⚠ |  |
| `deepinfra/deepseek-ai/deepseek-v4-flash` | $0.09 | $0.18 | unknown | `system` | ⚠ |  |
| `deepinfra/deepseek-ai/deepseek-v4-flash-0731` | $0.08 | $0.18 | unknown | `system` | ⚠ |  |
| `deepinfra/deepseek-ai/deepseek-v4-pro` | $1.30 | $2.60 | unknown | `system` | ⚠ |  |
| `deepinfra/deepseek-ai/deepseek-v4-pro-0813` | $1.30 | $2.60 | unknown | `system` | ⚠ |  |
| `deepinfra/google/gemini-2.5-flash` | $0.30 | $2.50 | unknown | `system` | ⚠ |  |
| `deepinfra/google/gemini-2.5-pro` | $1.25 | $10.00 | unknown | `system` | ⚠ |  |
| `deepinfra/google/gemini-3.1-flash-lite` | $0.25 | $1.50 | unknown | `system` | ⚠ |  |
| `deepinfra/google/gemini-3.1-pro` | $2.00 | $12.00 | unknown | `system` | ⚠ |  |
| `deepinfra/google/gemma-3-12b-it` | $0.05 | $0.15 | unknown | `system` | ⚠ |  |
| `deepinfra/google/gemma-3-27b-it` | $0.08 | $0.16 | unknown | `system` | ⚠ |  |
| `deepinfra/google/gemma-3-4b-it` | $0.05 | $0.10 | unknown | `system` | ⚠ |  |
| `deepinfra/google/gemma-4-26b-a4b-it` | $0.07 | $0.34 | unknown | `system` | ⚠ |  |
| `deepinfra/google/gemma-4-31b-it` | $0.13 | $0.38 | unknown | `system` | ⚠ |  |
| `deepinfra/google/gemma-4-31b-it-turbo` | $0.09 | $0.34 | unknown | `system` | ⚠ |  |
| `deepinfra/google/gemma-4-31b-it-ultra` | $0.27 | $0.76 | unknown | `system` | ⚠ |  |
| `deepinfra/google/gemma-4-e4b-it` | $0.02 | $0.10 | unknown | `system` | ⚠ |  |
| `deepinfra/gryphe/mythomax-l2-13b` | $0.40 | $0.40 | unknown | `system` | ⚠ |  |
| `deepinfra/inclusionai/ling-3.0-flash` | $0.06 | $0.18 | unknown | `system` | ⚠ |  |
| `deepinfra/meta-llama/llama-3.3-70b-instruct-turbo` | $0.10 | $0.32 | unknown | `system` | ⚠ |  |
| `deepinfra/meta-llama/llama-4-scout-17b-16e-instruct` | $0.10 | $0.30 | unknown | `system` | ⚠ |  |
| `deepinfra/meta-llama/meta-llama-3.1-70b-instruct-turbo` | $0.40 | $0.40 | unknown | `system` | ⚠ |  |
| `deepinfra/meta-llama/meta-llama-3.1-8b-instruct-turbo` | $0.02 | $0.04 | unknown | `system` | ⚠ |  |
| `deepinfra/microsoft/phi-4` | $0.07 | $0.14 | unknown | `system` | ⚠ |  |
| `deepinfra/minimaxai/minimax-m2.7` | $0.25 | $1.00 | unknown | `system` | ⚠ |  |
| `deepinfra/minimaxai/minimax-m3` | $0.28 | $1.10 | unknown | `system` | ⚠ |  |
| `deepinfra/mistralai/mistral-nemo-instruct-2407` | $0.02 | $0.03 | unknown | `system` | ⚠ |  |
| `deepinfra/mistralai/mistral-small-24b-instruct-2501` | $0.05 | $0.08 | unknown | `system` | ⚠ |  |
| `deepinfra/mistralai/mistral-small-3.2-24b-instruct-2506` | $0.07 | $0.20 | unknown | `system` | ⚠ |  |
| `deepinfra/moonshotai/kimi-k2.5` | $0.45 | $2.25 | unknown | `system` | ⚠ |  |
| `deepinfra/moonshotai/kimi-k2.6` | $0.75 | $3.50 | unknown | `system` | ⚠ |  |
| `deepinfra/moonshotai/kimi-k2.7-code` | $0.68 | $3.40 | unknown | `system` | ⚠ |  |
| `deepinfra/moonshotai/kimi-k3` | $2.85 | $14.25 | unknown | `prefill` | ⚠ | `no_temperature` |
| `deepinfra/nousresearch/hermes-3-llama-3.1-405b` | $1.00 | $1.00 | unknown | `system` | ⚠ |  |
| `deepinfra/nousresearch/hermes-3-llama-3.1-70b` | $0.70 | $0.70 | unknown | `system` | ⚠ |  |
| `deepinfra/nvidia/nemotron-3-nano-30b-a3b` | $0.05 | $0.20 | unknown | `system` | ⚠ |  |
| `deepinfra/nvidia/nvidia-nemotron-3-super-120b-a12b` | $0.08 | $0.40 | unknown | `system` | ⚠ |  |
| `deepinfra/nvidia/nvidia-nemotron-3.5-lightning` | $0.08 | $0.20 | unknown | `system` | ⚠ |  |
| `deepinfra/openai/gpt-oss-120b-turbo` | $0.15 | $0.60 | unknown | `system` | ⚠ | `reasoning_budget` |
| `deepinfra/openai/gpt-oss-120b-ultra` | $0.20 | $0.95 | unknown | `system` | ⚠ | `reasoning_budget` |
| `deepinfra/openai/gpt-oss-20b` | $0.03 | $0.14 | unknown | `system` | ⚠ | `reasoning_budget` |
| `deepinfra/qwen/qwen2.5-72b-instruct` | $0.36 | $0.40 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3-14b` | $0.12 | $0.24 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3-235b-a22b-instruct-2507` | $0.09 | $0.55 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3-30b-a3b` | $0.12 | $0.50 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3-32b` | $0.08 | $0.28 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3-coder-480b-a35b-instruct-turbo` | $0.30 | $1.00 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3-max` | $1.20 | $6.00 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3-max-thinking` | $1.20 | $6.00 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3-next-80b-a3b-instruct` | $0.09 | $1.10 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3-vl-235b-a22b-instruct` | $0.20 | $0.88 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3-vl-30b-a3b-instruct` | $0.15 | $0.60 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3.5-122b-a10b` | $0.29 | $2.40 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3.5-27b` | $0.26 | $2.60 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3.5-35b-a3b` | $0.14 | $1.00 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3.5-397b-a17b` | $0.45 | $3.00 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3.5-9b` | $0.10 | $0.15 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3.6-35b-a3b` | $0.10 | $0.95 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3.7-max` | $2.50 | $7.50 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3.8-2.4t-a95b` | $2.00 | $6.00 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3.8-27b` | $0.40 | $3.00 | unknown | `system` | ⚠ |  |
| `deepinfra/qwen/qwen3.8-max` | $1.65 | $4.95 | unknown | `system` | ⚠ |  |
| `deepinfra/sao10k/l3-8b-lunaris-v1-turbo` | $0.04 | $0.05 | unknown | `system` | ⚠ |  |
| `deepinfra/sao10k/l3.1-70b-euryale-v2.2` | $0.85 | $0.85 | unknown | `system` | ⚠ |  |
| `deepinfra/thinkingmachines/inkling` | $0.95 | $4.05 | unknown | `system` | ⚠ |  |
| `deepinfra/thinkingmachines/inkling-small` | $0.45 | $1.20 | unknown | `system` | ⚠ |  |
| `deepinfra/xiaomimimo/mimo-v2.5` | $0.40 | $2.00 | unknown | `system` | ⚠ |  |
| `deepinfra/xiaomimimo/mimo-v2.5-pro` | $1.00 | $3.00 | unknown | `system` | ⚠ |  |
| `deepinfra/zai-org/glm-4.6` | $0.50 | $2.00 | unknown | `system` | ⚠ |  |
| `deepinfra/zai-org/glm-4.7` | $0.40 | $1.75 | unknown | `system` | ⚠ | `reasoning_budget` |
| `deepinfra/zai-org/glm-4.7-flash` | $0.06 | $0.40 | unknown | `system` | ⚠ | `reasoning_budget` |
| `deepinfra/zai-org/glm-5` | $0.60 | $2.08 | unknown | `system` | ⚠ |  |
| `deepinfra/zai-org/glm-5.1` | $1.05 | $3.50 | unknown | `system` | ⚠ |  |
| `deepinfra/zai-org/glm-5.2` | $0.75 | $2.40 | unknown | `system` | ⚠ |  |
| `deepseek/deepseek-v4-flash` | $0.44 | $1.32 | unknown | `system` | ⚠ | `reasoning_budget` |
| `deepseek/deepseek-v4-flash-vision-exp` | $0.44 | $1.32 | unknown | `system` | ⚠ | `reasoning_budget` |
| `deepseek/deepseek-v4-pro` | $1.32 | $3.96 | unknown | `system` | ⚠ | `reasoning_budget` |
| `gemini/gemini-2.5-flash` | $0.30 | $2.50 | 2025-06-17 | `system` | ⚠ |  |
| `gemini/gemini-2.5-flash-lite` | $0.10 | $0.40 | 2025-07-22 | `system` | ⚠ |  |
| `gemini/gemini-2.5-pro` | $1.25 | $10.00 | 2025-06-17 | `system` | ⚠ |  |
| `gemini/gemini-3-flash-preview` | $0.50 | $3.00 | 2025-12-17 | `system` | ✓ |  |
| `gemini/gemini-3-pro-image` | $2.00 | $12.00 | 2026-05-28 | `prefill` | ✓ |  |
| `gemini/gemini-3-pro-image-preview` | $2.00 | $12.00 | 2026-05-28 | `prefill` | ✓ |  |
| `gemini/gemini-3.1-flash-image` | $0.50 | $3.00 | 2026-05-28 | `system` | ✓ |  |
| `gemini/gemini-3.1-flash-image-preview` | $0.50 | $3.00 | 2026-05-28 | `system` | ✓ |  |
| `gemini/gemini-3.1-flash-lite` | $0.25 | $1.50 | 2026-06-30 | `system` | ✓ |  |
| `gemini/gemini-3.1-flash-lite-image` | $0.25 | $1.50 | 2026-06-30 | `system` | ✓ |  |
| `gemini/gemini-3.1-flash-lite-preview` | $0.25 | $1.50 | 2026-05-07 | `system` | ✓ |  |
| `gemini/gemini-3.1-pro-preview` | $2.00 | $12.00 | 2026-02-19 | `system` | ✓ |  |
| `gemini/gemini-3.1-pro-preview-customtools` | $2.00 | $12.00 | 2026-02-19 | `prefill` | ✓ |  |
| `gemini/gemini-3.5-flash` | $1.50 | $9.00 | 2026-07-21 | `system` | ✓ |  |
| `gemini/gemini-3.5-flash-lite` | $0.30 | $2.50 | 2026-07-21 | `system` | ✓ |  |
| `gemini/gemini-3.6-flash` | $0.75 | $3.75 | 2026-07-21 | `system` | ✓ |  |
| `gemini/gemini-flash-lite-latest` | $0.10 | $0.40 | unknown | `system` | ⚠ |  |
| `gemini/gemini-pro-latest` | $1.25 | $10.00 | 2026-04-27 | `system` | ⚠ |  |
| `gemini/gemini-robotics-er-1.6-preview` | $1.00 | $5.00 | unknown | `prefill` | ⚠ |  |
| `gemini/gemini-robotics-er-2-preview` | $2.00 | $10.00 | unknown | `system` | ⚠ |  |
| `gemini/gemma-4-26b-a4b-it` | $0.07 | $0.34 | 2026-04-03 | `system` | ⚠ | `reasoning_budget` |
| `gemini/gemma-4-31b-it` | $0.09 | $0.34 | 2026-04-02 | `system` | ⚠ | `reasoning_budget` |
| `gemini/nano-banana-pro-preview` | unknown | unknown | unknown | `prefill` | ⚠ |  |
| `groq/allam-2-7b` | unknown | unknown | unknown | `system` | ⚠ |  |
| `groq/groq/compound` | unknown | unknown | unknown | `system` | ⚠ |  |
| `groq/groq/compound-mini` | unknown | unknown | unknown | `system` | ⚠ |  |
| `groq/openai/gpt-oss-120b` | $0.15 | $0.60 | unknown | `system` | ⚠ | `reasoning_budget` |
| `groq/openai/gpt-oss-20b` | $0.07 | $0.30 | unknown | `system` | ⚠ | `reasoning_budget` |
| `groq/qwen/qwen3.6-27b` | $0.60 | $3.00 | 2026-04-22 | `system` | ✓ |  |
| `moonshot/kimi-k2-0905-preview` | $0.60 | $2.50 | 2025-07-11 | `system` | ⚠ |  |
| `moonshot/kimi-k2.5` | $0.60 | $3.00 | 2026-01-27 | `system` | ⚠ | `no_temperature` |
| `moonshot/kimi-k2.6` | $0.95 | $4.00 | 2026-04-20 | `system` | ✓ | `no_temperature` |
| `moonshot/kimi-k2.7-code` | unknown | unknown | unknown | `system` | ⚠ | `no_temperature`, `reasoning_budget` |
| `moonshot/kimi-k2.7-code-highspeed` | unknown | unknown | unknown | `system` | ⚠ | `no_temperature`, `reasoning_budget` |
| `moonshot/kimi-k3` | $3.00 | $15.00 | 2026-07-15 | `prefill` | ✓ | `no_temperature` |
| `moonshot/moonshot-v1-128k` | $2.00 | $5.00 | unknown | `system` | ⚠ |  |
| `moonshot/moonshot-v1-128k-vision-preview` | $2.00 | $5.00 | unknown | `system` | ⚠ |  |
| `moonshot/moonshot-v1-32k` | $1.00 | $3.00 | unknown | `system` | ⚠ |  |
| `moonshot/moonshot-v1-32k-vision-preview` | $1.00 | $3.00 | unknown | `system` | ⚠ |  |
| `moonshot/moonshot-v1-8k` | $0.20 | $2.00 | unknown | `system` | ⚠ |  |
| `moonshot/moonshot-v1-8k-vision-preview` | $0.20 | $2.00 | unknown | `system` | ⚠ |  |
| `moonshot/moonshot-v1-auto` | $2.00 | $5.00 | 2023-11-08 | `system` | ⚠ |  |
| `novita/baidu/ernie-4.5-vl-424b-a47b` | $0.42 | $1.25 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-r1` | $4.00 | $4.00 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-r1-0528` | $0.70 | $2.50 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-r1-distill-llama-70b` | $0.80 | $0.80 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-r1-turbo` | $0.70 | $2.50 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-v3-0324` | $0.27 | $1.12 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-v3-turbo` | $0.40 | $1.30 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-v3.1` | $0.27 | $1.00 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-v3.1-terminus` | $0.27 | $1.00 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-v3.2` | $0.27 | $0.40 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-v3.2-exp` | $0.27 | $0.41 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-v4-flash` | $0.14 | $0.28 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-v4-flash-0731` | $0.44 | $1.32 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-v4-flash-vision-exp` | $0.44 | $1.32 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-v4-pro` | $1.60 | $3.20 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek-v4-pro-0813` | $1.32 | $3.96 | unknown | `system` | ⚠ |  |
| `novita/deepseek/deepseek_v3` | $0.89 | $0.89 | unknown | `system` | ⚠ |  |
| `novita/google/gemma-3-27b-it` | $0.12 | $0.20 | unknown | `system` | ⚠ |  |
| `novita/google/gemma-4-26b-a4b-it` | $0.13 | $0.40 | unknown | `system` | ⚠ |  |
| `novita/google/gemma-4-31b-it` | $0.14 | $0.40 | unknown | `system` | ⚠ |  |
| `novita/inclusionai/ling-3.0-flash` | $0.06 | $0.18 | unknown | `system` | ⚠ |  |
| `novita/inclusionai/ling-3.0-flash-fast` | $0.06 | $0.18 | unknown | `system` | ⚠ |  |
| `novita/inclusionai/ling-3.0-flash-fin` | unknown | unknown | unknown | `system` | ⚠ |  |
| `novita/kwaipilot/kat-coder-pro` | $0.30 | $1.20 | unknown | `system` | ⚠ |  |
| `novita/meta-llama/llama-3.1-8b-instruct` | $0.02 | $0.05 | unknown | `system` | ⚠ |  |
| `novita/meta-llama/llama-3.3-70b-instruct` | $0.14 | $0.40 | unknown | `system` | ⚠ |  |
| `novita/meta-llama/llama-4-maverick-17b-128e-instruct-fp8` | $0.27 | $0.85 | unknown | `system` | ⚠ |  |
| `novita/meta-llama/llama-4-scout-17b-16e-instruct` | $0.18 | $0.59 | unknown | `system` | ⚠ |  |
| `novita/microsoft/wizardlm-2-8x22b` | $0.62 | $0.62 | unknown | `system` | ⚠ |  |
| `novita/mindai/macaron-v1-venti` | $1.50 | $4.50 | unknown | `system` | ⚠ |  |
| `novita/minimax/m2-her` | unknown | unknown | unknown | `system` | ⚠ |  |
| `novita/minimax/minimax-m2` | $0.30 | $1.20 | unknown | `system` | ⚠ |  |
| `novita/minimax/minimax-m2.1` | $0.30 | $1.20 | unknown | `system` | ⚠ |  |
| `novita/minimax/minimax-m2.5` | $0.30 | $1.20 | unknown | `system` | ⚠ |  |
| `novita/minimax/minimax-m2.5-highspeed` | $0.60 | $2.40 | unknown | `system` | ⚠ |  |
| `novita/minimax/minimax-m2.7` | $0.30 | $1.20 | unknown | `system` | ⚠ |  |
| `novita/minimax/minimax-m2.7-highspeed` | $0.60 | $2.40 | unknown | `system` | ⚠ |  |
| `novita/minimax/minimax-m3` | $0.30 | $1.20 | unknown | `system` | ⚠ |  |
| `novita/minimaxai/minimax-m1-80k` | $0.55 | $2.20 | unknown | `system` | ⚠ |  |
| `novita/mistralai/mistral-nemo` | $0.04 | $0.17 | unknown | `system` | ⚠ |  |
| `novita/moonshotai/kimi-k2-0905` | $0.60 | $2.50 | unknown | `system` | ⚠ |  |
| `novita/moonshotai/kimi-k2-instruct` | $0.57 | $2.30 | unknown | `system` | ⚠ |  |
| `novita/moonshotai/kimi-k2.5` | $0.60 | $3.00 | unknown | `system` | ⚠ |  |
| `novita/moonshotai/kimi-k2.6` | $0.80 | $3.40 | unknown | `system` | ⚠ |  |
| `novita/moonshotai/kimi-k2.7-code` | $0.95 | $4.00 | unknown | `system` | ⚠ |  |
| `novita/moonshotai/kimi-k3` | $3.00 | $15.00 | unknown | `prefill` | ⚠ | `no_temperature` |
| `novita/nvidia/nemotron-3-nano-30b-a3b` | $0.05 | $0.20 | unknown | `system` | ⚠ |  |
| `novita/openai/gpt-oss-120b` | $0.05 | $0.25 | unknown | `system` | ⚠ | `reasoning_budget` |
| `novita/openai/gpt-oss-20b` | $0.04 | $0.15 | unknown | `system` | ⚠ | `reasoning_budget` |
| `novita/qwen/qwen-2.5-72b-instruct` | $0.38 | $0.40 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-235b-a22b-fp8` | $0.20 | $0.80 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-235b-a22b-instruct-2507` | $0.09 | $0.58 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-235b-a22b-thinking-2507` | $0.30 | $3.00 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-coder-30b-a3b-instruct` | $0.07 | $0.27 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-coder-480b-a35b-instruct` | $0.38 | $1.55 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-coder-next` | $0.20 | $1.50 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-max` | $2.11 | $8.45 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-next-80b-a3b-instruct` | $0.15 | $1.50 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-omni-30b-a3b-instruct` | $0.25 | $0.97 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-omni-30b-a3b-thinking` | $0.25 | $0.97 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-vl-235b-a22b-instruct` | $0.30 | $1.50 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-vl-235b-a22b-thinking` | $0.98 | $3.95 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3-vl-30b-a3b-instruct` | $0.20 | $0.70 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3.5-122b-a10b` | $0.40 | $3.20 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3.5-27b` | $0.30 | $2.40 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3.5-35b-a3b` | $0.25 | $2.00 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3.5-397b-a17b` | $0.60 | $3.60 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3.5-plus` | unknown | unknown | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3.6-27b` | $0.60 | $3.60 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3.6-35b-a3b` | $0.25 | $1.49 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3.6-plus` | unknown | unknown | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3.7-max` | $1.25 | $3.75 | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3.8-27b` | unknown | unknown | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3.8-flash` | unknown | unknown | unknown | `system` | ⚠ |  |
| `novita/qwen/qwen3.8-max` | $2.00 | $6.00 | unknown | `system` | ⚠ |  |
| `novita/sao10k/l3-8b-lunaris` | $0.05 | $0.05 | unknown | `system` | ⚠ |  |
| `novita/sao10k/l31-70b-euryale-v2.2` | $1.48 | $1.48 | unknown | `system` | ⚠ |  |
| `novita/thudm/glm-4-32b-0414` | $0.55 | $1.66 | unknown | `system` | ⚠ |  |
| `novita/xiaomimimo/mimo-v2.5` | $0.17 | $0.34 | unknown | `system` | ⚠ |  |
| `novita/xiaomimimo/mimo-v2.5-pro` | $0.52 | $1.04 | unknown | `system` | ⚠ |  |
| `novita/zai-org/autoglm-phone-9b-multilingual` | $0.04 | $0.14 | unknown | `system` | ⚠ |  |
| `novita/zai-org/glm-4.5-air` | $0.13 | $0.85 | unknown | `system` | ⚠ |  |
| `novita/zai-org/glm-4.5v` | $0.60 | $1.80 | unknown | `system` | ⚠ |  |
| `novita/zai-org/glm-4.7` | $0.60 | $2.20 | unknown | `system` | ⚠ |  |
| `novita/zai-org/glm-5` | $1.00 | $3.20 | unknown | `system` | ⚠ |  |
| `novita/zai-org/glm-5-turbo` | $1.20 | $4.00 | unknown | `system` | ⚠ |  |
| `novita/zai-org/glm-5.1` | $1.38 | $4.40 | unknown | `system` | ⚠ |  |
| `novita/zai-org/glm-5.2` | $1.40 | $4.40 | unknown | `system` | ⚠ |  |
| `novita/zai-org/glm-5.3` | $1.40 | $4.40 | unknown | `system` | ⚠ |  |
| `novita/zai-org/glm-5v-turbo` | $1.20 | $4.00 | unknown | `system` | ⚠ |  |
| `openai/gpt-4-turbo-2024-04-09` | $10.00 | $30.00 | 2024-04-09 | `system` | ⚠ |  |
| `openai/gpt-4.1` | $2.00 | $8.00 | 2025-04-14 | `system` | ✓ |  |
| `openai/gpt-4.1-2025-04-14` | $2.00 | $8.00 | 2025-04-14 | `system` | ✓ |  |
| `openai/gpt-4.1-mini` | $0.40 | $1.60 | 2025-04-14 | `system` | ✓ |  |
| `openai/gpt-4.1-mini-2025-04-14` | $0.40 | $1.60 | 2025-04-14 | `system` | ✓ |  |
| `openai/gpt-4.1-nano` | $0.10 | $0.40 | 2025-04-14 | `system` | ✓ |  |
| `openai/gpt-4.1-nano-2025-04-14` | $0.10 | $0.40 | 2025-04-14 | `system` | ✓ |  |
| `openai/gpt-4o` | $2.50 | $10.00 | 2024-11-20 | `system` | ✓ |  |
| `openai/gpt-4o-2024-05-13` | $5.00 | $15.00 | 2024-05-13 | `system` | ⚠ |  |
| `openai/gpt-4o-2024-08-06` | $2.50 | $10.00 | 2024-08-06 | `system` | ✓ |  |
| `openai/gpt-4o-2024-11-20` | $2.50 | $10.00 | 2024-11-20 | `system` | ✓ |  |
| `openai/gpt-4o-mini` | $0.15 | $0.60 | 2024-07-18 | `system` | ⚠ |  |
| `openai/gpt-4o-mini-2024-07-18` | $0.15 | $0.60 | 2024-07-18 | `system` | ⚠ |  |
| `openai/gpt-5.1` | $1.25 | $10.00 | 2025-12-04 | `system` | ✓ |  |
| `openai/gpt-5.1-2025-11-13` | $1.25 | $10.00 | 2025-11-13 | `system` | ✓ |  |
| `openai/gpt-5.2` | $1.75 | $14.00 | 2026-01-14 | `system` | ✓ |  |
| `openai/gpt-5.2-2025-12-11` | $1.75 | $14.00 | 2025-12-11 | `system` | ✓ |  |
| `openai/gpt-5.2-pro` | $21.00 | $168.00 | 2025-12-11 | `system` | ✓ | `no_temperature` |
| `openai/gpt-5.2-pro-2025-12-11` | $21.00 | $168.00 | 2025-12-11 | `system` | ✓ | `no_temperature` |
| `openai/gpt-5.3-codex` | $1.75 | $14.00 | 2026-02-24 | `system` | ✓ | `no_temperature` |
| `openai/gpt-5.4` | $2.50 | $15.00 | 2026-04-21 | `system` | ✓ |  |
| `openai/gpt-5.4-2026-03-05` | $2.50 | $15.00 | 2026-03-05 | `system` | ✓ |  |
| `openai/gpt-5.4-mini` | $0.75 | $4.50 | 2026-03-17 | `system` | ✓ |  |
| `openai/gpt-5.4-mini-2026-03-17` | $0.75 | $4.50 | 2026-03-17 | `system` | ✓ |  |
| `openai/gpt-5.4-nano` | $0.20 | $1.25 | 2026-03-17 | `system` | ✓ |  |
| `openai/gpt-5.4-nano-2026-03-17` | $0.20 | $1.25 | 2026-03-17 | `system` | ✓ |  |
| `openai/gpt-5.5` | $5.00 | $30.00 | 2026-04-23 | `system` | ✓ | `no_temperature` |
| `openai/gpt-5.5-2026-04-23` | $5.00 | $30.00 | 2026-04-23 | `system` | ✓ | `no_temperature` |
| `openai/gpt-5.6-sol` | $4.00 | $20.00 | 2026-07-09 | `system` | ✓ | `no_temperature` |
| `openai/gpt-5.6-terra` | $2.00 | $12.00 | 2026-07-09 | `system` | ✓ | `no_temperature` |
| `openrouter/moonshotai/kimi-k2.6` | $0.95 | $4.00 | 2026-04-20 | `system` | ⚠ | `no_temperature` |
| `together_ai/deepseek-ai/DeepSeek-V4-Pro-0813` | $1.32 | $3.96 | unknown | `system` | ⚠ | `reasoning_budget` |
| `xai/grok-4.20-0309-non-reasoning` | $1.25 | $2.50 | 2026-03-09 | `system` | ✓ |  |
| `xai/grok-4.20-0309-reasoning` | $1.25 | $2.50 | 2026-03-09 | `system` | ✓ |  |
| `xai/grok-4.3` | $1.25 | $2.50 | 2026-04-30 | `system` | ✓ |  |
| `xai/grok-4.5` | $2.00 | $6.00 | 2026-07-08 | `system` | ✓ |  |
| `xai/grok-4.6` | $2.00 | $6.00 | 2026-08-10 | `system` | ✓ |  |
| `xai/grok-build-0.1` | $1.00 | $2.00 | 2026-05-20 | `system` | ✓ |  |
| `zai/glm-4.5` | $0.60 | $2.20 | 2025-08-11 | `system` | ⚠ |  |
| `zai/glm-4.5-air` | $0.20 | $1.10 | 2025-07-25 | `system` | ⚠ |  |
| `zai/glm-4.6` | $0.60 | $2.20 | 2025-12-08 | `system` | ✓ |  |
| `zai/glm-4.7` | $0.60 | $2.20 | 2025-12-22 | `system` | ✓ |  |
| `zai/glm-5` | $1.00 | $3.20 | 2026-02-11 | `system` | ✓ |  |
| `zai/glm-5-turbo` | $1.20 | $4.00 | 2026-03-15 | `system` | ⚠ |  |
| `zai/glm-5.1` | $1.40 | $4.40 | 2026-04-06 | `system` | ✓ |  |
| `zai/glm-5.2` | $1.19 | $3.74 | 2026-06-16 | `system` | ⚠ |  |

Legend: `✓` = LiteLLM pricing present and release date available; `⚠` = missing/approximate field or known issue.

<!-- verified-models:end -->
