Metadata-Version: 2.4
Name: benchscope
Version: 1.0.6
Summary: LLM inference performance testing tool. Supports vLLM, SGLang, and any OpenAI-compatible API.
Author-email: benchscope <labelnet@foxmail.com>
License-Expression: Apache-2.0
Project-URL: Homepage, https://github.com/LABELNET/benchscope
Project-URL: Documentation, https://github.com/LABELNET/benchscope#readme
Project-URL: Source, https://github.com/LABELNET/benchscope
Keywords: vllm,sglang,benchmark,llm,performance-test,inference,openai-api,web-ui,benchscope
Classifier: Development Status :: 5 - Production/Stable
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: System :: Benchmark
Classifier: Framework :: FastAPI
Requires-Python: >=3.9
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: fastapi>=0.110
Requires-Dist: uvicorn[standard]>=0.29
Requires-Dist: requests>=2.31
Requires-Dist: openpyxl>=3.1
Requires-Dist: pydantic>=2
Requires-Dist: python-multipart>=0.0.9
Requires-Dist: pyyaml>=6.0
Provides-Extra: modelscope
Requires-Dist: modelscope>=1.15; extra == "modelscope"
Dynamic: license-file

<div align="center">
  <img src="asserts/black_logo.png" width="120" height="120" alt="BenchScope logo" />
</div>

<h1 align="center" style="font-size: 48px; margin-top: 12px;">BenchScope</h1>

<p align="center"><strong>English</strong> | <a href="README.zh-CN.md">简体中文</a></p>

BenchScope is an open‑source LLM inference benchmarking platform built with herness coding.

A visualization testing platform for LLM model **performance & accuracy**, supporting models deployed with vLLM / SGLang and any OpenAI-compatible inference service.

<div align="center">
  <img src="asserts/main-performance.png" width="72%" alt="BenchScope main performance screenshot" />
</div>

---

## Features

- **Easy to install** — `pip install` and one command starts the whole web platform.
- **Performance testing dual mode** — Concurrency Mode (multi-level concurrency load) and Threshold Mode (auto-search the max concurrency meeting the threshold).
- **Accuracy testing dual mode** — Online / offline testing (planned, v5.0).
- **Real-time data feedback** — every concurrency result streams into tables, charts and progress in real time.
- **Visualization curves** — multi-dimensional charts for throughput / TTFT / TPOT / ITL.
- **Log cache & download** — run logs, mean/P99 summaries and Excel export with online preview & download.

## Quick Start

```bash
# Install from PyPI
pip install benchscope

# Start
benchscope

# Options
benchscope --port 8080 --no-browser
```

## Development

See [docs/Readme.md](docs/Readme.md).

## Open Source

- **License** — [Apache License 2.0](LICENSE)
- **Published on** — [PyPI: benchscope](https://pypi.org/project/benchscope/)
- **Source** — <https://github.com/LABELNET/benchscope>
- **Contributing** — Feel free to open issues / pull requests on the source repository.
