Metadata-Version: 2.5
Name: warmswap
Version: 0.0.1
Summary: Name reservation. WarmSwap is source-available and distributed under licence; see warmswap.github.io.
Project-URL: Homepage, https://warmswap.github.io/
Project-URL: Quickstart, https://warmswap.github.io/quickstart.html
Project-URL: Licence, https://warmswap.github.io/license.html
Author: Masih Moloodian
License: LicenseRef-WarmSwap-Source-Available-1.0
License-File: LICENSE
Keywords: gpu,kv-cache,llm,migration,session-continuity
Classifier: Development Status :: 1 - Planning
Classifier: Intended Audience :: System Administrators
Classifier: License :: Other/Proprietary License
Classifier: Operating System :: POSIX :: Linux
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.10
Description-Content-Type: text/markdown

# WarmSwap

**Move a running LLM generation from one GPU to another without losing it.**

When you drain a GPU worker, every in-flight session dies with it. The KV cache — everything
the model has read so far — is gone, and the user waits through a prompt they already paid
for. WarmSwap moves the cache instead: the session continues on the next GPU at the next
token, and the client streaming it sees no gap.

Measured on 2× RTX 3090 with vLLM 0.11.0 and Qwen2.5-7B-Instruct, a resumed session is
bitwise identical to one that never moved — zero differing KV positions, maximum logit delta
0.0 across 80 concurrent probes.

**→ [warmswap.github.io](https://warmswap.github.io/)**

## This package

This release reserves the name. It installs no product code.

WarmSwap is **source-available and distributed under licence**, not from this index:
production use requires a written licence and a certificate for the specific deployment
being run, because a migration is only exact when both GPUs run the same execution plan.
See the [licence](https://warmswap.github.io/license.html) and the
[quickstart](https://warmswap.github.io/quickstart.html).

Installing it is not how you get WarmSwap. Read the quickstart and get in touch.
