Metadata-Version: 2.4
Name: inferlab-integration-specialized-engine
Version: 0.2.1
Summary: Inferlab adapter integration for token-only Specialized Engines
Project-URL: Repository, https://github.com/Infer-Lab/InferLab
License-Expression: MIT
License-File: LICENSE
Requires-Python: >=3.12
Requires-Dist: inferlab-adapter-sdk==0.6.0
Description-Content-Type: text/markdown

# Inferlab Integration for Specialized Engines

This package connects Inferlab to a hardware-by-model Specialized Engine that
implements the canonical `inferlab-token-engine smg-worker` command. The Engine
accepts prompt token IDs and returns generated token IDs over SMG's worker
protocol. TokenSpeed SMG remains responsible for the public HTTP API,
tokenization, chat templates, detokenization, and response formatting.

The integration contains no model-, architecture-, hardware-, or
Engine-implementation-specific lowering. A downstream workspace supplies the
Rust Engine binary, SMG, model intent, source revision, locked environment, and
private placement bindings. Consequently, a new conforming Engine does not
need another Inferlab integration package.

The supported shape is deliberately closed: one `single` Engine replica in one
process behind one SMG Gateway. The process owns an arbitrary nonzero pure-TP
device set; attention, expert, and dense-expert tensor parallelism all equal
the outer TP width, while pipeline, data, context, and expert parallelism stay
at one. The contract remains serial and has no P/D Router, KV-transfer,
batching, or Engine-local profiling surface. InferLab can profile the Engine
process tree while TokenSpeed SMG exposes the capture-window
`POST /start_profile` and `POST /stop_profile` actions on the Gateway.
