Metadata-Version: 2.1
Name: llm_inferencer
Version: 0.0.22
Summary: A collection of commonly used code
Home-page: https://github.com/jiangpw41/llm_inferencer
Author: Peiwen Jiang (Wayne)
Author-email: wayne_roaming@163.com
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Description-Content-Type: text/markdown
Requires-Dist: flask
Requires-Dist: wayne_utils
Requires-Dist: openai

# Overview
This is a package of LLMs inference, including
- Engine (vllm) and no engine;
- Local or Remote
- API or Reading file

# Tool list
