Metadata-Version: 2.1
Name: llama-index-llms-text-generation-inference
Version: 0.3.2
Summary: llama-index llms huggingface text generation inference integration
License: MIT
Author: Your Name
Author-email: you@example.com
Requires-Python: >=3.9,<4.0
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Dist: llama-index-core (>=0.12.0,<0.13.0)
Requires-Dist: llama-index-utils-huggingface (>=0.3.0,<0.4.0)
Requires-Dist: text-generation (>=0.7.0,<0.8.0)
Description-Content-Type: text/markdown

# LlamaIndex Llms Integration: Text Generation Inference

Integration with [Text Generation Inference](https://huggingface.co/docs/text-generation-inference) from Hugging Face to generate text.

## Installation

```shell
pip install llama-index-llms-text-generation-inference
```

## Usage

```python
from llama_index.llms.text_generation_inference import TextGenerationInference

llm = TextGenerationInference(
    model_name="openai-community/gpt2",
    temperature=0.7,
    max_tokens=100,
    token="<your-token>",  # Optional
)

response = llm.complete("Hello, how are you?")
```

