Metadata-Version: 2.2
Name: nexa_enterprise
Version: 0.0.9.8
Summary: Nexa AI SDK for Enterprise
Author-Email: Nexa AI <octopus@nexa4ai.com>
License: MIT
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Project-URL: Homepage, https://github.com/NexaAI/nexa-sdk-enterprise
Requires-Dist: cmake
Requires-Dist: faster_whisper
Requires-Dist: typing-extensions>=4.5.0
Requires-Dist: numpy>=1.20.0
Requires-Dist: diskcache>=5.6.1
Requires-Dist: jinja2>=2.11.3
Requires-Dist: uvicorn
Requires-Dist: pydantic
Requires-Dist: huggingface_hub
Requires-Dist: prompt_toolkit
Requires-Dist: tqdm
Requires-Dist: tabulate
Requires-Dist: python-multipart
Requires-Dist: cmake
Description-Content-Type: text/markdown

# Nexa-SDK-Enterprise

Enterprise SDK for Nexa AI's model serving on edge devices.

## Python Package Installation

We have released pre-built wheels for various Python versions, platforms, and backends for convenient installation on our [index page](https://nexaai.github.io/nexa-sdk/whl/).

### CPU Installation

```bash
pip install nexa-enterprise --prefer-binary --index-url https://nexaai.github.io/nexa-sdk-enterprise/whl/cpu --extra-index-url https://pypi.org/simple --no-cache-dir
```

### GPU Installation (Vulkan)

To install with Vulkan support, make sure you have [Vulkan SDK 1.3.261.1 or later](https://vulkan.lunarg.com/sdk/home) installed.

For **Windows PowerShell**:

```bash
$env:CMAKE_ARGS="-DGGML_VULKAN=on"; pip install nexa-enterprise --prefer-binary --index-url https://nexaai.github.io/nexa-sdk-enterprise/whl/vulkan --extra-index-url https://pypi.org/simple --no-cache-dir
```

For **Windows Command Prompt**:

```bash
set CMAKE_ARGS="-DGGML_VULKAN=on" & pip install nexa-enterprise --prefer-binary --index-url https://nexaai.github.io/nexa-sdk-enterprise/whl/vulkan --extra-index-url https://pypi.org/simple --no-cache-dir
```

For **Windows Git Bash**:

```bash
CMAKE_ARGS="-DGGML_VULKAN=on" pip install nexa-enterprise --prefer-binary --index-url https://nexaai.github.io/nexa-sdk-enterprise/whl/vulkan --extra-index-url https://pypi.org/simple --no-cache-dir
```

### Local Build (You may need to acquire access to this private repo first.)

How to clone this repo:

```bash
git clone --recursive https://github.com/NexaAI/nexa-sdk-enterprise
```

If you forget to use `--recursive`, you can use below command to add submodule:

```bash
git submodule update --init --recursive
```

Then you can build and install the package:

```bash
pip install -e .
```

## Unit Tests

```
python -m tests.test_text_generation
python -m tests.test_disk_kv_cache
```
