Metadata-Version: 2.2
Name: chunking4rag
Version: 0.0.1
Summary: A small library to chunk large files into smaller arrays that can be used for generating RAG embeddings
Home-page: https://github.com/harpreetset1/chunking4rag
Author: Harpreet Sethi
Author-email: Harpreet Sethi <harpreetset@gmail.com>
Classifier: Development Status :: 3 - Alpha
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.12
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: gensim>=4.3.3
Requires-Dist: nltk>=3.9.1
Requires-Dist: pydantic>=2.10.6
Provides-Extra: test
Requires-Dist: pytest; extra == "test"
Requires-Dist: pytest-cov; extra == "test"
Provides-Extra: formatting
Requires-Dist: black; extra == "formatting"
Requires-Dist: flake8; extra == "formatting"
Requires-Dist: isort; extra == "formatting"
Provides-Extra: type-checking
Requires-Dist: mypy; extra == "type-checking"
Provides-Extra: docs
Requires-Dist: pydocstyle; extra == "docs"
Provides-Extra: publishing
Requires-Dist: twine; extra == "publishing"
Requires-Dist: wheel; extra == "publishing"

# chunking4rag
This repo will have various chunking strategies one can build in order to get best performance out of RAG framework

# To install this library
Run the following command
```
pip install chunking4rag
```

# To start with contribution to the project
1. Clone the repository using git
  
2. Create a virtual environment using uv
  ```
  uv create chunking4rag
  ```
3. Activate the virtual environment
  ```
  uv activate chunking4rag
  ```
4. Install the dependencies by running
  ```
  uv install -r requirements.txt
  ```
5. Run tests to make sure everything is working fine
  ```
  python chuking_tests.py
  ```
