Metadata-Version: 2.1
Name: crawlab-sdk
Version: 0.7.0rc6
Summary: Python SDK for Crawlab
Home-page: https://github.com/crawlab-team/crawlab-python-sdk
License: BSD-3-Clause
Author: Marvin Zhang
Author-email: tikazyq@163.com
Requires-Python: >=3.9,<4.0
Classifier: License :: OSI Approved :: BSD License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Requires-Dist: httpx (>=0.23.0,<0.24.0)
Requires-Dist: pydantic (>=2.10.1,<3.0.0)
Requires-Dist: rich (>=13.9.4,<14.0.0)
Project-URL: Repository, https://github.com/crawlab-team/crawlab-python-sdk
Description-Content-Type: text/markdown

# Crawlab Python SDK

Python SDK for Crawlab

## Installation

```bash
pip install crawlab-sdk
```

## Usage

### CLI

```bash
crawlab-cli
```

### Scrapy Integration

In `settings.py`, add the following:

```python
ITEM_PIPELINES = {
    'crawlab.CrawlabPipeline': 300
}
```

### Save Scraped Items
    
```python
from crawlab import save_item

scraped_items = [
    {
        'name': 'item1',
        'value': 'value1'
    },
    {
        'name': 'item2',
        'value': 'value2'
    }
]

for item in scraped_items:
    save_item(item) 
```

## Development

### Pre-requisites

```bash
pip install poetry
```

### Install dependencies

```bash
poetry install
```

