Metadata-Version: 2.1
Name: humanity_etl
Version: 0.1.1
Summary: Replicate humanity data in databricks
Home-page: https://github.com/neofinancial/humanity_etl
Author: Neo Financial
Author-email: engineering@neofinancial.com
License: UNLICENSED
Platform: UNKNOWN
Classifier: Development Status :: 2 - Pre-Alpha
Classifier: Intended Audience :: Developers
Classifier: Natural Language :: English
Classifier: Programming Language :: Python :: 3
Requires-Python: >=3.6
Description-Content-Type: text/markdown

# `humanity_etl`

> Replicate data from humanity in databricks

[![pypi](https://img.shields.io/pypi/v/humanity_etl?style=for-the-badge)](https://pypi.org/project/humanity_etl/)

## Usage

### CLI

```bash
python -m humanity_etl --table <table-name>
```

where table-name is one of the following: `timeclocks` or `ALL`.

### API

```python
from humanity_etl.tables.timeclocks import timeclocks

timeclocks()
```

Further configs are set via environment variables:

Further configs are set via environment variables:

- `*_ACCESS_TOKEN`: API access
- `APP_ENV`: <development/production> - debug mode
- `SAMPLE_OUTPUT`: <True/False> - Save dataframes to csv

## DEV

### Create venv

```bash
python -m venv env
```

### Activate venv

- unix

```bash
source env/bin/activate
```

- windows

```bash
env\Scripts\activate.bat
```

### Install Packages

```bash
pip install -r requirements.txt
```

### Test

```bash
make test
```

### Format

```bash
make format
```

```bash
make lint
```

### Version & Release

```bash
bump2version <major/minor/patch>
```

```bash
make release
```

**note** Don't forget to `git push` with `--tags`

### pre-commit

#### Setup

```bash
pre-commit install
```

#### Run all

```bash
make pre-commit
```


