Metadata-Version: 2.1
Name: mucri
Version: 0.0.9
Summary: Quickly fetch multiple pages
Home-page: https://github.com/meain/mucri
Author: Abin Simon
Author-email: abinsimon10@gmail.com
License: UNKNOWN
Keywords: asyncio,scraper,aiohttp
Platform: UNKNOWN
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.5
Classifier: Programming Language :: Python :: 3.6
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Topic :: Software Development :: Libraries
Classifier: Topic :: Utilities
Classifier: Environment :: Console
Classifier: Intended Audience :: End Users/Desktop
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Operating System :: POSIX
Classifier: Natural Language :: English
Description-Content-Type: text/markdown
Requires-Dist: aiohttp

# Mucri

Quickly fetch a lot of pages/apis using python `asyncio`.


## Installation

> Only python 3.6+

```sh
pip isntall mucri
```

## Usage

`fetch_pages` takes two args:

`links` : list of links to be fetched (example below)
`concurrency`: how many requests to be send at a time (default 20)

```python
from mucri import fetch_pages

# links can be a single string or a dict with specific instructions
links = [
    "http://meain.github.io",  # Can be just a url
    { "url": "http://somelink" }, # or a dict with url key
    { # for more complex stuff
        "url": "http://fakelink",
        "action": "get", # get | post
        "data": {},
        "headers": {},
        "resp_type": "text", # text | json | image
    }
]

results = fetch_pages(links) # fetches all of them asynchronously
```


