Toggle navigation sidebar
Toggle in-page Table of Contents
CmonCrawl 1.0.0 documentation
Contents:
Usage
Command Line Interface
Command Line Interface
Command Line Download
Command line Extract
Extraction
Custom Extractor
Extractor config file
Extraction utils
Programming Guide
Programming Guide
Custom Pipeline
Miscellaneous
Domain Record
API
cmoncrawl
cmoncrawl.aggregator
cmoncrawl.aggregator.index_query
cmoncrawl.aggregator.utils
cmoncrawl.common
cmoncrawl.common.loggers
cmoncrawl.common.types
cmoncrawl.processor
cmoncrawl.processor.extraction
cmoncrawl.processor.pipeline
.rst
.pdf
Contents
IDownloader.download()
cmoncrawl.processor.pipeline.downloader.IDownloader.download
Contents
IDownloader.download()
cmoncrawl.processor.pipeline.downloader.IDownloader.download
#
async
IDownloader.
download
(
domain_record
:
DomainRecord
)
→
List
[
Tuple
[
str
,
PipeMetadata
]
]
#