Metadata-Version: 2.4
Name: freecrawl
Version: 0.0.1
Summary: A minimal, extensible web crawling framework. Write a spider once, reuse it forever.
Author: DiscourseLab
License-Expression: Apache-2.0
Project-URL: Homepage, https://freecrawl.dev
Project-URL: Source, https://github.com/freecrawl
Keywords: crawler,scraper,spider,web-scraping
Classifier: Development Status :: 1 - Planning
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Internet :: WWW/HTTP :: Indexing/Search
Requires-Python: >=3.10
Description-Content-Type: text/markdown

# freecrawl

A minimal, extensible web crawling framework that runs on your machine.

Give it a URL, and it writes a reusable spider: URL rules plus extraction config,
saved to a database so the same site never has to be figured out twice. Discovery
sources, transports, extractors, and sinks are single-file extensions.

This is a placeholder release. The framework is under development at
https://github.com/freecrawl and https://freecrawl.dev.
