Metadata-Version: 2.4
Name: sitemap-harvester
Version: 1.0.4
Summary: A tool to crawl website sitemaps and create a CSV report of URLs and their metadata
Author-email: Meysam Azad <meysam@developer-friendly.blog>
Project-URL: Homepage, https://github.com/meysam81/sitemap-harvester
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Programming Language :: Python :: 3.14
Requires-Python: <4.0,>=3.7
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: requests<3,>=2
Requires-Dist: beautifulsoup4<4.15
Dynamic: license-file

# 🗺️ Sitemap Harvester

[![PyPI - Version](https://img.shields.io/pypi/v/sitemap-harvester)](https://pypi.org/project/sitemap-harvester/)
[![Python Support](https://img.shields.io/pypi/pyversions/sitemap-harvester.svg)](https://pypi.org/project/sitemap-harvester/)
[![License: Apache 2.0](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
[![PyPI - Downloads](https://img.shields.io/pypi/dm/sitemap-harvester)](https://pypi.org/project/sitemap-harvester/)

> 🚀 **A blazingly fast Python tool to harvest URLs and metadata from website sitemaps like a digital archaeologist!**

## 🚀 Quick Start

### Installation

```bash
pip install sitemap-harvester
```

### Basic Usage

```bash
# Harvest a website's sitemap
sitemap-harvester --url https://example.com

# Custom output file and timeout
sitemap-harvester --url https://example.com --output my_data.csv --timeout 15
```

## 🎯 What Gets Extracted?

- 📝 **Page Title** - The main title of each page
- 📄 **Meta Description** - SEO descriptions
- 🏷️ **Keywords** - Meta keywords (if present)
- 👤 **Author** - Page author information
- 🔗 **Canonical URL** - Canonical link references
- 🖼️ **Open Graph Data** - Social media metadata
- 🌐 **Custom Meta Tags** - Any additional meta information

## 💡 Pro Tips

- Use `--timeout` for slower websites or large sitemaps
- The tool automatically deduplicates URLs for you
- Check the console output for real-time progress updates
- Large sitemaps? Grab a coffee ☕ and let it work its magic!

## 🤝 Contributing

Found a bug? Have a feature request? Contributions are welcome! Feel free to open an issue or submit a pull request.

## 📜 License

This project is licensed under the Apache License 2.0 - see the [LICENSE](LICENSE) file for details.

---

_Happy harvesting! 🌾_
