Metadata-Version: 2.4
Name: senate-hearings
Version: 0.1.1
Summary: Scrape and clean U.S. Senate hearing transcripts.
Author: Mikkel Christensen, Corbin Brinkerhoff
License-Expression: MIT
Project-URL: Homepage, https://github.com/lmikkelc5/senate-hearings
Keywords: scraping,nlp,senate,transcripts,streamlit,quarto
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.11
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: beautifulsoup4>=4.12.0
Requires-Dist: numpy>=2.3.4
Requires-Dist: pandas>=2.3.3
Requires-Dist: playwright>=1.55.0
Requires-Dist: pyyaml>=6.0.3
Requires-Dist: requests>=2.32.5
Requires-Dist: scipy>=1.16.3
Requires-Dist: selenium>=4.38.0
Requires-Dist: seaborn>=0.13.2
Provides-Extra: dev
Requires-Dist: build; extra == "dev"
Requires-Dist: twine; extra == "dev"
Requires-Dist: pytest; extra == "dev"
Requires-Dist: ipykernel>=7.1.0; extra == "dev"
Requires-Dist: nbclient>=0.10.2; extra == "dev"
Requires-Dist: nbformat>=5.10.4; extra == "dev"
Provides-Extra: app
Requires-Dist: streamlit>=1.52.1; extra == "app"
Provides-Extra: nlp
Requires-Dist: spacy>=3.8.11; extra == "nlp"
Requires-Dist: sentence-transformers>=5.2.0; extra == "nlp"
Dynamic: license-file

# senate-hearings

Scrape, clean, and analyze U.S. Senate hearing transcripts from
[govinfo.gov](https://www.govinfo.gov/).

This package provides Python utilities for collecting Senate hearing metadata
and transcript text, expanding dynamically loaded content, and preparing
hearing data for analysis, NLP, and visualization workflows.

---

## Features

- Scrape Senate hearing metadata and transcript text
- Expand dynamically loaded “Show more” / accordion content
- Clean and normalize long transcript documents
- Extract structured fields (date, committee, title, text, etc.)
- Designed to support downstream NLP and dashboarding

---

## Installation

Basic installation:

```bash
pip install senate-hearings
```

## Documentation & demos 

### Home page (Github Pages)

https://lmikkelc5.github.io/senate-hearings/site/

### Full documentation (GitHub Pages) 

https://lmikkelc5.github.io/senate-hearings/site/documentation.html

### Tutorial (Github Pages)

https://lmikkelc5.github.io/senate-hearings/site/tutorial.html

### Technical Report

https://lmikkelc5.github.io/senate-hearings/site/technical_report.html

### Interactive EDA (Streamlit) 

Streamlit puts apps to sleep after 12 hours of inactivity, if you need us to reactivate it email me at mikkelc5@byu.edu

https://senate-hearings-555.streamlit.app/

### Source code (GitHub) 

https://github.com/lmikkelc5/senate-hearings


