# Research-OS reliability

_Last regenerated: 2026-06-05_

This file is auto-generated by the stress-test harness on every
release. The numbers below are empirical: each reference project
is replayed end-to-end against the listed models. Negative
results are surfaced verbatim — if a model fails at a protocol,
you'll see it here.

## Per-project, per-model results

| Project | Model | Success rate | Gates passed | Artifacts present | Duration | Tool calls |
|---|---|---|---|---|---|---|
| biology_genomics_mini | mock | 100% | 3/3 | 1/1 | 0.0s | 31 |
| humanities_ms_review | mock | 100% | 2/2 | 2/2 | 0.0s | 20 |
| mid_pipeline_handoff | mock | 100% | 2/2 | 2/2 | 0.0s | 14 |
| qualitative_interviews | mock | 100% | 3/3 | 2/2 | 0.0s | 22 |
| quick_plot_throwaway | mock | 100% | 1/1 | 1/1 | 0.0s | 7 |

## Per-protocol breakdown

Each row = one protocol, aggregated across every project and model where it was attempted.

| Protocol | Attempts | Successes | Success rate |
|---|---|---|---|
| `audit/audit_and_validation` | 1 | 1 | 100% |
| `guidance/casual_exploration` | 1 | 1 | 100% |
| `guidance/mid_pipeline_entry` | 1 | 1 | 100% |
| `guidance/project_startup` | 1 | 1 | 100% |
| `guidance/session_resume` | 1 | 1 | 100% |
| `humanities/archival/archival_research` | 1 | 1 | 100% |
| `humanities/archival/source_provenance` | 1 | 1 | 100% |
| `humanities/output/scholarly_edition` | 1 | 1 | 100% |
| `methodology/exploratory_data_analysis` | 1 | 1 | 100% |
| `qualitative/coding/coding_scheme_iteration` | 1 | 1 | 100% |
| `qualitative/method/thematic_analysis_braun_clarke` | 1 | 1 | 100% |
| `qualitative/output/qualitative_report_format` | 1 | 1 | 100% |

## How to reproduce

```bash
# CI (mock model — deterministic; no API keys needed)
python -m research_os.testing.stress_runner --model mock

# Real-model runs (requires the corresponding adapter + API key)
STRESS_MODEL=claude-sonnet-4-6 python -m research_os.testing.stress_runner --model anthropic
```

Adapter modules live under `src/research_os/testing/adapters/`.
Reference projects live under `tests/fixtures/projects/`.
