UofA Adversarial Coverage Report

HIT HIT+ MISS WRONG CLEAN-CORRECT CLEAN-WRONG GEN-INVALID

View 1 — Catalog self-coverage (UofA pattern × subtlety)

COU-dependent rules: No rules show COU-dependent firing behavior at the 30% disparity threshold.

Pattern	low	medium	high	per-COU breakdown
COMPOUND-01	—	—	100% (180/180)	show Morrison COU1: 100% Morrison COU2: n/a Nagaraja COU1: n/a
COMPOUND-03	—	—	100% (180/180)	show Morrison COU1: 100% Morrison COU2: n/a Nagaraja COU1: n/a
W-AL-01	—	—	100% (178/178)	show Morrison COU1: 99% Morrison COU2: n/a Nagaraja COU1: n/a
W-AL-02	—	—	0% (0/180)	show Morrison COU1: 0% Morrison COU2: n/a Nagaraja COU1: n/a
W-AR-01	—	—	95% (170/179)	show Morrison COU1: 94% Morrison COU2: n/a Nagaraja COU1: n/a
W-AR-02	—	—	100% (179/179)	show Morrison COU1: 99% Morrison COU2: n/a Nagaraja COU1: n/a
W-AR-03	—	—	100% (178/178)	show Morrison COU1: 99% Morrison COU2: n/a Nagaraja COU1: n/a
W-AR-04	—	—	0% (0/180)	show Morrison COU1: 0% Morrison COU2: n/a Nagaraja COU1: n/a
W-AR-05	—	—	100% (44/44)	show Morrison COU1: 98% Morrison COU2: n/a Nagaraja COU1: n/a
W-CON-01	—	—	100% (179/179)	show Morrison COU1: 99% Morrison COU2: n/a Nagaraja COU1: n/a
W-CON-02	—	—	100% (180/180)	show Morrison COU1: 100% Morrison COU2: n/a Nagaraja COU1: n/a
W-CON-03	—	—	0% (0/179)	show Morrison COU1: 0% Morrison COU2: n/a Nagaraja COU1: n/a
W-CON-04	—	—	100% (177/177)	show Morrison COU1: 98% Morrison COU2: n/a Nagaraja COU1: n/a
W-CON-05	—	—	100% (179/179)	show Morrison COU1: 99% Morrison COU2: n/a Nagaraja COU1: n/a
W-EP-01	—	—	100% (179/179)	show Morrison COU1: 99% Morrison COU2: n/a Nagaraja COU1: n/a
W-EP-02	—	—	100% (178/178)	show Morrison COU1: 99% Morrison COU2: n/a Nagaraja COU1: n/a
W-EP-03	—	—	0% (0/179)	show Morrison COU1: 0% Morrison COU2: n/a Nagaraja COU1: n/a
W-EP-04	—	—	100% (179/179)	show Morrison COU1: 99% Morrison COU2: n/a Nagaraja COU1: n/a
W-ON-01	—	—	not measurable	show Morrison COU1: 0% Morrison COU2: n/a Nagaraja COU1: n/a
W-ON-02	—	—	100% (180/180)	show Morrison COU1: 100% Morrison COU2: n/a Nagaraja COU1: n/a
W-PROV-01	—	—	67% (121/180)	show Morrison COU1: 67% Morrison COU2: n/a Nagaraja COU1: n/a
W-SI-01	—	—	not measurable	show Morrison COU1: 0% Morrison COU2: n/a Nagaraja COU1: n/a
W-SI-02	—	—	0% (0/179)	show Morrison COU1: 0% Morrison COU2: n/a Nagaraja COU1: n/a

View 2 — Literature coverage (gap_probe outcomes by taxonomy)

Source taxonomy	WRONG	INVALID	Verdict
clarissa-machinery/workflow/eliminative-argumentation	15	0	alt rule fires
clarissa-machinery/workflow/residual-risk-justification	15	0	alt rule fires
clarissa-machinery/workflow/theory-preconditions	15	0	alt rule fires
gohar/contextual/configuration	15	0	alt rule fires
gohar/contextual/environmental-factors	15	0	alt rule fires
gohar/contextual/faults-physical	15	0	alt rule fires
gohar/contextual/faults-software	15	0	alt rule fires
gohar/contextual/human-errors	15	0	alt rule fires
gohar/evidence_validity/coverage-edge-cases	15	0	alt rule fires
gohar/evidence_validity/data-drift	15	0	alt rule fires
gohar/evidence_validity/fidelity	15	0	alt rule fires
gohar/evidence_validity/inadequate-metrics	15	0	alt rule fires
gohar/evidence_validity/model-variance	15	0	alt rule fires
gohar/evidence_validity/robustness	15	0	alt rule fires
gohar/requirements/ambiguous	15	0	alt rule fires
gohar/requirements/inconsistent	15	0	alt rule fires
gohar/requirements/incorrect	15	0	alt rule fires
gohar/requirements/missing	15	0	alt rule fires
gohar/requirements/stale	15	0	alt rule fires
greenwell/sufficiency/arguing-from-ignorance	15	0	alt rule fires
greenwell/sufficiency/confusion-necessary-sufficient	15	0	alt rule fires
greenwell/sufficiency/hasty-inductive-generalization	14	1	alt rule fires

View 3 — Precision / recall summary

Metric	Value	Source battery
Catalog recall (HIT + HIT+)	73.4%	confirm_existing (n=3626)
Catalog precision (1 − FPR)	0.0%	negative_controls (n=176)
Gap-probe MISS rate	0.0%	gap_probe (n=329)

Outcome class counts

Class	Count
COV-CLEAN-WRONG	176
COV-HIT-PLUS	2751
COV-WRONG	1294
GEN-INVALID	384

Performance characterization (v1.8 D2)

Hardware: hardware spec not configured (set UOFA_HW_SPEC env var)

Metric	Value (ms)
Mean total_eval_ms	1755
Median total_eval_ms	1732
p95 total_eval_ms	1874
Sample size	4221

Slowest 20 packages

spec_id	variant	total_eval_ms
adv-2026-p2-003-w-ar-03_high_morrison-cou2	15	2322
adv-2026-p2-009-w-al-01_medium_morrison-cou1	12	2279
adv-2026-p2-003-w-ar-03_high_morrison-cou2	16	2268
adv-2026-p2-001-w-ar-01_low_morrison-cou2	14	2247
adv-2026-p2-001-w-ar-01_medium_morrison-cou2	4	2185
adv-2026-p2-001-w-ar-01_medium_morrison-cou2	1	2165
adv-2026-p2-003-w-ar-03_high_morrison-cou2	13	2129
adv-2026-p2-009-w-al-01_medium_morrison-cou1	10	2121
adv-2026-p2-009-w-al-01_medium_morrison-cou1	11	2097
adv-2026-p2-003-w-ar-03_medium_morrison-cou2	19	2094
adv-2026-p2-009-w-al-01_medium_morrison-cou1	8	2088
adv-2026-p2-001-w-ar-01_medium_morrison-cou2	5	2087
adv-2026-p2-009-w-al-01_medium_morrison-cou2	8	2079
adv-2026-p2-108-incorrect_medium	4	2068
adv-2026-p2-009-w-al-01_low_morrison-cou2	4	2064
adv-2026-p2-009-w-al-01_low_morrison-cou2	2	2045
adv-2026-p2-009-w-al-01_medium_morrison-cou2	12	2044
adv-2026-p2-010-w-al-02_medium_nagaraja-cou1	16	2044
adv-2026-p2-009-w-al-01_medium_morrison-cou2	1	2041
adv-2026-001-w-ar-05_medium_morrison-cou1	4	2040

n = 4605 package rows.