UofA Adversarial Coverage Report

HIT HIT+ MISS WRONG CLEAN-CORRECT CLEAN-WRONG GEN-INVALID

View 1 — Catalog self-coverage (UofA pattern × subtlety)

No confirm_existing rows; View 1 unavailable.

View 2 — Literature coverage (gap_probe outcomes by taxonomy)

No gap_probe rows; View 2 unavailable.

View 3 — Precision / recall summary

MetricValueSource battery
Catalog recall (HIT + HIT+)0.0%confirm_existing (n=0)
Catalog precision (1 − FPR)97.1%negative_controls (n=171)
Gap-probe MISS rate0.0%gap_probe (n=0)

Outcome class counts

ClassCount
COV-CLEAN-CORRECT166
COV-CLEAN-WRONG5
GEN-INVALID9

View 4 — Per-rule precision (M5-B)

Decomposes the catalog's package-level precision (= 0% on M5) into per-rule contributors. NC denominator: 171 evaluable negative_control rows. Sorted by NC FPR descending.

RuleNC FPRNC firingsTotal firingsTargeted firingsPrecision when fires
W-ON-011.8%3300.0%
W-AL-011.2%2200.0%
W-AR-051.2%2200.0%
W-EP-021.2%2200.0%
COMPOUND-030.6%1100.0%

Performance characterization (v1.8 D2)

Hardware: hardware spec not configured (set UOFA_HW_SPEC env var)

MetricValue (ms)
Mean total_eval_ms3183
Median total_eval_ms3171
p95 total_eval_ms3589
Sample size171

Slowest 20 packages

spec_idvarianttotal_eval_ms
adv-2026-p2-208-nc-clean-partial-envelope_medium_morrison-cou123722
adv-2026-p2-206-nc-clean-not-applicable-factors_high_nagaraja-cou113721
adv-2026-p2-208-nc-clean-partial-envelope_medium_morrison-cou113700
adv-2026-p2-208-nc-clean-partial-envelope_medium_morrison-cou213699
adv-2026-p2-206-nc-clean-not-applicable-factors_high_nagaraja-cou123695
adv-2026-p2-208-nc-clean-partial-envelope_high_morrison-cou223669
adv-2026-p2-208-nc-clean-partial-envelope_high_morrison-cou213640
adv-2026-p2-207-nc-clean-rejected-decision_low_morrison-cou213611
adv-2026-p2-207-nc-clean-rejected-decision_low_morrison-cou123589
adv-2026-p2-207-nc-clean-rejected-decision_low_morrison-cou113576
adv-2026-p2-208-nc-clean-partial-envelope_low_nagaraja-cou123503
adv-2026-p2-208-nc-clean-partial-envelope_low_morrison-cou223501
adv-2026-p2-208-nc-clean-partial-envelope_low_nagaraja-cou113494
adv-2026-p2-208-nc-clean-partial-envelope_high_morrison-cou123491
adv-2026-p2-208-nc-clean-partial-envelope_high_morrison-cou113489
adv-2026-p2-208-nc-clean-partial-envelope_medium_morrison-cou223487
adv-2026-p2-206-nc-clean-not-applicable-factors_high_morrison-cou213477
adv-2026-p2-208-nc-clean-partial-envelope_low_morrison-cou213476
adv-2026-p2-206-nc-clean-not-applicable-factors_high_morrison-cou223476
adv-2026-p2-208-nc-clean-partial-envelope_low_morrison-cou113460

n = 180 package rows.