CorpusGuard audit
examples/demo.jsonl
64/100 ยท D
Metrics
| Rows | 5 |
| Valid Rows | 5 |
| Invalid Rows | 0 |
| Empty Outputs | 0 |
| Short Outputs | 0 |
| Exact Duplicate Groups | 1 |
| Exact Duplicate Rows | 1 |
| Near Duplicate Pairs | 0 |
| Pii Hits | 1 |
| High Repetition Rows | 0 |
| Latin Chars | 325 |
| Cyrillic Chars | 0 |
| Other Letter Chars | 0 |
| Avg Input Chars | 36.6 |
| Avg Output Chars | 49.4 |
| P95 Output Chars | 101 |
| Leakage Matches | 0 |
Recommendations
- Deduplicate repeated examples to reduce memorization bias.
- Review and redact potential PII before publishing or training.
Findings
| Severity | Code | Row | Message |
|---|---|---|---|
| error | pii | 4 | Potential sensitive data: email, phone |
| warning | exact_duplicate | 2 | Exact duplicate across rows [2, 5] |