Observatory LLM Evaluation

Bulletin No. 01 — Restricted instrument

# Measure how
language models
actually behave.

Compare responses across tasks, judges, and rubrics. Drill into individual samples. Generate signed reports. Treat the answers as data, not vibes.

Identifying
Contents

01
  Conversational driver — Script evaluations through plain language.
02
  Comparison grid — Every sample, every model, scored side by side.
03
  Judge transparency — See how each criterion was decided and by whom.
04
  Reproducible reports — Sign and export every run as a PDF.