ATOMIZE / CONCEPT STUDIES
02 / Retrieval Observatory · research practitioner hypothesis

A small system.
Every assumption exposed.

EXPERIMENT 001 / FROZEN CORPUS

Hold the question fixed. Change retrieval. Inspect what breaks.

Controlled comparison · actual fixture scores

Cosine and lexical coverage use different scoring rules. Compare retrieved evidence—not the sizes of those two numbers.

Choose an ablation, then run the comparison.

A / Baseline

Whole · cosine

—
TOP-1 COSINE
B / Intervention

Whole · lexical

—
TOP-1 LEXICAL COVERAGE
Reproducibility recordNomic · 768 dimensions · 3 documents
Data, scoring and authored gold rule

The scalar uses the selected method; cosine and lexical coverage have different meanings and must not be compared as a quality delta. Bar heights show nonnegative score magnitude; the rows retain signed exact values. A quote passes only when the selected chunk contains the full required source span. This conservative authored rule does not test combining evidence across chunks.