weksa loop recall: a recitation probe for public-domain items; admit_rules not required in the round schema #39

Merged
weksa merged 2 commits from weksa-lowering/recall-diagnostic into main 2026-11-10 14:15:30 +00:00

2026-11-10

Weksa
Recall tests: mean over every probe, unreadable answer scores 0, written and withdrawn items are not probed
Soul lows: the mean-to-max, skipped-for-0 and withdrawn-gate mutants survived.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-11-10 14:15:27 +00:00
Weksa
weksa loop recall: a recitation probe for public-domain items; admit_rules not required in the round schema
Each live public-domain Train and Validation item is offered to a model by its
opening alone and the completion is scored by chrF against the item's second
half (lowering-recall-diagnostic). Answers live in <root>/recall; the reading is
printed, recorded nowhere, never a gate. The round schema stops requiring
admit_rules, which older records lack.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-11-10 14:12:30 +00:00