Original corpus for a non-memorised target; recall probes every item; encode prompt states the id form #40
2026-11-10
Soul s2 lows: the id-form test lists a real inventory; the floor reads 14 to 20
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Encode prompt states the id form; recall line states the real chrF floor; probe test over data/original
Five of six encoders in the first original-corpus round wrote bare integer ids and were refused at parse (encoder-prompt-concept-ids). The prompt now says ids are written in full with their family prefix. Soul s1 on the original corpus: unrelated English scores chrF 13 to 18, not near 0, so the recall line says so; a test runs the probe over the real original items. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Original corpus (data/original): six passages written for the non-memorised target; recall probes every live item
Six short original sentences, model-written (Anthropic, claude-sonnet-5-5) and so labelled, three Train and three Validation, over the Dao revision-3 inventory and one live entity. The recall probe now covers every offered item, naming the work only for a public-domain one, so it can show the original set reads near the guessing floor. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>