Weksa/crates/weksa
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Weksa 5e2a4a0ebb Scorer coverage: words break at any non-word character, unspaced scripts read by run; near-miss chrF pairs per script
Soul scorer s3 Lows. words.rs no longer lists separators (_ and .) or defers to UAX #29, which splits Han, kana and Thai per character and made honest single-word glosses read as an n>=2 leak. A word is a run of letters, digits, marks and ZWNJ/ZWJ; a run of Han, kana, Thai, Lao, Khmer or Burmese is one word. Tests pin separators, marks, joiners, NFC, every range edge, and five sacrebleu 2.4.3 near-miss pairs (Ko, Tr, Fi, Th vowel-strip, Ja). 40 hand mutants killed.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-11-09 07:47:17 +00:00
..
src Scorer coverage: words break at any non-word character, unspaced scripts read by run; near-miss chrF pairs per script 2026-11-09 07:47:17 +00:00
tests Scorer coverage: words break at any non-word character, unspaced scripts read by run; near-miss chrF pairs per script 2026-11-09 07:47:17 +00:00
Cargo.toml scorer: chrF and meaning cosine of whole output against whole reference, no mask; Embedder port with Ollama adapter; pooled novel-n-gram leak diagnostics; aggregation by derived split (squash of weksa-lowering/scorer onto 20865ca, head 5689e62; spec r3, Soul s1-s3) 2026-10-29 17:17:46 +01:00