Commit graph Vili/scripts
Author SHA1 Message Date
Meta Vens
02ca1cd6d8 Vili README and tests: describe the embedding cache and the transient encoder
Replaces the 2026-06-12 timing paragraph with the cache, the child, and the numbers
measured on Raven on 2026-10-22. Adds the tests hand mutation showed missing: the
exact 2 GiB boundary, a child answer with too few vectors, and the 4096 dimension.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 21:40:42 +02:00
Meta Vens
f6acfc1c85 Vili worker: Kimodo's text encoder is the cache, not a resident 8B model
The worker builds CachedTextEncoder and passes it to load_model, so Kimodo's own
encoder selection (and the CPU encoder behind TEXT_ENCODER_DEVICE) is never built.
generate() returns the per-request encoder record (identity, hits, misses, seconds,
vector hashes) and the worker identity; /health adds the identity and stored count.
startKimodoWorker drops TEXT_ENCODER_DEVICE and mounts the scripts directory, the
cultcache-py source and .vili/embeddings, with the Kimodo commit and image id read
once per worker start. The encode clock is perf_counter: time.time went backwards
under WSL during a probe.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 21:18:17 +02:00
Meta Vens
76ab8308eb Vili: text-embedding cache and one-shot GPU encoder child
text_encoding.py holds the CultCache embedding store (gamecult.vili.text_embedding.v0
through cultcache-py), the encoder identity and key, plan_placement with its typed
gpu-busy refusal, and CachedTextEncoder, which sends a request's misses to one child
call. kimodo-text-encode.py is that child: it assembles Kimodo's LLM2Vec encoder in
bf16 with its own loader (operator ruling encoder-own-loader; peft's offload path
raises TypeError in Kimodo's loader), encodes each text alone, writes a MessagePack
answer and exits. GPU reserve 3 GiB: four cold runs on Raven's 16 GB card produced
identical vectors with no CUDA error. The worker and daemon are not wired yet.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 21:10:01 +02:00
Meta Vens
3778830df4 Vili: delete the unsigned Idunn RUDP health publisher
It published idunn.daemon_health to 10.77.0.2:17870 (the retired Windows Idunn)
every 15 s and failed each time; Idunn on Yggdrasil binds no RUDP health ingress.
Deletes idunn-rudp.cjs, the publisher and its status, the --idunn-* args in the
daemon and the three launcher scripts, operator_state slot 4, and the
cultnet-ts and direct @msgpack/msgpack dependencies. transportProfile now states
local-cultcache-only. All commits build (node --check passes); not yet run on Raven.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-21 05:12:00 +02:00
Meta Vens
8773c153c8 Remove unused readFile import and dead backend-status.json initializer
REC-120:

- Removed the unused `readFile` import (`readFile(` had zero call
  sites in the file).
- Removed the never-read `backend-status.json` initializer block; the
  `backendStatus` in-memory object it snapshotted is still very much
  alive (read at lines 287, 378, 489, 504, 509, 515, 768) and untouched
  here.
- Also removed the `existsSync` import, which the initializer block
  was its only caller for; left in place it would have become a second
  dead import introduced by this same cut.

Kill attempts that failed: none.
- `rg -n "readFile\(" scripts/vili-daemon.mjs` -> no matches (repeated
  the census command against current HEAD).
- `rg -n -F --glob '!scripts/vili-daemon.mjs' 'backend-status.json' .`
  -> no matches in this repo; cross-repo `rg -n 'backend-status\.json'`
  over F:/Projects only turns up Odin's
  docs/transport-shortcut-inventory.md, which documents the shortcut
  rather than reading the file.

Checks run: `node --check scripts/vili-daemon.mjs` -> syntax OK. No
package.json/test suite exists in this repo to run beyond that.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-09-13 14:18:49 +02:00
Meta Vens
8627297a6e Write Vili service state to CultCache 2026-06-16 10:39:54 +01:00
Meta Vens
50c424380c Publish Vili health over Idunn RUDP 2026-06-16 10:22:31 +01:00
Meta Vens
7cb320d11f Keep Raven Vili task background-only 2026-06-16 02:25:13 +01:00
Meta Vens
16d74cb674 Expose Kimodo generation options 2026-06-13 00:55:34 +01:00
Meta Vens
3560548146 Make Kimodo generation resident 2026-06-12 18:04:43 +01:00
Meta Vens
c22913c041 Run Vili scheduled task hidden 2026-06-12 17:22:20 +01:00
Meta Vens
b7297acbcd Use Kimodo input folders for generation prompts 2026-06-12 15:07:01 +01:00
Meta Vens
2f6a5bd2ce Decode generation prompts inside WSL 2026-06-12 15:00:08 +01:00
Meta Vens
974656a13b Allow Kimodo containers to warm Hugging Face cache 2026-06-12 14:32:34 +01:00
Meta Vens
e8dc7d08d7 Use Kimodo output stem for generation jobs 2026-06-12 14:24:58 +01:00
Meta Vens
ea9c7f8845 Pass Hugging Face token into Kimodo containers 2026-06-12 13:57:14 +01:00
Meta Vens
01f6bb9c6e Run Vili task with Raven user WSL access 2026-06-12 12:49:19 +01:00
Meta Vens
d59a76d8ea Run Vili scheduled task as SYSTEM 2026-06-12 12:47:54 +01:00
Meta Vens
de2ad53e48 Run Vili through a Raven scheduled task 2026-06-12 12:46:44 +01:00
Meta Vens
ca6a172cdd Initial Vili animation daemon 2026-06-12 12:42:33 +01:00