No description
  • JavaScript 67.2%
  • Python 31%
  • Shell 1.8%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
2026-10-26 03:40:30 +01:00
deployment/idunn Fix: a listed BVH is opened non-blocking, and the work directory is a declared state slot swept at start (Soul s2 readinside-opens-before-checking, work-dir-undeclared-unswept) 2026-10-25 01:45:14 +02:00
docs Map: the RPS slot clips r1 (takes, pace, slide, loop seams, countdown contacts) 2026-10-25 07:24:52 +01:00
scripts Vili keeps a request's marks and inPlace in the job record, never gives them to the worker, and refuses malformed ones first 2026-10-26 03:23:42 +01:00
vendor Daemon serves through a runtime port: Idunn write lease or hand-run socket lock 2026-10-24 00:23:07 +02:00
.gitignore Initial Vili animation daemon 2026-06-12 12:42:33 +01:00
.gitmodules Daemon serves through a runtime port: Idunn write lease or hand-run socket lock 2026-10-24 00:23:07 +02:00
package-lock.json Daemon serves through a runtime port: Idunn write lease or hand-run socket lock 2026-10-24 00:23:07 +02:00
package.json Daemon serves through a runtime port: Idunn write lease or hand-run socket lock 2026-10-24 00:23:07 +02:00
README.md README: FBX export is live, and marks and inPlace are the caller's, kept in the record 2026-10-26 03:23:42 +01:00

Vili

Vili is the GameCult Persona animation daemon.

It owns the bridge from Persona performance intent to body-motion generation. Its backend is Kimodo, run by Vili's own daemon as a CPU-only Python process tree on Linux. It runs on Yggdrasil as an Idunn target (see Front Door).

Front Door

  • Value: a supervised path from a text prompt to generated body motion. The daemon spawns one resident Kimodo worker, caps its threads, and returns motion artifacts (motion.npz, BVH, and an FBX for Unity, see FBX Export) for a job.
  • Problem: Personas and games need generated motion, but cold per-request model loads cost minutes. One daemon owns job identity, worker lifecycle, the thread budget and artifact references, so callers touch no model state.
  • Entry points: scripts/vili-daemon.mjs (the daemon; npm start, npm test), scripts/idunn-entry.mjs (the process Idunn runs), deployment/idunn/recipe.toml (the sealed release), scripts/kimodo-resident-worker.py (the worker it spawns), scripts/kimodo-text-encode.py (the one-shot encoder child), POST /motion/generate (see Motion Generation), docs/verse-service-contract.md and docs/motion-pipeline-target.md.
  • Live: the Idunn target vili on Yggdrasil at http://10.77.0.1:8824 (WireGuard only), CPU only: POST /motion/generate (motion.npz, optional BVH on the SOMA skeleton, and with "fbx": true a Unity-ready FBX per clip, which the live unit exported for the H3-s2 take), POST /motion/rest-fbx (the avatar's rest pose), GET /motion/artifacts/{jobId}/{name} (the FBX and BVH bytes), GET /health, GET /operator-state, and the CultCache service store. The fields added since that export (loop, marks, inPlace) answer on the live unit once a deploy carries them; the job record's request shows which ones it kept.
  • Planned: worker intake closed to local callers only, publication to Odin, and a Thing 2 operator surface. The text-prompt-to-Unity-clip path with no hand steps is docs/motion-pipeline-target.md.

Authority

  • Vili owns animation job intake, the worker process lifecycle, and generated motion artifact references.
  • Personas and Weksa may propose performance intent, gesture prompts, and constraints.
  • Kimodo owns motion synthesis.
  • Future renderers own retargeting, playback, facial performance, camera, and lip sync.
  • Odin discovers Vili; Odin does not own Vili's state.
  • Operator surfaces wait for Thing 2; today Vili publishes typed state and plain HTTP.

Local Runtime

One Linux CPU process tree:

vili-daemon.mjs          job intake, worker lifecycle, thread cap, nice 10
  kimodo-resident-worker.py   resident Kimodo model, one generation at a time
    kimodo-text-encode.py     one child per request with cache misses, on CPU

Setup: git submodule update --init (CultLib, Kimodo, SOMA-X); in vendor/CultLib, npm ci --ignore-scripts and npm run build --workspace=packages/cultcache-ts and --workspace=packages/cultnet-ts; then npm ci --install-links here. The worker needs a Python environment with Kimodo's pins and Kimodo itself importable, and a Hugging Face cache (<models root>/hub) holding the Llama 3 base, both LLM2Vec adapters and the Kimodo checkpoint. Everything runs offline.

node scripts/vili-daemon.mjs --python <python> --models-root <hf home> --kimodo-commit <sha> --python-env <env id> [--threads 8]

Flags, each with an environment twin: --host (VILI_DAEMON_HOST, 127.0.0.1), --port (VILI_DAEMON_PORT, 8824), --state-root (VILI_STATE_ROOT, .vili), --python (VILI_PYTHON), --worker-entry (VILI_WORKER_ENTRY, the test seam), --models-root (VILI_MODELS_ROOT), --threads (VILI_THREADS, 1 to 16, default 8), --kimodo-commit (VILI_KIMODO_COMMIT), --python-env (VILI_PYTHON_ENV, the environment's identity). A generate request without a models root, Kimodo commit and Python environment id gets 503 worker-unconfigured before anything spawns.

The daemon starts the worker on the first job, on a port the worker binds itself and reports in its ready line, and respawns it after an exit. The worker runs at nice 10 with torch limited to --threads (also OMP_NUM_THREADS and MKL_NUM_THREADS), so a shared host keeps its other services. Its log is <state>/logs/worker.log. The daemon owns the whole worker process group: it is killed when the worker exits for any reason, on SIGTERM or SIGINT, and, for a hand-run daemon, at start-up if a crashed predecessor left one (<state>/worker.pid). Under Idunn the unit's cgroup owns the tree.

A hand-run daemon holds its state root through a listening socket in Linux's abstract namespace, named by the root's real path: the bind is the atomic claim, so a second daemon on a live root prints that it is held and exits 2, killing nothing, and a dead daemon's claim is gone with it (there is no lock file). Two daemons in separate network namespaces do not exclude each other.

On Yggdrasil

Idunn runs node vili/scripts/idunn-entry.mjs --state-root <root> --kimodo-commit <sha> from a sealed release of three trees: node, vili (the daemon, worker, child, node_modules, cultcache-py) and python (python-build-standalone CPython 3.12 with the hash-locked packages, Kimodo, MotionCorrection and SOMA-X installed into it; no venv). The weights are the read-only cache /srv/vili/models; state is /var/lib/gamecult/vili. Idunn's process write lease is the one writer authority: until the daemon holds it, POST /motion/generate answers 503 write-lease-pending and nothing is written; the lease is asked every 250 ms and at every write, so if it is lost the worker tree is SIGKILLed within a second and the daemon answers 503 write-lease-lost. From SIGTERM on the daemon accepts nothing and writes and spawns nothing (503 stopping for a request in flight), stops the worker tree, and exits 0. Idunn proves readiness with its own POST /cultnet/snapshot challenge, answered with a signed runtime presence (an Origin is still refused).

POST /motion/generate refuses any POST that carries an Origin or is not application/json with 403 cross-site; no route answers a preflight.

Vili writes daemon-owned state to .vili/vili.service.cc: operator state, the command boundary and the transport profile. Jobs are .vili/jobs/<jobId>.json, artifacts .vili/artifacts/<jobId>/.

Routes: GET /health, GET /operator-state, POST /motion/generate; under Idunn also POST /cultnet/snapshot, Idunn's route challenge.

Motion Generation

POST /motion/generate exposes Kimodo's generation surface through the resident worker. Vili owns job identity, persistence, timeout handling, worker lifecycle, and the output stem; Kimodo owns synthesis and model-specific export formats.

Minimal request:

{
  "prompt": "a person gives a small friendly wave",
  "duration": 1,
  "diffusionSteps": 20,
  "bvh": true
}

Batch requests can use Kimodo-style metadata:

{
  "meta": {
    "texts": [
      "a person gives a small friendly wave",
      "a person takes one careful step"
    ],
    "durations": [0.5, 0.5],
    "num_samples": 1,
    "diffusion_steps": 20
  },
  "numTransitionFrames": 3,
  "cfgType": "regular",
  "cfgWeight": [1.5],
  "seed": 6101,
  "bvh": true,
  "bvhStandardTpose": true,
  "saveExampleDir": true
}

Supported request fields:

  • prompt / utterance plus duration / durationSeconds
  • texts plus durations, or a full meta object
  • inputFolder / input_folder for a Kimodo input folder on the worker host with meta.json and optional constraints.json
  • model; changing the requested model restarts the single resident worker
  • diffusionSteps / diffusion_steps
  • numSamples / num_samples
  • numTransitionFrames / num_transition_frames
  • constraints as an object/list, or constraints, constraintsPath, or constraints_path as a path on the worker host
  • seed (an integer from 0 to 2^31 - 1, anything else is a 400; absent: the daemon mints one; the job records the seed the worker was given)
  • cfg, cfgType / cfg_type, cfgWeight / cfg_weight
  • bvh, bvhStandardTpose / bvh_standard_tpose
  • fbx and clipName (see FBX Export)
  • loop (a boolean, valid only with fbx: true; see FBX Export)
  • marks and inPlace (see FBX Export): the caller's own, kept in the job record and never given to the worker
  • noPostprocess / no_postprocess
  • saveExampleDir / save_example_dir
  • timeoutMs, workerTimeoutMs, exportTimeoutMs (at most 120000)

Vili intentionally does not accept an arbitrary Kimodo output path. Generated artifacts are written under .vili/artifacts/{jobId}/ and referenced from the job record. Kimodo-SOMA-RP-v1.1 produces NPZ and optional BVH output, Kimodo-SMPLX-RP-v1.1 also exports AMASS NPZ, and Kimodo-G1-RP-v1.1 also exports CSV when that model is resident.

FBX Export

"fbx": true makes the job's BVH an FBX for Unity, beside it: motion.fbx, or motion/motion_NN.fbx for several samples. It implies bvh and bvhStandardTpose; an explicit bvhStandardTpose: false is a 400. clipName (^[A-Za-z0-9_-]{1,64}$, default the job id; sample N of several is <clipName>_NN) names the armature, the action and the FBX take. With Blender not ready (backend.blender is unconfigured or unavailable, not a Blender 5.2.2 LTS ... line) an fbx request is a 503 blender-unavailable and nothing is written.

The worker never runs Blender. After it answers, the daemon runs the release's Blender (blender -b --factory-startup --python-use-system-env --python scripts/bvh-to-fbx.py) on each BVH it listed. The BVH must be a regular file inside the job's artifact directory, opened without following a symlink; Blender is handed a private copy of it and writes a private FBX in a directory made for that export (<state>/work/export-XXXXXX, the work state slot; a daemon that holds the state root sweeps the ones a killed daemon left at start), and the daemon creates the FBX beside the BVH exclusively, so a path planted in the job directory is never read, written through or replaced. The FBX path is the BVH's, derived from the job id, which is the clock plus random bits and is taken by an exclusive mkdir. Blender converts and nothing else: the SOMA77 joint names are Kimodo's, the pose is the standard T-pose in metres, and the clip's travel stays on Hips (Root is static), so Unity derives root motion or bakes it into the pose as the caller chooses. Blender runs under the write gate in its own process group at nice 10, with HOME=/nonexistent, PYTHONHASHSEED=0 and LD_LIBRARY_PATH=<blender>/lib as its whole environment, a 120 s timeout, and its output in <state>/logs/export.log. It is killed with the worker on lease loss and stopped on SIGTERM. A failed export fails the job (fbx-export-refused or fbx-export-failed (...), 502) and the answer never carries Blender's output.

"loop": true (with fbx: true; otherwise a 400, as is a non-boolean) exports the take's lowest-cost loop window instead of the whole take. The worker chooses it (scripts/loop_window.py) from Kimodo's own posed joints: every joint relative to its Hips and turned by its own heading (compute_global_heading), and the seam from frame b back to frame a costs the pose RMS plus 0.1 s times the velocity RMS (central differences, in m and m/s), over b - a >= ceil(F / 2). The lowest cost wins; a tie goes to the longer window, then the earlier. The worker's answer carries loops, one {first, last, poseCost, velocityCost} per sample (BVH frame indices, last inclusive), and the daemon hands sample k's window to bvh-to-fbx.py as --frames <first+1> <last+1> (Blender counts from 1); the daemon never computes a window, and an answer without one for a sample fails the job (fbx-export-failed (no loop window)). The BVH and NPZ stay the whole generated take. The job record keeps request.loop, worker.loops and the clip's frames as Blender reports them, and keeps inline constraints as sent (a path otherwise), so a committed record reproduces its clip. Without loop the FBX is the whole take, as before.

marks (absent, or at most 32 objects, each exactly {name, frame}: name matches ^[A-Za-z0-9_-]{1,64}$, frame an integer in [0, 2^31) in the take's own frame indices, frame 0 being BVH frame 0) and inPlace (absent or a boolean: the caller plays the take in place, so its consumer keeps the root travel in the pose) are the caller's. Vili keeps them verbatim in request.marks and request.inPlace of the job record and the answer (marks omitted when absent or empty, inPlace only when true), interprets neither, and never gives either to the worker, so the same request yields the same motion. Anything else is a 400 Invalid marks request. before a job directory, a file or a spawn.

One BVH gives the same FBX bytes on one host body (a fixed hash seed and a fixed time stamp); FBX bytes differ between glibc versions in the last float digits, so the BVH is the cross-body reproducibility unit.

POST /motion/rest-fbx exports Kimodo's own standard-T-pose rest skeleton as SOMA77_Rest.fbx in a rest-<13-digit ms>-<8 hex> job, the source for the avatar. GET /motion/artifacts/{jobId}/{name} serves motion.fbx, motion.bvh, SOMA77_Rest.fbx and motion/motion_NN.fbx|bvh of a job as bytes, read-only; anything else is a 404.

A job is a gamecult.vili.motion_job.v1 record in <state>/jobs/{jobId}.json and the generate answer: the request, the seed used, files (name, bytes, sha256 for every file in the artifact directory), the worker's answer, and for an export export (blender version line, script sha256, settings, and per clip file, clipName, bones, frames, fps).

Current Runtime State

Kimodo's 8B text encoder (LLM2Vec, Llama 3) never lives in the worker. The worker answers Kimodo's encoder call from a CultCache store of float32 vectors, <state>/embeddings/text-embeddings.cc (gamecult.vili.text_embedding.v0, through the cultcache-py in vendor/CultLib). A vector's key is sha256(encoderIdentity + newline + text). The identity names the three Hugging Face snapshot revisions, the encoder assembly and prompt form, the device, dtype, the torch, transformers, peft and accelerate versions, the Kimodo commit and the sha256 of kimodo-text-encode.py, so a changed input misses instead of serving a stale vector. Thread count is provenance, recorded in the worker identity, not identity.

The encoder is the Llama 3 base with the MNTP adapter merged, then the supervised adapter, in bfloat16 on CPU, and kimodo-text-encode.py wraps every prompt in Llama 3 Instruct's chat header itself (text_encoding.chat_header, pooled after LLM2Vec's query marker), as Kimodo's LLM2Vec does when loaded from the repo ids. The identity names that prompt form. A fresh child vector matches Kimodo's own encoder from the repo ids (test_text_encoding.ReferenceVector, run on Yggdrasil). The measured timings are in docs/research/vili-on-yggdrasil-cpu-2026-10.md. Kimodo normalizes the prompt before encoding (A person shrugs sadly.), and the cache keys on that text. A request's misses go to one transient child that loads the encoder, encodes, writes its answer and exits, so the OS reclaims its RAM; hits never touch it. Each job carries the encoder record (hits, misses, seconds, vector hashes) and the worker identity. The cache starts empty on a new host: vectors from another assembly or device are never copied in.