Add visual blockout pipeline

This commit is contained in:
Meta Vens 2026-05-03 14:34:50 +01:00
commit 139902246e
15 changed files with 1447 additions and 8 deletions

View file

@ -61,6 +61,8 @@ path is a source-grounded branching-scene data loop:
- Narrative quality reviewer prompt: `prompts/narrative-quality-reviewer.md`
- Visual scene continuity reviewer prompt:
`prompts/visual-scene-continuity-reviewer.md`
- Visual blockout architecture: `docs/architecture/visual-blockout-architecture.md`
- Visual blockout schema: `schemas/visual-blockout-plan.schema.json`
- Research-enabled Sella packet: `examples/responder-packets/scene-02-sanctuary-intake.sella_ren.packet.research.v0.json`
- Research-enabled Sella capture: `experiments/responder-packets/cold-wake-sanctuary-intake-sella-research-enabled-v0.capture.json`
- Research-enabled Sella mutation: `experiments/responder-packets/cold-wake-sanctuary-intake-sella-research-enabled-v0.mutation.json`
@ -96,6 +98,8 @@ path is a source-grounded branching-scene data loop:
- Pallas Species Strikes Ink scaffold: `examples/ink/pallas-species-strikes.branch-and-fold.v0.ink`
- Pallas Species Strikes Ink sidecar: `examples/ink/pallas-species-strikes.branch-and-fold.v0.training.json`
- Pallas Species Strikes visual plan: `examples/visual/pallas-species-strikes.branch-and-fold.v0.visual.json`
- Pallas Species Strikes Service Ring Kappa blockout plan:
`examples/visual-blockouts/pallas-species-strikes.service-ring-kappa.v0.blockout.json`
- Pallas Species Strikes readable run: `experiments/pallas-species-strikes/pallas-species-strikes.branch-and-fold-clean-run.v0.md`
- Branch compiler and IF reviewer contract: `docs/architecture/ink-branching-scenes.md`
@ -163,13 +167,19 @@ mappings. It now segments the introduction, branch locations, Kappa red alert,
climax decision, and aftermath into click-through visual sections with
`visual_scene_id` anchors, stable `visual_character_refs`, a global Media
Molecule Dreams-style volumetric brushstroke cue, and imagegen-ready prompts
that explain fictional equipment in visible terms. Its location grounding now
that explain fictional equipment in visible terms. A new visual blockout seam
adds a Blender-backed `ghostlight.visual_blockout_plan.v0` maquette for Service
Ring Kappa: room shape, scale, large object placement, actor blocking, and
camera angles. The blockout guide is a spatial reference for image generation,
not a segmentation mask or hidden color contract. Its location grounding now
uses the Bloom process correctly: engineered rotating shell, consolidated
asteroid rubble/aggregate, TCS substrate, seals, supports, and service systems,
with image prompts written as affirmative visible targets. Treat it as
coordinator/IF scaffold training data, not raw responder gold.
coordinator/IF scaffold training data plus illustrated replay collateral, not
raw responder gold.
Next: add the corpus coverage ledger seam or choose the next Aetheria fixture
Next: promote the blockout seam only as far as needed for the Pallas fixture,
then add the corpus coverage ledger seam or choose the next Aetheria fixture
from the 100-150 broad coverage target.
## Warnings

View file

@ -35,7 +35,7 @@ Aetheria lore/source context
-> mutation receipt
-> updated scene/world/social state
-> coordinator continuity and next-beat plan
-> branch compiler materializes Ink + sidecar + visual plan + compiler notes
-> branch compiler materializes Ink + sidecar + visual plan + optional blockout plan + compiler notes
-> IF artifact reviewer audits consequence, fold, and visual continuity
-> visual scene reviewer audits click-through segmentation and imagegen-ready prompts
-> accepted fixture / future training corpus + optional illustrated replay collateral
@ -67,6 +67,14 @@ Names are handles, not faces. The visual reviewer judges the playable Ink
experience and visual plan; clean-run prose receipts are debugging mirrors, not
the reviewed visual surface.
Multi-angle illustrated replay needs geometry, not hopeful prose continuity.
When a fixture needs several camera angles in the same space, emit a
`.blockout.json` plan and generate Blender guide renders. The blockout is a
spatial maquette for room shape, scale, large object placement, actor blocking,
and camera angle. It is not a segmentation mask, and flat semantic colors are
human-readable helper marks rather than a secret language the image model is
expected to obey.
## Important Contracts
- Agent state: `schemas/agent-state.schema.json`
@ -77,6 +85,8 @@ the reviewed visual surface.
- Responder packets: `schemas/responder-packet.schema.json`
- Responder outputs: `schemas/responder-output.schema.json`
- Ink branch contract: `docs/architecture/ink-branching-scenes.md`
- Visual blockout contract: `docs/architecture/visual-blockout-architecture.md`
- Visual blockout schema: `schemas/visual-blockout-plan.schema.json`
- Training stages and corpus gates: `docs/architecture/training-plan.md`
## Current Live Example

View file

@ -64,6 +64,12 @@ not carry live next-action lists.
character refs only for characters actually visible in the rendered frame;
keep continuity notes as tooling constraints unless rewritten as visible
prompt text.
- Visual blockout correction: for multi-angle illustrated replay, prompt
continuity is not enough. Emit a `.blockout.json` plan for any fixture
that needs stable room geometry across several cameras, then generate
Blender guide renders. Treat the blockout as a spatial/camera maquette
for room shape, scale, large objects, actor blocking, and shot angle, not
as a segmentation mask or a hidden color contract for imagegen.
- IF review correction: run an independent artifact reviewer after branch/Ink generation and before acceptance. The reviewer audits fake variables, cosmetic choices, missing state reads, fake folds, unearned convergence, state-named-instead-of-checked prose, visual callback gaps, and endings that ignore major state. The first Cold Wake user review is a seed failure taxonomy for this evaluator path.
- Visual review correction: run a visual scene continuity reviewer for
illustrated fixtures. It audits oversized Ink screens, missing visual