Add visual blockout pipeline
This commit is contained in:
parent
4db20c237d
commit
139902246e
15 changed files with 1447 additions and 8 deletions
|
|
@ -61,6 +61,8 @@ path is a source-grounded branching-scene data loop:
|
|||
- Narrative quality reviewer prompt: `prompts/narrative-quality-reviewer.md`
|
||||
- Visual scene continuity reviewer prompt:
|
||||
`prompts/visual-scene-continuity-reviewer.md`
|
||||
- Visual blockout architecture: `docs/architecture/visual-blockout-architecture.md`
|
||||
- Visual blockout schema: `schemas/visual-blockout-plan.schema.json`
|
||||
- Research-enabled Sella packet: `examples/responder-packets/scene-02-sanctuary-intake.sella_ren.packet.research.v0.json`
|
||||
- Research-enabled Sella capture: `experiments/responder-packets/cold-wake-sanctuary-intake-sella-research-enabled-v0.capture.json`
|
||||
- Research-enabled Sella mutation: `experiments/responder-packets/cold-wake-sanctuary-intake-sella-research-enabled-v0.mutation.json`
|
||||
|
|
@ -96,6 +98,8 @@ path is a source-grounded branching-scene data loop:
|
|||
- Pallas Species Strikes Ink scaffold: `examples/ink/pallas-species-strikes.branch-and-fold.v0.ink`
|
||||
- Pallas Species Strikes Ink sidecar: `examples/ink/pallas-species-strikes.branch-and-fold.v0.training.json`
|
||||
- Pallas Species Strikes visual plan: `examples/visual/pallas-species-strikes.branch-and-fold.v0.visual.json`
|
||||
- Pallas Species Strikes Service Ring Kappa blockout plan:
|
||||
`examples/visual-blockouts/pallas-species-strikes.service-ring-kappa.v0.blockout.json`
|
||||
- Pallas Species Strikes readable run: `experiments/pallas-species-strikes/pallas-species-strikes.branch-and-fold-clean-run.v0.md`
|
||||
- Branch compiler and IF reviewer contract: `docs/architecture/ink-branching-scenes.md`
|
||||
|
||||
|
|
@ -163,13 +167,19 @@ mappings. It now segments the introduction, branch locations, Kappa red alert,
|
|||
climax decision, and aftermath into click-through visual sections with
|
||||
`visual_scene_id` anchors, stable `visual_character_refs`, a global Media
|
||||
Molecule Dreams-style volumetric brushstroke cue, and imagegen-ready prompts
|
||||
that explain fictional equipment in visible terms. Its location grounding now
|
||||
that explain fictional equipment in visible terms. A new visual blockout seam
|
||||
adds a Blender-backed `ghostlight.visual_blockout_plan.v0` maquette for Service
|
||||
Ring Kappa: room shape, scale, large object placement, actor blocking, and
|
||||
camera angles. The blockout guide is a spatial reference for image generation,
|
||||
not a segmentation mask or hidden color contract. Its location grounding now
|
||||
uses the Bloom process correctly: engineered rotating shell, consolidated
|
||||
asteroid rubble/aggregate, TCS substrate, seals, supports, and service systems,
|
||||
with image prompts written as affirmative visible targets. Treat it as
|
||||
coordinator/IF scaffold training data, not raw responder gold.
|
||||
coordinator/IF scaffold training data plus illustrated replay collateral, not
|
||||
raw responder gold.
|
||||
|
||||
Next: add the corpus coverage ledger seam or choose the next Aetheria fixture
|
||||
Next: promote the blockout seam only as far as needed for the Pallas fixture,
|
||||
then add the corpus coverage ledger seam or choose the next Aetheria fixture
|
||||
from the 100-150 broad coverage target.
|
||||
|
||||
## Warnings
|
||||
|
|
|
|||
|
|
@ -35,7 +35,7 @@ Aetheria lore/source context
|
|||
-> mutation receipt
|
||||
-> updated scene/world/social state
|
||||
-> coordinator continuity and next-beat plan
|
||||
-> branch compiler materializes Ink + sidecar + visual plan + compiler notes
|
||||
-> branch compiler materializes Ink + sidecar + visual plan + optional blockout plan + compiler notes
|
||||
-> IF artifact reviewer audits consequence, fold, and visual continuity
|
||||
-> visual scene reviewer audits click-through segmentation and imagegen-ready prompts
|
||||
-> accepted fixture / future training corpus + optional illustrated replay collateral
|
||||
|
|
@ -67,6 +67,14 @@ Names are handles, not faces. The visual reviewer judges the playable Ink
|
|||
experience and visual plan; clean-run prose receipts are debugging mirrors, not
|
||||
the reviewed visual surface.
|
||||
|
||||
Multi-angle illustrated replay needs geometry, not hopeful prose continuity.
|
||||
When a fixture needs several camera angles in the same space, emit a
|
||||
`.blockout.json` plan and generate Blender guide renders. The blockout is a
|
||||
spatial maquette for room shape, scale, large object placement, actor blocking,
|
||||
and camera angle. It is not a segmentation mask, and flat semantic colors are
|
||||
human-readable helper marks rather than a secret language the image model is
|
||||
expected to obey.
|
||||
|
||||
## Important Contracts
|
||||
|
||||
- Agent state: `schemas/agent-state.schema.json`
|
||||
|
|
@ -77,6 +85,8 @@ the reviewed visual surface.
|
|||
- Responder packets: `schemas/responder-packet.schema.json`
|
||||
- Responder outputs: `schemas/responder-output.schema.json`
|
||||
- Ink branch contract: `docs/architecture/ink-branching-scenes.md`
|
||||
- Visual blockout contract: `docs/architecture/visual-blockout-architecture.md`
|
||||
- Visual blockout schema: `schemas/visual-blockout-plan.schema.json`
|
||||
- Training stages and corpus gates: `docs/architecture/training-plan.md`
|
||||
|
||||
## Current Live Example
|
||||
|
|
|
|||
|
|
@ -64,6 +64,12 @@ not carry live next-action lists.
|
|||
character refs only for characters actually visible in the rendered frame;
|
||||
keep continuity notes as tooling constraints unless rewritten as visible
|
||||
prompt text.
|
||||
- Visual blockout correction: for multi-angle illustrated replay, prompt
|
||||
continuity is not enough. Emit a `.blockout.json` plan for any fixture
|
||||
that needs stable room geometry across several cameras, then generate
|
||||
Blender guide renders. Treat the blockout as a spatial/camera maquette
|
||||
for room shape, scale, large objects, actor blocking, and shot angle, not
|
||||
as a segmentation mask or a hidden color contract for imagegen.
|
||||
- IF review correction: run an independent artifact reviewer after branch/Ink generation and before acceptance. The reviewer audits fake variables, cosmetic choices, missing state reads, fake folds, unearned convergence, state-named-instead-of-checked prose, visual callback gaps, and endings that ignore major state. The first Cold Wake user review is a seed failure taxonomy for this evaluator path.
|
||||
- Visual review correction: run a visual scene continuity reviewer for
|
||||
illustrated fixtures. It audits oversized Ink screens, missing visual
|
||||
|
|
|
|||
Loading…
Reference in a new issue