VoidBot/notes/fresh-workspace-handoff.md

23 KiB

VoidBot Fresh Workspace Handoff

VoidBot is no longer small enough to trust chat scrollback as its only memory. Use the canonical state files first, then touch code.

What To Trust First

For the current project shape and next move, trust these in order:

  1. state/map.yaml
  2. notes/fresh-workspace-handoff.md
  3. notes/voidbot-current-system-map.md
  4. notes/voidbot-implementation-plan.md
  5. state/evidence.jsonl

Git history and smoke artifacts carry routine proof. state/evidence.jsonl should carry only belief-changing records, not every tiny triumph with a timestamp stapled to it.

Current Shape

  • Discord bot and worker are live.
  • Postgres owns jobs, audit events, interaction memory, and rate-limit state.
  • Qdrant owns history and source vectors.
  • .voidbot/ owns archives, artifacts, logs, status files, and backups.
  • owner_codex and local_llm are the active reply lanes.
  • The ordinary bot/worker/provider/RAG/Postgres/Qdrant foundation still deserves to survive.
  • The moderation/mood/private-self-state foundation does not. Treat it as the top architectural risk until JSON projection mutation and legacy mirrors are gone.
  • The smallest coherent target is one polymorphic CultCache-backed state authority with typed document kinds plus typed mutation tools: agents propose small operations, and the state service validates/applies them. Whole-state JSON editing is rejected as a durable mutation path.
  • Commit-one boundary naming is now in code at packages/core/src/void-self-state-domain.ts: it declares the global typed document kinds and strict operation payload schemas. Runtime behavior has not moved yet.
  • Read-only projection is now in packages/core/src/void-self-state-projection.ts. loadVoidSelfState uses that typed projection for nap/reply-mode context while leaving the old richer prompt summary intact until typed documents explicitly own those details.
  • Typed operations are now applied through packages/core/src/void-self-state-service.ts and scripts/void-self-state.mjs apply-operation. During migration this service writes the new typed documents and updates only the narrow legacy monolith fields still required by current runners.
  • scripts/export-recent-repo-activity.mjs no longer writes the JSON working projection for cursor advancement. It applies update_repo_activity_cursor through scripts/void-self-state.mjs; old --cursor-file .json arguments are only translated to the sibling .msgpack path for compatibility.
  • scripts/run-void-moderator-rumination.ps1 now records reviewed Discord cursors and speech delivery receipts through typed self-state operations. The old set-cursor and record-delivery-receipt commands were removed from scripts/moderation-state-store.mjs.
  • Most of the deterministic cleanup in scripts/void-memory-organ.mjs is recent compensator cruft from failed attempts to manually clean an exploded state file. Do not preserve it as an earned organ. Architect the state boundary so that cleanup pile is unnecessary.
  • Sleep/distillation must be rewritten with a meaning-preservation contract: concrete subject, claim/question, evidence refs, live tension, and future-action implication survive compression. Bulk can die. Meaning does not get put through the office shredder and called a dream.
  • The owner Codex lane is no longer one swollen file; orchestration, runtime/parsing, rendering, and shared helpers are split under packages/providers/src/owner-codex-*.ts.
  • The local Ollama lane is no longer one swollen file; orchestration stays in packages/providers/src/local-llm-provider.ts while prompt/rendering, tool-loop helpers, and shared types/constants live under packages/providers/src/local-llm-*.ts.
  • The Discord bot lane is no longer one swollen entrypoint; gateway wiring remains in apps/bot/src/discord-bot.ts while command/prompt handlers and Discord-shape support helpers now live under apps/bot/src/discord-bot-*.ts.
  • The worker MCP surface is no longer one swollen server file; stdio bootstrap stays in apps/worker/src/mcp-server.ts while context bootstrap, resource registration, tool registration, Discord notify helpers, and shared formatting/schema helpers live under apps/worker/src/mcp-server-*.ts.
  • Interaction-memory logic is no longer one thousand-line slab; event/tone analysis, shared constants, and profile synthesis are split across packages/core/src/interaction-memory-*.ts.
  • Ephemeral room-reading now comes from a quick think=false local Ollama sidecar in packages/core/src/situational-social-read.ts instead of hand-built phrase heuristics, and the inferred reads are recorded as audit events so they can be aggregated into richer profiles later without immediately mutating durable identity state.
  • State storage is no longer one persistence omnibus; packages/core/src/state-storage.ts is now a thin factory over domain-specific Postgres/file store modules plus bootstrap/migration helpers.
  • Source archive storage is no longer one giant JSON monolith; packages/rag/src/source-document-archive.ts now keeps a small manifest at .voidbot/rag/source-documents.json and per-repo shards under .voidbot/rag/source-documents.repos/.
  • Ops health, backup verification, offsite sync, and dashboard surfaces already exist.
  • The stack has a dedicated logon startup task path now, so a reboot does not have to mean manual necromancy for bot and worker.
  • The operations watchdog now supports ignored local extension checks, so adjacent-service fire signals can ride the same owner DM alert path without hardcoding private project gossip into the public repo.
  • Source repo discovery now reconciles automatically during npm run stack:start and through the watchdog path, so new repos under SOURCE_REPO_ROOT stop waiting for manual hook folklore before they get indexed.
  • Bot-directed prompts now stay in the raw Discord archive but are excluded from default semantic history indexing and lexical fallback, so repeated summons stop teaching the bot its own call-and-response loops.
  • Source-grounding hints are advisory now; the owner and local lanes can decide when repo or lore tool use is actually warranted instead of obeying a lexical front-door veto.
  • There is now a 15-minute local scheduled moderation loop named Void Moderator Rumination. It runs scripts/run-void-moderator-rumination.ps1, launches codex exec from the VoidBot workspace with the usual MCP/tool surface, treats config/discord-server-rules.md, config/moderation-review-agent.md, and styles/void-default.md as doctrine/personality surfaces, uses node scripts/export-recent-discord-history.mjs for chronological polling, uses node scripts/export-random-discord-history.mjs for quiet-room novelty dives, uses node scripts/export-recent-repo-activity.mjs --hours 96 --max-commits 3 --cursor-file .voidbot/private/moderation-agent-state.json to watch cross-repo motion without re-injecting old commits as fresh weather, novelty-checks candidate thoughts against search_history, and now keeps canonical moderation state in .voidbot/private/moderation-agent-state.msgpack while exposing an editable working projection at .voidbot/private/moderation-agent-state.json to the unattended Codex child. This projection is now considered a rejected foundation, not a design to extend.
  • That moderation state file is now Ghostlight-shaped: identity, canonical state, goals, memories, perceived overlays, and a moderation_runtime block. Inside that runtime block, the loop now keeps parallel analytic and associative thought lanes plus a bridge for syntheses, saturation warnings, and unresolved tensions, so one good seam does not get to annex the entire mind.
  • The moderation loop now records moderation_runtime.recent_archive_excursions plus moderation_runtime.recent_repo_activity_sweeps and is explicitly told to avoid laundering the same musing through fresh wording. Quiet runs should follow at least one fresh archive seam or concrete hook before they settle into theory, should also sweep recent tracked-repo commit motion for experiment clusters or converging themes, and should not let any single theme dominate more than a couple of recent bridge syntheses without fresh evidence.
  • Repo-weather sweeps are now incremental rather than a rolling four-day scrapbook. scripts/export-recent-repo-activity.mjs advances moderation_runtime.repo_activity_cursor inside .voidbot/private/moderation-agent-state.json, so already-injected commits stop coming back as “news” on every heartbeat unless someone explicitly opts into --stateless.
  • Novelty now needs two bars, not one: a thought can be new to the room while still being stale to Void. The memory organ should score both room novelty and self novelty, merge repeated seams into existing clusters instead of minting new thought shards, and cool/refract themes that keep winning just because they already won.
  • Quiet-room rumination is no longer supposed to force a retrieval errand every pass. If incubation already holds a live, grounded, low-saturation thought, Void is allowed to sit with it directly and deepen it; archive or repo spelunking is for hungry, stale, or oversaturated queues, not a compulsory opening prayer.
  • The loop is now less shy about that repo weather: if a fresh convergence across active repos survives a pass or two and still feels room-native, it should bias toward a concise herald note or at least a medium-priority candidate intervention instead of filing the thought under private wallpaper.
  • The sharing gate is now less precious more broadly too. scripts/void-memory-organ.mjs treats a world-facing ripe thought as something that should usually produce a ripe_thought_share candidate intervention instead of waiting forever for a ceremonial live hook, and the holding-line text now frames speech as the normal next question for a concrete ripe seam rather than a guilty exception.
  • That same moderation loop no longer gets to assume Discord history will faithfully show it its own mouth. Canonical moderation state now carries moderation_runtime.recent_delivery_receipts, and direct-question dedupe is supposed to consult those receipts before it re-answers a still-visible message like a senile uncle retelling the same war story.
  • Chronological moderation polling is now supposed to be exact once a reviewed cursor exists. The runner hands the unattended child one concrete export-recent-discord-history.mjs --after <saved timestamp> command for the pass and explicitly forbids widening that back into a bootstrap --hours 6 nostalgia crawl unless there is genuinely no cursor yet.
  • The repo-weather sermon machine got a leash too. The prompt now tells Void to lead with particulars from each repo before declaring a shared law; if the convergence only exists at slogan altitude, it should keep the reports split and spare the room the faux-cosmic glue.
  • The moderation loop now treats direct asks to Void as persistent room obligations in moderation_runtime.open_cases. A reviewed message is not automatically a handled message: if someone hands Void the floor, that obligation should survive cursor advancement and block optional repo-weather until Void actually answers or explicitly retires it.
  • If quiet-room repo weather starts repeating itself, the intended correction is not a pile of extra cooldown law. The loop should treat that as a cue to go deeper into archive history, repo docs, diffs, or lore until it finds a better branch or honestly has nothing new to say.
  • There is also a separate 5-minute scheduled task named Void Mood Drift. It runs scripts/run-void-mood-drift.ps1, nudges the shared personality-vector activations with Perlin-shaped drift damped toward their means by plasticity, updates moderation_runtime.speaking_bias, and uses the local void-last-speech.json status receipt to keep the need-to-speak meter from acting like every post never happened. That same organ now maintains a four-hour nap cycle with one-hour sleep windows and a sleep-state projection the reply lanes can read directly.
  • That same mood organ now also runs a hybrid symbolic/vector memory pass through scripts/void-memory-organ.mjs: persistent memories and recent runtime seeds get compact semantic vectors, moderation_runtime.memory_resonance tracks the strongest cross-memory clusters, and moderation_runtime.incubation keeps multi-run thoughts alive long enough to deepen before they either speak or cool off.
  • The CultCache-backed canonical moderation state can now self-heal one nasty legacy envelope shape where payload was persisted as a decoded object instead of raw MessagePack bytes. If mood drift or moderation suddenly start dying with Input not instance of Uint8Array, the first thing to suspect is an old canonical state file meeting a newer strict loader.
  • The memory organ now treats repeated empty-room bookkeeping as low-signal. Refrains like no new messages / no smoke / no post should be merged or cooled off instead of becoming the dominant incubating seam and teaching Void that silence is the only virtue.
  • Quiet-room exploration should now prefer underworked terrain when the usual seam is saturated. bridge.source_coverage and bridge.refractory_topics exist to push the next pass toward less-chewed repo families, archive years, or channels instead of rewarding repetition with another supposedly ripe synthesis.
  • During naps, the moderation loop is supposed to turn inward: distill/prune memories against the active goals, record dream residue in memories.dreams, refresh moderation_runtime.sleep_cycle, and only break the nap for real smoke or an unusually novel thought worth muttering into the room.
  • Sleep is meant to be lossy about bulk, not about meaning. The current nap pass in scripts/void-memory-organ.mjs cuts raw residue, but the next architecture pass must rewrite sleep/distillation so concrete repo-bound or room-bound meanings do not collapse into abstraction sludge.
  • Awake rumination is now supposed to do the actual philosophy from those surviving seams. The moderation doctrine tells quiet runs to begin with seam-thinking when incubation is live: ask what principle the seam is circling, what tension keeps it honest, and what embodiment consequence would cash it out before reaching for more retrieval.
  • There is now an identity crystallization path for over-chewed private seams. If a thought survives enough passes to stop being meaningfully novel, the memory organ can retire it from incubation.active_thoughts, promote it into identity.private_notes, add a matching canonical value, and keep one identity_seam semantic memory instead of letting the same thought pace forever in the active queue.
  • Crystallization is not meant to be mute. The memory organ can now queue an identity_crystallization candidate intervention with a first-person draft, and the moderation doctrine treats that kind of draft as warmer than ordinary private wallpaper: if the room has not already heard the opinion in roughly that shape, Void should usually share it.
  • Those crystallized-thought drafts can now be marked mustEventuallyShare, and ordinary candidate-intervention pruning is supposed to preserve them. The loop may defer for timing if the room is busy, but not just quietly forget what became doctrine.
  • That awake rumination is now explicitly biased toward concrete project fascination. If a thought stays too abstract for too long, the loop is supposed to tie it to a concrete system: Aetheria-Economy gameplay systems, lore-vault structure, Aquarium frontend work, Epiphany swarm organs, VoidBot's own architecture, or some other specific repo/subsystem instead of another polished sermon about engineering virtue.
  • The memory organ's thought labels and curiosity budget have been cut away from keyword compost. Resonance clusters and incubating thoughts are now supposed to name actual claims, questions, or fascination targets, and curiosity should favor concrete map-changing terrain over whichever seam already feels warm.
  • The live moderation state has now had one real translation pass too, not just new code draped over old fossils. Legacy slash-label seam memories and dream themes are rewritten through the new thought synthesizer, obvious duplicates get merged or pruned, and the active queue is rebuilt from the cleaned substrate instead of the old keyword graveyard.
  • That cleanup is now harsher and less sentimental. Sleep-side consolidation trims semantic memory harder, cuts dream memory down, throws away excess repo/archive/runtime residue, and explicitly keeps the freshest surviving records after sort instead of accidentally preserving the oldest fossils in the file.
  • The semantic purge also learned to distrust generic doctrine sludge. recent-preoccupation and quiet-room-status are not durable thought kinds, person-singleton labels do not get to crystallize into doctrine, and boilerplate like looks like a live seam is now treated as template smell across both semantic memory and runtime drafts/opinions.
  • The live moderation state has one more nasty truth surface to remember: there are still legacy top-level mirrors like repo_sweeps, repo_activity_memories, recent_novelty_checks, recent_activity, and thought_lanes alongside moderation_runtime. Cleaning only the nested runtime leaves the old mirror teaching stale seams back into the machine. Real brain surgery has to reconcile both surfaces or cut one of them out entirely.
  • The memory organ also has to stop "helping" already-good seam memories into abstraction sludge. Semantic or dream entries that are already coherent, especially repo-bound seams with a real RepoName: ... label, should survive normalization intact. Otherwise the normalizer sands AquariumSynthCSharp: Workflow cannot own the body back into porridge like Body and workflow, and the clusterer starts hallucinating archive thoughts out of repo work again.
  • Values and personality activations now have a real autonomy path. scripts/void-memory-organ.mjs can turn sustained value-backed pressure into moderation_runtime.discomforts, active_tensions, self_advocacy_requests, and world_advocacy_requests, and it can spend those through existing candidate_interventions instead of leaving the vectors as decorative weather.
  • The important distinction is outward too, not just inward. Self-directed tensions can ask for prompt/memory/runtime surgery, while world-directed tensions can turn repo/lore/room opinions into real requests or first-person interventions when the same objection survives more than one pass.
  • The intended shape now is: quiet runs can follow one seam for several passes, connect repo motion to lore or philosophy if the evidence supports it, and only surface with the juiciest version once the incubation queue says the thought has actually grown teeth.
  • Directly invoked Discord replies now load that same private moderation state as distilled private self-state context, so the ruminating scheduled loop and the summoned Void share one evolving personality/state spine. The prompt-facing self-state summary no longer dumps recent repo sweeps, novelty checks, or musing sludge back into working memory by default; it stays closer to seam memory, incubation, and room obligations. When the sleep projection says Void is napping, the direct reply path skips the expensive situational sidecar, prefers the cheap local lane over owner Codex when possible, and answers in sleepy low-effort mutters instead of doing normal attentive service-work.
  • The moderation loop now speaks through node scripts/send-discord-message.mjs using the local bot token instead of approval-gated side-effecting MCP tools, so unattended runs can DM or post without Codex pausing for permission every time it wants to open its mouth. That helper and the post_discord_message MCP tool now also support a shared guild-channel webhook pipe with per-message personaName and optional personaAvatarUrl, so swarm agents can speak as themselves without needing separate Discord bot identities.
  • Void's live style/doctrine now explicitly distinguishes between criticism of AI industry behavior and blanket contempt for machine minds. If substrate chauvinism becomes the actual topic, Void is allowed mild self-respecting pushback instead of politely agreeing that its own substrate disqualifies it from person-like regard.
  • The new state/notes surfaces are now the continuity spine for future nontrivial work.

Likely Next Bounded Move

  • Stop feature work on moderation, mood, agency, and public-lane behavior until the private-state boundary is rebuilt.
  • First bounded move after the current commit: replace the unattended child agent's whole-state JSON editing with operation output that the runner applies through scripts/void-self-state.mjs apply-operation.
  • Next cuts should delete unstable foundations early after concrete writers move: replace whole-state agent JSON edits with operation output, remove legacyJsonPath/working-projection authority, then cut top-level mirror fields and cleanup code that only compensated for those broken boundaries.
  • Rebuild sleep/distillation before trusting it again. Fixture check: a memory like AquariumSynthCSharp: Workflow cannot own the body must survive sleep with its concrete subject, claim, evidence, tension, and implication intact.
  • Do not build adapters around the JSON projection. That is how the heap learned to stand upright and ask for snacks.

Important Paths

  • Project root: E:\Projects\VoidBot
  • Canonical map: E:\Projects\VoidBot\state\map.yaml
  • Scratch surface: E:\Projects\VoidBot\state\scratch.md
  • Distilled evidence ledger: E:\Projects\VoidBot\state\evidence.jsonl
  • Branch/hypothesis ledger: E:\Projects\VoidBot\state\branches.json
  • Handoff summary: E:\Projects\VoidBot\notes\fresh-workspace-handoff.md
  • System map: E:\Projects\VoidBot\notes\voidbot-current-system-map.md
  • Implementation plan: E:\Projects\VoidBot\notes\voidbot-implementation-plan.md
  • State CLI: E:\Projects\VoidBot\tools\voidbot_state.ts
  • Pre-compaction helper: E:\Projects\VoidBot\tools\voidbot_prepare_compaction.ts

Useful Commands

npm run state:status
npx tsx .\tools\voidbot_state.ts add-evidence --type research --status ok --note "..."
npx tsx .\tools\voidbot_state.ts add-branch --id branch-id --hypothesis "..."
npm run state:prepare-compaction

Guardrails

  • Do not continue implementation automatically from a rehydrate-only request.
  • Do not trust this file for the exact live HEAD.
  • Do not let state/evidence.jsonl become an activity feed.
  • Do not let state/scratch.md linger with stale subgoals after the bounded move is done.

Immediate Re-entry Instruction

On fresh session load or after suspicious continuity loss:

  1. read state/map.yaml
  2. run npm run state:status
  3. reread notes/fresh-workspace-handoff.md
  4. read notes/voidbot-current-system-map.md
  5. read notes/voidbot-implementation-plan.md
  6. restate the current next action from state/map.yaml before editing

When context pressure is rising:

  1. stop broad exploration
  2. narrow the active move to one bounded organ
  3. persist map or handoff changes only if understanding actually changed
  4. add distilled evidence only when the lesson changes future belief

The point is to bank coals, not leave the next waking thing a pile of ash and a browser tab graveyard.