201 KiB
CultCache Migration Cut
Date: 2026-09-13 (second Imagination pass; first pass 2026-09-12, 82c1e72e)
Status: cut map. Ends are owned by cultcache-migration-target.md; this
document owns the means. Progress (update in each cut's landing commit):
Cuts 0-4 landed on CultLib codex/cultcache-store-routing and passed their
Soul passes (Cut 4 ended at 5bd4e4e, generator deleted, registry aligned to
MessagePack round-trip semantics; the five GameCult.Eve.Surface documents'
schema ids change because their constructor-filled get-only members now enter
the catalog, and no store on disk holds them). Cut 5 landed (ended at
47c7111): mirrors deleted in TS, Rust and Python; each sibling enforces one
home store, a record's home cannot move, refusal at load from a non-home
store, zero stores in memory, validation before any store write, a TS per-cache
serial queue and a Python per-cache lock, globals only under __global__ with
a legacy-key load shim. Re-pin follow-ups: TS addBackingStore,
addGenericBackingStore, registerDocumentType, registerRegistry,
registerNameLookup and registerIndex now return promises (VoidBot's vendor
fork, if it adopts CultLib's package); Rust callers of add_backing_store
should propagate the new Result with ? (Epiphany epiphany-core,
CodexConnector); Rust CacheBackingStore implementations must provide
push_all (Epiphany's already does); Heimdall re-vendors CultLib when it moves.
Cut 6 (Studio on an engine-free inspection model) and Cut 6b: CultMath grows
what Aetheria needs landed after four and four Soul passes; merge commit
1b95dd6 on codex/cultcache-store-routing brings in
codex/cultmath-hlsl-parity (d4c43ed).
Cut 7 is mostly landed. Main merged at 546c919, and the release commit is
ae194d5, which carries rebuilt Unity plugins; the build now leaves the
commit out of the output, so the byte check passes after a commit. Tags on
ae194d5:
cultlib-unity-v1.0.57caching-unity-v1.2.0cultmath-unity-v0.2.0(?path=/packages/cultmath/unity/org.gamecult.cultmath)cultcache-ts-v0.14.0cultcache-py-v0.3.0
GitHub skips tag workflows when one push carries more than three tags, so no
publish job ran. The operator ruled (2026-09-14) that only cultcache-py is
re-pushed alone to publish to PyPI. npm publication of cultcache-ts is
parked by choice (operator, 2026-09-16, recorded as Q5 C in CultLib's
docs/typescript-quic-realtime-cut.md): there is no repo-level NPM_TOKEN,
no cultcache-ts publish has ever run, and the cultcache-ts-v0.14.0 tag
stays inert. Consumers use file: paths. Unity
versions 1.0.47-1.0.56 were never tagged. Cut 8 is split into 8a (CultMath
swap) and 8b (data model cutover), refreshed against Aetheria 59bc5753.
Cut 8b landed on codex/cultcache-cutover (d3db1730..9bdf6ef2). Its Soul
pass found the following; Cut 10 now owns every item:
- Unity opens no run store, so run-type writes throw.
SaveLoadoutis live and serializesfloat3without the math resolver.PlayerSettings.SavedRunis a second owner of the run root.- Every save leaves orphan
SavedZones behind. - Four non-CultCache file formats remain.
- No lifecycle owner creates the run and player globals.
Cuts 9 and 10 are refreshed against Aetheria 20db3a93. Cut 9 landed at
70fbaca1 and passed Soul:
- 180 catalog records landed in one commit.
factionsis byte-identical to the Cut 8a capture.censusandhardpoint-fitmatch once ties are sorted, after the census normalizer was fixed to split the first maker off its column.- Every record was compared at the wire level against the legacy file.
- A failed import writes nothing.
Recorded, not fixed (the importer is deleted in Cut 10):
- An empty
NameFilefolder imports silently. - The
RequireBehaviorrewrite rule and the bin16DatabaseLinkrewrite rule never fire on this data. - A slot with no matching member is copied raw.
CultLib b85a828 (tags cultlib-unity-v1.0.58 and caching-unity-v1.3.0)
gives drawers a read-only CultInspector.Record. Soul found that it writes an
unset CultRecordRef as a nil map key, which Python's msgpack rejects. The
correction release makes "" the canonical unset wire form, and readers
still accept nil.
CultLib 1.0.59 / Studio 1.3.1 (a0813c6) passed Soul. Four low follow-ups are
recorded, none blocking:
CultRecordRefFormatter.cs:15-16: the empty check is dead, becauseCultRecordKeyalready equates null and"". The reader can collapse to one line.- The contract's reason for accepting nil should also name code from before
452f928. - No script enforces the release byte check; it is a manual
git diffafter a rebuild. - A dictionary holding both a nil key and a
""key throws a load error that names the document type but not the record. Only a non-C# writer following the brief 1.0.58 guidance could produce it.
Cut 10 landed on codex/cultcache-cutover (4a545469..1cd6170d):
- CultLib is pinned to 1.0.59.
danglingcleared the three DemandProfile keys and lists exactly the threeWeaponData.AmmoTyperefs.- One cache holds all three stores for the process.
RunSavecommits a save atomically with stable zone keys and clears the run on New Game or death.SavedRun, the msgpack settings and layout I/O,.loadout,SaveState,SaveZoneand the importer are deleted.- Loadouts are authored ship presets in the catalog. This was reworked
after the operator redefined loadouts; see Rulings.
- They are design-only.
- They are captured in the editor with
capturepreset "<name>" [replace]. - Capture goes through
Loadouts.Commit(catalogPath, …), the only preset writer. It opens its own short-lived writable cache and commits the one record conditionally. - The process cache keeps the catalog read-only in every build, so play-mutated catalog objects cannot persist, and a missing global stays loud. This is legal because read-only single-file stores take no lock.
- Capture refuses when the catalog file is missing, and when the same name already exists under another key.
- The console now refuses, instead of stripping, any command with characters
outside
[a-zA-Z0-9 -]. This applies to every console command. - Materialize owns availability (a port wired to
LoadoutGenerator.IsAvailable, candidates in key order) and is all-or-nothing. - The player menus, affordability, the charge and
Priceare deleted. - Known gaps, accepted for a dev tool:
- No test reaches the conditional commit's
Expect: the race window lies inside one call. - A Studio save landing between the name check and the lock could still insert a duplicate name.
- No test reaches the conditional commit's
- CultLib follow-up: a CultCache Studio session that is open while a preset is captured overwrites the preset on its next Save (single-file last-writer-wins). The Studio should detect an on-disk change before saving. Until then, reopen the Studio after capturing.
StableHashreplacesName.GetHashCode().- The schematic drawer is restored through
inspector.Record. TryUnequipnow removes weapons from their groups. This was a live bug outside loadouts: an unequipped weapon still fired from the action bar.
Verification at ab4ced0f:
- 25 tests pass, and each rule fails under its mutation.
- AetherDb captures are byte-identical to Cut 9.
- Unity 6000.3.24f1 batchmode reports 0 errors.
The first Soul pass found untested all-or-nothing, availability and price rules, weapon-group corruption, dictionary-ordered product choice, and a premature "done". All are fixed.
Recorded, not fixed: New Game clears the previous run before generation, as the spec says, so a generation fault loses that run.
GameData/PlayerSettings.msgpack entered history through 5c5c3d5e. It holds
defaults and the username, and about 65 earlier versions are already in LFS
history, so history is left alone.
The operator play smoke passed (2026-09-17) and both branches merged to master at
9b85211f: new game, combat, loot, save and Continue with lot brand and quality intact,
death clearing the run across relaunch, stance toggle, FieldShieldTest. It found one
migration defect: CultMath types are not Unity-serializable, so Unity-serialized CultMath
fields load as zero. Mouse sensitivity (lost look control) moved to PlayerSettings in
00ebe46a; the rest, including the black rarity colours, is docs/settings-globals-cut.md.
Scene materials are broken by the dead Substance plugin, not by this migration.
History, before the smoke:
- nothing else from agents. The preset rework's Soul findings were fixed in
d503f076,d90a65a9and20f0f3d7: 29 tests, 18 of 19 mutations caught (the survivor is the one noted above), and Unity batchmode reports 0 errors.
The Studio click-through passed (operator, 2026-09-17). The three AmmoType refs
were repointed in 515859cf, and dangling lists zero. The schematic underlay
was drawn across the whole inspector width, because the port dropped the old
drawer's FlexibleSpace; it was restored and checked by the operator in the
commit after 515859cf.
The Database Tools' record grouping (foldout tree by category, hardpoint type,
manufacturer and hull type, with create-in-group) and drag-and-drop of record
references were dropped by the cutover without being recorded. The attribute
inventory above counted attributes, and those features were code in the window
and in DatabaseLinkInspector. They are being restored in CultLib's Studio as
member attributes (operator, 2026-09-17); CultLib\docs\studio-grouping-cut.md
owns that work.
Presets are not yet used by any spawner. The candidates are enemy ships
(ZoneGenerator.cs:309) and the starting player ship
(ActionGameManager.StartGame). Turrets and stations need a broader API than
the Ship-only Materialize.
Rulings (operator, 2026-09-14):
- Q9-1 A:
InputLayoutis catalog state, imported by Cut 9. - Loadouts (supersedes Q10-1's player-store ruling and Q10-3's cost and
charge). The operator said: "loadouts are not something we'll expose to
players in the MVP, but we'll be creating and using them to spawn ship
presets. Think variants in Mechwarrior."
- Loadouts are authored ship presets in the catalog. They are edited in the Studio and captured by an editor command.
- They hold only item designs: the hull's design, plus a design ref, hull cell and rotation per slot. No manufacturer is stored.
Loadouts.Materializebuilds them against the current galaxy; no game spawner calls it yet.- The player menus and the credit charge are deleted.
- Hardpoint-configuration variants are a future direction.
docs/cultcache-migration-target.md"Loadouts" is the durable owner.- The Cut 10 spec text below that describes player-store loadouts, the Save
and Restore menus,
Priceand the charge is history, not live design.
- Q10-2 A: the local
PlayerSettings.msgpackis discarded, with no importer. - Q10-3, all A. Materialization:
- uses
LoadoutGenerator.IsAvailablefor availability (the maker is present and allied with the docked station's faction); - picks the first available product of each design, in record-key order;
- is all-or-nothing: on any failure, no ship, and every failing slot is listed. (The cost and charge parts were superseded; there is no charge.)
- uses
- Cut 9's six dangling refs, option B:
- Cut 10 clears the two
CompoundCommodityData.DemandProfilekeys, which point at the deleted Conscientiousness and NeuroticismPersonalityAttributes. They are on Mouth Adapting Gummy Molars (2 keys) and Neural Lace (1 key), and nothing readsDemandProfile. - The three
WeaponData.AmmoTyperefs, on DeathCluster, FastBlast+- and pretty pretty bang bang, point at the deleted Auto and Charged Shotgun Ammo. The operator fixes them in the Studio click-through.
- Cut 10 clears the two
- CultLib follow-ups decided alongside:
- Studio hands drawers the owning record, read-only (1.3.0, corrected in 1.3.1).
- An unset
CultRecordRefreads back exactly as written, with sibling-runtime parity checked. The canonical wire form is"", per the 1.0.59 correction. - Cut 10's schematic-shape drawer restores the texture underlay and hardpoint tints.
CultMath 0.2.1 (f060536 on main, tag cultmath-unity-v0.2.1, lightweight)
fills Q8-1's gaps:
- HLSL vector conversions in both directions between float, int and bool. Float to int truncates toward zero; the result for NaN or an out-of-range value is undefined, as in dxc.
- Integer
clampas IMax followed by IMin, so inverted bounds return the upper bound. frac(double).
Operator ruling (2026-09-14): double overloads keep full double precision, a documented exception to dxc parity, since dxc narrows double through float. The dxc rule governs float, int and bool.
Cut 8a landed on Aetheria codex/cultcache-cutover (4f4beb0f..2b38d2dc).
What was verified:
- Headless builds pass.
- Unity 6000.3.24f1 batchmode reports 0 errors.
census,factionsandhardpoint-fitare byte-identical to captures taken before the cut.- No
Unity.Mathematicsremains inAssets.
Soul found behaviour changes those captures cannot see, and the fixes landed:
- SectorMap label pivot:
signreturns int, so the pivot used integer division. - Pin guard: it now runs only for projects that reference
CultMath.csproj, so Unity's generated projects skip it. - Scripts outside the swap: five remaining files moved off Unity.Mathematics; none use Burst.
AetheriaMath.cs: deleted, with callers on identical CultMath formulas.- CultMath 0.2.2 (
111b918):normalizematches dxc (x * rsqrt(dot)), so zero or NaN input gives NaN, as Unity.Mathematics did. DXIL.rst's Rsqrt special-value table is a copy of Round's; the op definition wins. - CultMath 0.2.3 (
0f2c1f0, operator ruling): Jarzynski & Olano 2020 PCG integer hashes (pcg,pcg3d,pcg4d,asuint). Zone seeds use them in place of the shader-stylehash, which gave 1625 distinct seeds in 10000 positions.
Accepted as CultMath's own behaviour, because old runs are discarded:
- the
Randominteger sequence; quaternion.LookRotationnormalizing its input.
Second Soul pass on Cut 8a: nothing Hands promised turned out false. It confirmed the PCG constants against the paper using an independent Python transcription, and the three captures matched again.
Recorded follow-ups, outside 8a:
- Zone names seed through
Name.GetHashCode()(ZoneGenerator.cs:47,Zone.cs:55). This predates the cut. Mono hashes strings stably, but net10 randomizes them per process, so a headless sim that generates zones would get different zones on every run. Fix before the headless sim generates zones by hashing the name with a stable function. quaternion.LookRotationgives NaN for a zero or parallelforward/up, as Unity.Mathematics did. No CultMath test pins this;Ship.cs:310, 322, 329can hit it.- The normalize test checks C# against its own formula, not dxc output. A 1-ULP gap from dxc constant folding is unverified.
- The pin guard matches the CultMath ProjectReference by exact path, and
BuildProjectReferences=falseskips it. asuintis untested on signaling-NaN payloads.
Open:
- Whether the
CultLib-delvehold-isosurfaceworktree carries the iso-surface zero-normal code that 0.2.2 guards.
Cut 6b decisions (operator, 2026-09-14). Aetheria adopts CultMath to exercise
it, but the audit showed it is not a drop-in: missing float2x2, float3x3,
int3, int4, mul, float3 snoise, vector pow/sqrt/trig overloads,
comparisons returning bool vectors, any/all, several swizzles, and any
Unity Vector/Quaternion bridge; record struct types made components
read-only; hash, normalize and Random differ. CultMath's parity target is
HLSL, not Unity.Mathematics: HLSL source should compile as C# with the right
using directive, so components and swizzles are writable (the design doc's
"prefer immutable value types" is amended). Where CultMath intentionally
differs from Unity.Mathematics it keeps its behavior, following HLSL where HLSL
defines the intrinsic; old runs are discarded, so a different galaxy per seed
costs nothing. Only what Aetheria uses is added. The Unity bridge lives in
CultMath's Unity package; the core stays engine-free. Cut 8 then swaps
Aetheria (ServerShared, Aetheria.Shared, tools\AetherDb, Unity-side
scripts) onto CultMath and deletes the Library\PackageCache Unity.Mathematics
source include from Aetheria.Shared.csproj.
Cut 6b Soul (after CultLib 2ad8dbc): semantics and existing numeric output
held, but HLSL source did not compile as C#: most swizzles, repeated-component
and rgba swizzles, mixed constructors and matrix element writes were missing.
Operator decisions (2026-09-14, all option A): generate the full swizzle set and
mixed constructors into a checked-in file, with a test that compiles CultMath's
own shader bodies; add cheap intrinsic correctness now (numeric any/all,
int-vector min/max/abs, HLSL step on NaN, sign returning int) and defer
float4x4, transpose, determinant and _11 names until a consumer needs
them; add Studio drawers for the new CultMath types after the branch merges.
The shader mirror is compile-checked with dxc (download approved). Line
numbers below refer to the evidence base, not to the branch.
Cut 6b second Soul pass (after CultLib 10b2c15):
- Held:
- numeric output unchanged over 400 samples;
- generator reruns byte-identical;
- swizzle setters write back;
signandany/allmatch dxc;- no consumer serializes CultMath matrices.
- Defects, fixes dispatched:
stepon NaN followed the docs, but dxc lowers it tox < e ? 0 : 1, so it reverts to the compiler's behaviour. The parity target is HLSL as dxc compiles it.- The shader mirror test proved only compilation. It gains numeric comparison of every mirrored function, including ties and NaN.
- A stale cultmath bump in the Caching
package.jsonconflicts with the routing branch and is dropped. get-dxc.ps1is pinned with a hash.
- Operator decision (2026-09-14): the
refmatrix row indexer stays, with no analyzer. Writes through a readonly field, aninparameter, a property oridentityland on a defensive copy and are silently lost; design.md and the indexer document this.
Cut 6b closed (CultLib d4c43ed, after two more Soul passes):
- Unity DLL: built independently of the commit (no source revision, no Source Link, non-incremental), so its byte check passes on any SHA.
- NaN rules: float and double
min/max/clamp/saturatefollow DXIL FMin/FMax/Saturate, where a NaN operand returns the other operand. Consequence: NaN does not reliably propagate (smoothstep(a,a,a)gives 0, andnormalizewith one NaN component blows up the others), as on the GPU. design.md tells callers to checkisnanfirst. - No finite output changed: checked over 633k calls.
- Tests: the mirror test compares bit patterns. It proves the shader text
matches C# math on the CPU, not on a GPU; the intrinsic rules themselves are
pinned only by
HlslSemanticsTests. - Merge: the branch merges cleanly into
codex/cultcache-store-routingand waits for Cut 6's final Soul pass. - Operator decision (2026-09-14), supersedes "Studio drawers for the new
CultMath types after the merge": no CultMath drawers for now, and the Studio
takes no CultMath dependency. The generic unkeyed-struct rule covers them: a
struct with public fields shows its fields, and one without shows its settable
properties. So vectors edit by field and matrices by their
_mRCproperties. A drawer is added only if the Aetheria click-through shows the rows are painful.
Evidence base: CultLib main at c2a9a6e; Aetheria codex/aetheria-state-rebuild
at 82c1e72e. Line numbers refer to those revisions (CC: is
src\GameCult.Caching\CultCache.cs, DMS: is
src\GameCult.Caching.MessagePack\DirectoryMessagePackBackingStore.cs, CND:
is src\GameCult.Networking\CultNetDatabase.cs). Every mechanism claim a cut
is built on was established by running code; probes are in section 7, cited
as [P<n>]. Consumer facts come from a sweep of CultLib\src, CultLib\tests,
and every C# repo under F:\Projects referencing GameCult.Caching (Aquarium,
Ymir, Mimir, Delvehold, AquaSynth, Gjallar, Brokkr, Eve, EveUnity, EvePlugins),
excluding bin, obj, vendor, CultLib-* worktrees and AetheriaEve*.
Canonical runtimes are the C# reference under CultLib\src and the packages
under CultLib\packages. F:\Projects\cultcache-rs, cultcache-py,
cultnet-rs, cultnet-ts are defunct and cited nowhere. F:\Projects\AetheriaEve
and its worktrees are taxidermy, not a consumer.
1. Answers to the open questions
Q1. Is routing a C# behavior or a cross-runtime semantic?
Routing is the contract in every runtime: one home store per document type. Replication and mirrors are deleted everywhere. No bytes change.
- TypeScript routes by type and mirrors the rest:
addBackingStore(store, ...types)(CultLib\packages\cultcache-ts\src\cult-cache.ts:180-188),#resolveRoutereturns{primary, mirrors}(:663-677), andput,putEnvelope,deletepush toprimarythen every mirror (:401-402, 447-448, 502-503;StoreRoute.mirrorsat:18). - Rust:
add_backing_store/add_generic_backing_store(CultLib\packages\cultcache-rs\src\lib.rs:1950-1963),resolve_route_indices(:2363-2380), mirror loops at:2092-2094, 2213-2215, 2252-2254, 2323-2325;put_prepared_batchalready demands one route and one store (:2174-2189). Its README claims this "mirrors the C# behavior" (CultLib\packages\cultcache-rs\README.md:216-241), which is false. - Python:
stores_by_type: dict[str, list[BackingStore]],generic_stores: list(CultLib\packages\cultcache-py\src\cultcache_py\cache.py:23-24); write loops at:199-201, 218-219, 239-241, 269-270; resolver at:300-302. - C# replicates every record to every store (
CC:2097-2101, 2135-2139) and pushes all entries into a newly attached store (CC:1436-1439).[P2-A]: attach a second store after hydrating the first, flush with no mutation, and the second file is written with the first store's record. - Nobody uses a mirror: every cache in
CultLib\src,CultLib\testsand every consumer attaches one untyped store; the only multi-store cache anywhere is the Rust testtype_specific_store_routes_before_generic_store(CultLib\packages\cultcache-rs\src\lib.rs:3714-3748), whose types never share a store. No test asserts mirroring. - No runtime writes store identity into the file: all write
[formatVersion, catalog[], records[]], records[key, schemaId, storedAt, payload](C#CultDocumentMessagePackSerialization.cs:180-251; TSCultLib\packages\cultcache-ts\src\single-file-messagepack-backing-store.ts:203-232; RustCultLib\packages\cultcache-rs\src\lib.rs:244-280, 2401-2455; PythonCultLib\packages\cultcache-py\src\cultcache_py\stores.py:137-152).storeId(cultcache-persistence-format.md:93) is implemented nowhere.
Decision: a document type has exactly one home store, chosen by its most specific registered route (C# by assignable CLR type; TS, Rust, Python by the exact type string they already route on); a second untyped store or an overlapping route is a registration error; a write with no home is an error. C# implements it (Cut 3); TS, Rust and Python delete their mirror paths (Cut 5). Each routed file is a complete single-store file (section 3).
Q2. How do Unity.Mathematics values encode portably?
As fixed-length positional arrays of components, Aetheria's existing wire
shape [P5]. CultMath defines no encoding and is not adopted. (Superseded
2026-09-14: Aetheria adopts CultMath, the operator's decision for dogfooding
GameCult's math library. The same positional-array encoding applies to CultMath
types, and gaps found by the parity audit are filled in CultMath rather than
worked around in Aetheria. Unity.Mathematics stays licensed for tooling that
supports a Unity game under the Unity Companion License; CultLib itself uses
CultMath only.)
- Aetheria writes
float2as[f32,f32],float3three,float4four,int2[int,int],bool2[bool,bool](ServerShared\CultCache\Serialization\MathFormatters.cs:8, 49, 90, 131, 177); the realFactionrecord's twofloat3slots areArray(n3)on disk[P5].MathResolver.cs:55mapsint2?[]toArrayFormatter<float2?>, a bug fixed in Cut 8.bool2[,]uses MessagePack'sTwoDimensionalArrayFormatter. - CultMath (
CultLib\packages\cultmath) has no serialization; no sibling defines a vector shape. - The persisted member type name is the CLR full name, the same rule as
System.Int32(at the evidence base,CultGeneratedDocumentMetadata.cs:258-282and the generator; since the Cut 4 generator deletion the registry'sCultSchemaTypeNamesalone owns it, with nested types writtenOuter+Inner). - CultLib has no consumer formatter extension point:
Optionsis astatic readonlycomposite underMessagePackSecurity.UntrustedData(CultDocumentMessagePackSerialization.cs:50-55); generated serializers read it at call time[P4](historical: the generator and its serializers were deleted in Cut 4; every payload now goes throughMessagePackSerializerwithOptionsFor(assembly)). [P5]: MessagePack 3's own generator (MessagePackAnalyzer3.1.7, a dependency ofMessagePack) fails the build (CS0426) onDictionary<CultRecordRef<T>, float>by emitting a reference to a non-existentGeneratedMessagePackResolver.GameCult.Caching.CultRecordRefFormatter<T>; andUntrustedDatarefusesCultRecordRef<T>as a dictionary key ("No hash-resistant equality comparer available"). AMessagePackSecuritysubclass supplying a comparer over the key string fixes the second. The generator reaches consumers transitively through CultLib'sMessagePackreference, so the owner is CultLib:[P6]shows thatExcludeAssets="analyzers"on the library'sMessagePackreference does not stop it,[assembly: MessagePackKnownFormatter]does not fix the emission, and a direct<PackageReference Include="MessagePackAnalyzer" Version="3.1.7" PrivateAssets="all" />in the library does stop it. CultLib composesStandardResolverexplicitly and never registers a generated resolver, so it does not need the generator.
Decision: options are owned by the assembly that declares the documents.
Cut 4 adds [assembly: CultCacheFormatterResolver(typeof(R))] and
CultDocumentMessagePackSerialization.OptionsFor(Assembly); generated and
reflective serializers resolve options from the document's assembly, so there
is no mutable static, no registration call, no load-order hazard. The contract
gains: vector-like value types encode as fixed-length positional arrays of
primitive components; no ext types, no maps. Aetheria keeps Unity.Mathematics
(26,566 lines of ServerShared use Unity.Mathematics.math) and declares its
MathResolver through the attribute.
Known non-portable shape, left alone: EntityPack.Dictionary<int2, PersistentBehaviorData[]> (EntitySerializer.cs:183) lives in the Run store
no other runtime reads.
Q3. What replaces System.Type fields?
A string holding the BehaviorData subclass simple name, which the sibling
field already uses.
- The only persisted
TypeisStatModifierData.RequireBehavior(ServerShared\Behaviors\StatModifier.cs:22-23), written asAssemblyQualifiedNamebyTypeFormatterResolver.cs:17, read atStatModifier.cs:73, 80asb.GetType() == _data.RequireBehavior. StatReference.Target(:136-137) has the same[InspectableType(typeof(BehaviorData))], is astring, and is resolved by name at:63. The closed set is the[Union]list onBehaviorData(Behaviors\Behaviors.cs:152-190).
Decision: public string RequireBehavior; with [Key(4)] unchanged;
comparisons become b.GetType().Name == _data.RequireBehavior; the importer
writes Type.GetType(stored)?.Name ?? "". TypeFormatterResolver.cs is
deleted. Rejected: the union tag (opaque, bound to MessagePack-C#) and any
CLR-qualified name.
Q4. Do CultNet or CultMesh depend on replication, declared-type schema, or exact-type watches?
No. One store per cache everywhere; no base-typed writes; every watch names a leaf. What they do use is in the audit (2.0) and named in the authority map.
- One store per cache:
CultCacheMessagePack.cs:119, 128;CultMesh.DocumentFromStore(CultMesh.cs:1588-1603);CultNetLocal.cs:146; the Studio by reflection (CultCacheStudioWindow.cs:688); Aquarium (AquariumCultStateStore.cs:24-26); AquaSynth, Ymir, Mimir, Gjallar throughOpenAsync/Create. Test pairs (BackingStoreTests.cs:27/40, 67/76, 822/825, 856/864, 909/915, 1501/1509;CultMeshStreamingTests.cs:2402-2475, 2634/2643, 2688/2697) are two caches on one file.CultNetLocal.cs:148readsBackingStores; it stays. - Declared-type schema:
CND:875, 913take the descriptor fromGetRequired<T>().[P3]:PutAsync<Gear>(key, new Weapon())persists theGearschema, publishes aGearschema id, keeps aWeaponin memory, and reloads asGear.PublishCacheUpdate(CND:1214-1215),CultNetDocumentRegistry.cs:327,CultNetDatabaseServer.cs:391-398,CultNetDatabaseSubscriptionServer.cs:504-513already usedocument.GetType().CultMesh.cs:3515-3538converts to the stored CLR type beforePutAsync<storedType>. No caller passes a base type or interface. - Exact-type watches:
CND:1134-1140is CultNet's own exact match; callers name leaves (CultMeshGameSession.cs:155,Server.cs:490-733, AquaSynth, Brokkr).CultMesh.Collection<T>(CultMesh.cs:2289-2290) snapshots with the assignableGetAlland streams with the exactWatch; after Cut 3 both are assignable.CultNetDatabase.Watch<T>stays exact. - Transactions:
CultCache.ExecuteTransactionAsync's only non-test caller isCultNetDatabase.ExecuteTransactionAsync(CND:534), whose only callers are tests;RequireTransactionsForAuthoritativeWritesis tests-only.[P2-B]shows the single-store rule. The CultNet wrapper goes in Cut 2; the cache primitive is replaced by the explicit batchCommitin Cut 3 (2.2), because atomic multi-record commit is a capability the operator keeps. - Globals: nothing in
CultLib\srcor any consumer callsGetGlobal<T>(definition atCC:1765;CultNetDatabase.WatchGlobal<T>atCND:1162). AquaSynth declares[CultGlobal]types (AquaSynthDaemonService.cs:295,AquaSynthCultNetDaemon.cs:20,CultCachePatchDocument.cs:8) and opens throughCreate/OpenAsync, so today those get invented defaults; how it reads them back is determined in Cut 3's Soul step. - The Studio reaches the cache by string reflection (types
CultCache,CultCacheOpenOptions,CultCacheMessagePack,CultRecordKey,CultRecordRef<>; membersPullOnOpen,OpenAsync,IsDirty,Registry,AllDescriptors,GetRequired(Type),AllStoredDocuments,UpsertAsync(Type, object, CultRecordKey?),Remove(CultRecordKey),FlushAsync(bool), and descriptor/catalog members). Cut 6 replaces the reflection with a compile-time reference, so nothing is frozen for it; the Studio package moves in lockstep in the same release (Cut 7). - At the evidence base the GameCult generator discovered members on the
declaring type only and had no
[Union]handling. Cut 4 deleted it, so Aetheria's Unity and headless builds share the reflective registry and no longer depend on whether a generator runs. Re-pin follow-up for Delvehold: remove the generatorProjectReferences inDelvehold.WorldHost.csproj:13andDelvehold.Protocol.csproj:11, and stopDirectory.Build.props:8preferring the staleCultLib-aetheria-authorityworktree; it builds today only because of that preference.
Q5. Can existing stores hold records written under a declared parent schema?
No consumer writes one; the fix changes no existing bytes.
- Aquarium:
AddAsync(state, new CultRecordHandle<T>(key)), concreteT(AquariumCultStateStore.cs:82-83, 95-96). Ymir: four concreteUpsertAsync(YmirServicePublicationDocument.cs:169-177,YmirWorldStateDocument.cs:255). Delvehold, AquaSynth, Mimir, Gjallar: grepped in Cut 3's Soul step for a base-typedT(none expected; the sweep found none). [P2-E]: today the payload under theGearschema id already hasWeapon's two slots.CreateStoredDocument(typeof(T), ...)atCC:1632, 1641becomesdocument.GetType(). The new loud failure: a runtime type without[CultDocument]throws fromGetRequired(CC:493-498).
Q6. Which consumers pin which revision, and what is the release order?
| Consumer | Takes CultLib by | Pin | Affected |
|---|---|---|---|
| Aquarium | .NET sibling checkout, unpinned (Aquarium.Epiphany.csproj:14-15) |
none | Compiles against main at once; new CultCache(), AddAsync, GetByName, PullAllBackingStoresAsync all kept |
| Ymir | .NET sibling, unpinned (Ymir.Core.csproj:4-14) |
none | OpenAsync with UseDirectoryStore, StoreFlushOnDispose, UpsertAsync kept |
| AquaSynth | .NET sibling | none found | Create, OpenAsync, [CultGlobal] types, UseDirectoryStore kept; invented globals stop |
| Mimir | .NET sibling | none found | OpenAsync, snapshot/catalog types, GeneratedPayloadSerializer, FlushAsync(soft: true) via CultMesh kept |
| Gjallar | .NET sibling | none found | Create, FlushAllBackingStores, FlushOnDispose, StoreFlushOnDispose kept |
| Brokkr, Eve, EveUnity, EvePlugins | Unity package / sibling | various | Watch<T> via CultMesh, new CultCache(registry), FlushAsync(soft: true) via CultMesh kept |
| Delvehold | .NET sibling with a revision guard | 334e60f, 52 behind |
Not until it re-pins; Registry, FlushOnDispose, generator kept |
| Heimdall | submodule, TS only | b6b1d9c |
CultLib\packages\cultcache-ts mirror deletion (Cut 5) on next bump; it attaches one store |
| Idunn, Epiphany, Odin, Ghostlight, Muninn, Ratatoskr, CodexConnector | Cargo by commit | various | CultLib\packages\cultcache-rs mirror deletion (Cut 5) on re-pin; all use add_generic_backing_store once |
| Huginn, Sai, Stonks, Vili | npm sibling paths | none | as Heimdall, immediately |
| Aetheria | nothing yet | n/a | the consumer this cut serves |
Release mechanics: unity\org.gamecult.cultlib\package.json is at 1.0.56
with committed DLLs; newest tag cultlib-unity-v1.0.46 (1fc68a4); install
docs stale (docs\nuget-packaging.md:22, package README :15). The Studio is
org.gamecult.caching.unity 1.0.0 at src\GameCult.Unity\Assets\Caching,
untagged, with no dependency on the runtime package (hence its reflection).
publish-packages.yml publishes npm and PyPI on tags only.
Order: CultLib main (Cuts 1-6) -> Cut 7 tags cultlib-unity-v1.0.57,
caching-unity-v1.1.0, cultcache-ts-v0.14.0, cultcache-py-v0.3.0 ->
Aetheria (Cuts 8-10). Aquarium, Ymir, AquaSynth, Mimir, Gjallar are built in
Cut 2's and Cut 3's Soul steps because they track main.
Q7. Where do Aetheria's world types fall, and where are the save points?
Facts from the data [P5]: GameData\AetherDB.msgpack holds 167 records in
ten tags (0:13, 1:51, 2:25, 3:3, 13:12, 17:3, 29:4, 30:1, 31:18, 32:37) plus
12 name files (tag 9, three slots). The root union declares 30 tags
(DatabaseEntry.cs:23-54); tags 4, 5, 6, 14, 20 name classes that are not
DatabaseEntry subclasses; tags 8 (GalaxyMapLayerData) and 11 (PlayerData)
have no records and no live reader, and both types are deleted;
ConsumableItemData (ItemData.cs:348) and PatrolOrbitsTask are subclasses
with no tag. Agent tasks are not persisted (Zone.Agents, Zone.cs:35, is
absent from ZonePack) and this migration adds no persistence. Action-bar
bindings index into the run's entity (SavedGame.cs:111-118), so they are Run
state.
| Type | Store | Kind | Why |
|---|---|---|---|
| ItemData tree: SimpleCommodityData, CompoundCommodityData, GearData, HullData, CargoBayData, DockingBayData, WeaponItemData, ConsumableItemData | Catalog | document | ItemInstance.Data, FactionProductData.Design, Faction.BossHull, WeaponData.AmmoType |
| Faction | Catalog | document | ItemData.Manufacturer, EntityPack.Faction, SavedGame.Factions, Faction.Allegiance keys |
| FactionProductData | Catalog | document | ItemInstance.Product (ItemInstance.cs:49) |
| PersonalityAttribute | Catalog | document | keys in Faction.Personality, CompoundCommodityData.DemandProfile |
| NameFile | Catalog | document | Faction.GeonameFile (Corporations.cs:40), Galaxy.cs:338 |
| BehaviorData tree, WeaponData, ItemRole | inside item design | value | EquippableItemData.Behaviors (ItemData.cs:351) |
| OrbitData | Run | document | BodyData.Orbit, OrbitData.Parent, OrbitalEntityPack.Orbit, MoveTo.Orbit; created at runtime (Zone.cs:120, 265) |
| BodyData tree: PlanetData, GasGiantData, SunData, AsteroidBeltData | Run | document | Mining.Asteroids, Survey.Planets, MiningToolData.AsteroidBelt, Zone.Planets keys |
| SavedZone (with ZonePack) | Run | document | one per zone; List<CultRecordRef<OrbitData>>, List<CultRecordRef<BodyData>> |
| SavedGame | Run | [CultGlobal] |
run root: factions, home/boss zones, current zone, action-bar bindings |
| EntityPack tree, ItemInstance tree, PersistentBehaviorData, SavedActionBarBinding | inside SavedZone / SavedGame | value | no identity |
| AgentTask tree | not persisted | value owned by Agent |
not saved today |
| Entity, Ship, OrbitalEntity, Zone, Galaxy | live simulation | not records | tags 14 and 20 deleted |
| PlayerSettings | Player | [CultGlobal] |
name, tutorial flag, credits |
| InputLayout | Catalog | document keyed by layout name | authored keyboard geometry; player rebinds live in PlayerSettings (Q9-1 A); imported by Cut 9 from GameData\KeyboardLayouts |
| Loadout | Catalog | document named by [CultName], key loadout:<name> |
authored ship preset: item designs only (a design ref per hull cell, no manufacturer); captured in the editor; Loadouts.Materialize builds them, and no spawner calls it yet |
Save points at Aetheria 20db3a93 (Gameplay\ActionGameManager.cs unless noted):
- Player settings:
SavePlayerSettings(:70-73) writesGameData\PlayerSettings.msgpack. That file embeds the run asSavedRun(PlayerSettings.cs:11). - Run:
SaveState(:234-243) buildsSavedGame(CultCache, …), which upserts a freshSavedZoneper zone (SavedGame.cs:69).- Unity opens only the catalog (
:52), so this and zone generation (ZoneGenerator.cs:99, 108, 200-201) throw.
- Unity opens only the catalog (
- Triggers:
- quit (
:232) and wormhole arrival (:605); - death (
Die,:1059, which leavesSavedRunin the file); - settings Back (
UI\MainMenu.cs:236); - new game (
MainMenu.cs:138, 167, which setsSavedRun = null).
- quit (
- Loadouts:
SaveLoadout(:227-230) is live fromInventoryPanel.cs:170-174but throws, because_loadoutPathis never assigned. Restore (InventoryPanel.cs:176-195) never appears, becauseLoadoutsis never filled. - Other writers:
SaveZone(:1087-1088) has no caller.InputDisplayLayout.SaveLayout(:494-499) is reached only from the uncalledAssociateInputKeys.
- Loads:
- catalog
:46-56; - settings
:58-67; - resume
MainMenu.cs:96-106, throughGalaxy(CultCache, SavedGame, ...)(Galaxy.cs:48-92); - layouts
InputDisplayLayout.cs:88-90.
- catalog
After Cut 10, every runtime write is a single-store Commit on one cache that
holds catalog, run and player stores from first access:
RunSave.Commitsaves the run at wormhole arrival and quit, with stableSavedZonekeys.RunSave.Cleardeletes every run record at New Game and at death.- The settings getter creates
PlayerSettingson first launch, andSavePlayerSettingscommits it. Loadouts.Savewrites loadouts to the player store, andLoadouts.Materializebuilds them against the current galaxy.- The keyboard layout is read from the catalog.
- Nothing reopens or deletes a store file.
Q8. How do identity comparisons survive without DatabaseEntry.ID?
Documents are singleton instances per cache and identity is the record key; reference equality replaces ID equality, keys replace stored Guids.
- The only
Equals/GetHashCodeoverride isDatabaseEntry.cs:60-69; it goes with the class. - One instance per key (
CC:1274,:1710-1719), so the seven dictionaries keyed byFaction/OrbitData(Galaxy.cs:18, 19, 28, 34;ZoneGenerator.cs:97, 243;UI\Menu\SectorMap.cs:51) work with the default comparer; saves embed references, not copies. - The 14
.ID ==comparisons (Entity.cs:291, 304, 319;LoadoutGenerator.cs:159, 161;Narrative\ZoneConstraints.cs:37, 52;Zone.cs:316;UI\Menu\SectorRenderer.cs:65;TradeMenu.cs:292, 300;TradeMenuDebug.cs:275, 283) become reference orCultRecordRef.Keycomparisons. - Guid-keyed runtime dictionaries (
Zone.cs:59-77, 122, 265;Zone Display\ZoneRenderer.cs:342-413;ItemsOfTypeEntity.cs:331, 334, 1332, 1489-1589;TradeMenu*.cs) key byCultRecordKey. The twoDatabaseLink<T>fields (ItemInstance.cs:26,SavedGame.cs:118) and every rawGuidreference becomeCultRecordRef<T>;Dictionary<Guid, float>becomesDictionary<CultRecordRef<T>, float>(string-keyed map on the wire, deserializable under Cut 4's security[P5]). - Saves storing faction Guids (
SavedGame.cs:56-73,EntitySerializer.cs:43) storeCultRecordRef<Faction>. - The key of a document in hand comes from
CultCache.TryGetHandle(CC:1699, kept: CultNet uses it). The fourDatabaseLinkBase.Cachewriters go with the static;ItemManager.GetData(ItemManager.cs:62-75) is the single resolution path.ZoneGenerator.cs:164uses the first eight characters of the key.
Catalog keys carry the legacy Guid in D format (slot 0 is a 16-byte bin
[P5]). Run and Player keys are cache-minted (N, CC:2200).
2. CultLib authority map
2.0 Subtraction audit and target shape
Measured: GameCult.Caching + GameCult.Caching.MessagePack are 5,259 lines,
870 of them /// lines restating member names (CC 461 of 2,704;
CultDocumentContracts.cs 87/192; CultGeneratedDocumentMetadata.cs 93/308;
CultManagedDocument.cs 78/415; CultCacheMessagePack.cs 43/134;
CultDocumentMessagePackSerialization.cs 69/475; DMS 30/973).
GetAwaiter().GetResult() appears at CC:1432, 1433, 2184: the store
subscriptions and the global materializer, all on the deletion line.
GenerateDocumentationFile is on (src\Directory.Build.props:6) with no
NoWarn, so the comment removal adds <NoWarn>$(NoWarn);CS1591</NoWarn> to
the two Caching projects.
| Surface | Consumers | Verdict |
|---|---|---|
MaterializeMissingGlobals, CultCache(registry, bool) |
CultCacheMessagePack.cs:105 only |
delete (2.1) |
CultCacheOpenOptions.ConfigureCache, ConfigureStore, DirectoryStorePath, ConfigureDirectoryStore, DirectoryStoreHydrationFilter |
none (DirectoryStoreHydrationFilter tests only) |
delete |
FlushBackingStore(store), PrepareForReloadOrShutdown[Async] |
none | delete; FlushAsync writes every dirty store |
TryGet< |
AquaSynth (CultCachePatchDocument.cs:104), missed by the first audit |
keep |
TryGetByName, TryGetByIndex, Resolve< |
none | delete |
CultCache.Logger, store Logger, NullLogger use |
none | delete |
store FlushOnDispose |
none directly; CultCacheOpenOptions.StoreFlushOnDispose (Gjallar, Ymir, Delvehold) sets it |
keep both; collapsing the two flush-on-dispose flags is a follow-up |
store HydrationFilter, PullSelected, PullBackingStoreRecordsAsync, CultPersistedRecordMetadata |
tests only | delete |
soft flag on FlushAsync/FlushAllBackingStores/PushAll/CommitBatch |
no store reads it (CC:2638, DMS:360); Mimir (EveDashboard:900, CultMeshMedia:422) and Brokkr (BrokkrCultMeshMirror.cs:68-124) pass soft: true through CultMesh.FlushAsync/CultNetLocal.FlushAsync |
delete from Caching; CultMesh.FlushAsync(bool) and CultNetLocal.FlushAsync(bool) keep their parameter and stop forwarding it. Removing it there and at the four external call sites is a named follow-up |
SoA: Soa<T>, CultSoaTable, CultSoaColumn, CultCacheSoaStore, CultCacheSoaTypeTable, CultCacheSoaMember (CultManagedDocument.cs:136-414), _soa hooks in CC |
tests only | park, not delete: built for a stated reason (ECS-style structure-of-arrays columns over cached documents, performance without compromising document ergonomics). Cut 2 step 1 tags the last commit holding it as parked/cultcache-soa before removal, adds docs\parked-features.md, and amends docs\runtime-parity-scope.md:23-27, 33 to say the SoA table is parked at that tag |
Document<T>, CultManagedDocument<T>, CultNetDatabase.Document<T> |
tests only | removed from the live cache; CultManagedDocument<T> is parked with SoA at parked/cultcache-soa (docs\parked-features.md, CultLib 1982d73) |
Transactions: ExecuteTransactionAsync (both), CultCacheTransaction, CommitTransaction, VisibleStoredDocuments, _ambientTransaction, _transactionGate, CacheBackingStore.CommitBatch (+ DMS:308-351), CultNetDatabase.ExecuteTransactionAsync (CND:519-555), RequireTransactionsForAuthoritativeWrites (CND:305), EnsureAuthoritativeTransaction (CND:1791-1796), AfterCommit (CND:898-901) |
tests only in C#. Siblings: TS has no batch; Python has put_envelopes (CultLib\packages\cultcache-py\src\cultcache_py\cache.py:227-251, one document type per call, push_all, no rollback) used by CultLib\packages\cultnet-py\src\cultnet_py\replication.py:98; Rust has a cache-level put_prepared_batch (CultLib\packages\cultcache-rs\src\lib.rs:2162-2201: one store per batch, all-or-nothing push_all) with no caller, and a store-level batch family (compare_and_swap_batch, compare_exchange, compare_exchange_snapshot, delete_batch_if_unchanged, CultLib\packages\cultcache-rs\src\lib.rs:397-800, 8f29ee5) consumed by Odin (12 sites), Idunn (31), CodexConnector (1) and Ghostlight (ghostlight-dungeon\src\app_session.rs:119, 371, plus tests): every one passes an explicit batch value; none relies on ambient in-flight visibility. Operator: atomic multi-record commit is a desired capability |
replace, not delete: the ambient AsyncLocal overlay, the SemaphoreSlim gate, CultCacheTransaction, CommitTransaction and VisibleStoredDocuments (~230 lines) go in Cut 3 in the same commit that lands Commit(Action<CultCacheBatch>) (2.2); CacheBackingStore.CommitBatch and DMS:308-351 stay as the store side. CultNetDatabase.ExecuteTransactionAsync, RequireTransactionsForAuthoritativeWrites, EnsureAuthoritativeTransaction, AfterCommit are deleted (tests only; CultNet callers use PutAsync). cultcache-persistence-format.md:42-55 is amended to the explicit-batch shape, not retracted |
Directory store legacy formats cultcache.store.v2.directory-indexed, v3.directory-immutable-pages, v1 inline records: LoadLegacyRecords, _legacyInlineRecords, LegacyRecordPath, MetadataRecordPath, _needsIndexUpgrade, _manifestUsesMetadataPages |
no store on disk anywhere scanned uses them; only v4 is written | delete; a v2/v3 manifest is refused with its format string |
Directory store ReadStageProbe, FlushStageProbe, stage constants, ReadPersistedGeneration |
tests only | delete, with the tests that inject through them |
Directory store itself, AcquireCommitLease, UseDirectoryStore, DefaultRecordDirectoryPath |
Ymir (YmirWorldStateDocument.cs:248, 267, YmirServicePublicationDocument.cs:161), AquaSynth (IpaTrialResults.cs:190) |
keep (v4 read/write and the lease) |
Schema migration: LastSchemaMigrationReports, CultSchemaMigrationReport/Warning/Kind, ResolvePersistedSchemaReport |
tests only | keep: the contract (cultcache-schema-compatibility.md:40-45) promises the typed report and soft migration must not be silent |
GetStoredDocuments< |
tests only | delete (fold into GetAll<T>) |
GetGlobal<T> |
tests only (BackingStoreTests.cs:342, 358, 365); Aetheria uses it in Cut 10 |
keep |
FlushAttachedStoresOnDispose |
via CultCacheOpenOptions.FlushOnDispose (Gjallar, Ymir, Delvehold) |
keep |
LastSuccessfulFlushAtUtc (cache and store) |
tests only | delete |
store EntryAdded/Updated/Deleted subjects |
cache only | replace with one internal callback set at attach; the three Subjects go |
CultCacheMessagePack.Create |
AquaSynth (AquaSynthDaemonService.cs:923, CultCachePatchDocument.cs:90), Gjallar (VerseState.cs:35) |
keep as the synchronous open; OpenAsync (Mimir, AquaSynth, Ymir, CultNetLocal, Studio) returns Task.FromResult(Create(...)) |
CultCacheOpenOptions.PullOnOpen |
Studio by reflection (:687); external setters found in Cut 2: AquaSynth (CultCachePatchDocument.cs:92 and AquaSynthDaemonService.cs:923 set false; IpaTrialResults.cs:189, SpeechDistributedTraining.cs:262 pass File.Exists-style values; a test sets true) and Mimir (BufferSmoke\Program.cs:1943, 3691, 3990, 4066, 7622) |
kept through Cut 2. false means "write this file without loading it", which attach-is-hydration cannot express: Cut 3 must decide how a consumer overwrites a store (open Cut 3 item, 2.2) and migrate these call sites or keep an explicit overwrite option |
OnUpdate |
CND:494, 1202 |
keep |
Watch<T>, WatchRecord<T> |
CultMesh.cs:2290, 2317, 2348, 1527 |
keep; assignable |
TryGetHandle, AllEntries, AllStoredDocuments, BackingStores, GetByIndex<, Get(key), Remove(CultRecordKey), Remove<T>, UpsertAsync<T>, UpsertAsync(Type,...), AddAsync<T>, GetAll<, Get<, GetByName<, IsDirty, Dispose, FlushAllBackingStores, FlushAsync, PullAllBackingStoresAsync |
CultNet/CultMesh, Aquarium, Gjallar, Ymir, Studio | keep |
CultDocumentRegistry.Shared/ForTypes/GetRequired/GetRequiredBySchemaId/AllDescriptors, descriptor SchemaId/SchemaName/ToCatalogEntry/GeneratedPayloadSerializer, CultRecordHandle<, [CultName], [CultGlobal], [CultIndex] |
Mimir, Delvehold, AquaSynth, CultNet | keep |
SerializeSnapshot/DeserializeSnapshot, CultPersistedStoreSnapshot/Record, CultSchemaCatalogEntry, SerializeUntyped/DeserializeUntyped, Serialize</Deserialize<, SerializePersistedRecord/DeserializePersistedRecord (DMS:112, 415, 522, 869) |
CultMesh, Mimir, directory store | keep |
SerializeSchemaCatalog/DeserializeSchemaCatalog |
tests only | delete |
Generated metadata provider types, GameCult.Caching.MessagePack.Analyzers (empty Class1.cs packaging host) |
generator output; the host spreads the analyzer to every MessagePack consumer (Networking, Delvehold, two test projects) | keep this cut; packaging the analyzer without an empty project is a follow-up |
/// lines restating names |
none | delete in every file a cut touches (CC, CultManagedDocument.cs, CultCacheMessagePack.cs, CultDocumentMessagePackSerialization.cs, DMS); the two contracts files are the documentation |
Target shape after Cuts 2-4 (the original Aetheria\...\CultCache.cs is
437 lines for a cache, routing, an inheritance-aware index and six stores;
this is what the cache half of CultCache.cs should read like; the "about 900
lines including the registry" figure was wrong: the registry and schema half
alone is 1,057 lines and is not reshaped by this migration (Cut 3 measured the
cache half at 1,025 lines after adding routing and commit). Original sketch,
at about 900 lines including the
registry):
public sealed class CultCache : IDisposable
{
readonly CultDocumentRegistry _registry;
readonly List<(CacheBackingStore Store, Type[] Homes)> _stores = new();
readonly Dictionary<string, CultStoredDocument> _entries = new(StringComparer.Ordinal);
readonly Dictionary<Type, Dictionary<string, string>> _names = new();
readonly Dictionary<(Type, string), Dictionary<string, string>> _indexes = new();
readonly Dictionary<Type, string> _globals = new();
readonly ConditionalWeakTable<object, CultRecordKeyBox> _handles = new();
readonly Subject<Change> _changes = new(); // Change: (Kind, Key, Descriptor, Document, Previous)
readonly object _gate = new();
bool _dirtyInMemory; // only meaningful with zero stores
public CultCache(CultDocumentRegistry? registry = null)
public void AddBackingStore(CacheBackingStore store, params Type[] homes) // attach = hydrate
public Task PullAllBackingStoresAsync() // re-pull
public void FlushAllBackingStores() / public Task FlushAsync() // every dirty writable store
public Task<CultRecordHandle<T>> AddAsync<T>(T doc, CultRecordHandle<T>? handle = null) // = UpsertAsync
public Task<CultRecordHandle<T>> UpsertAsync<T>(T doc, CultRecordHandle<T>? handle = null)
public Task<CultRecordKey> UpsertAsync(Type type, object doc, CultRecordKey? key = null)
public object? Get(CultRecordKey key); T? Get<T>(CultRecordKey key); IEnumerable<T> GetAll<T>()
public T? GetGlobal<T>(); T? GetByName<T>(string name); T? GetByIndex<T>(string alias, string value)
public bool Remove(CultRecordKey key); void Remove<T>(CultRecordHandle<T> handle)
public Observable<CultCacheDocumentChange<T>> Watch<T>(); WatchRecord<T>(CultRecordKey key)
public CultRecordHandle<T>? TryGetHandle<T>(T doc)
public bool IsDirty; IReadOnlyList<CacheBackingStore> BackingStores; CultDocumentRegistry Registry
public IEnumerable<object> AllEntries; IEnumerable<CultStoredDocument> AllStoredDocuments
public bool FlushAttachedStoresOnDispose; event Action<object?, object?>? OnUpdate
public void Commit(Action<CultCacheBatch> stage) // atomic multi-record commit on one home store
public void Dispose()
CacheBackingStore? Home(Type type) // most specific routed store, else the untyped one, else null
void Admit(CultStoredDocument stored, CacheBackingStore? source, bool durable) // every add: write, batch, or load
void Evict(CultStoredDocument stored, CacheBackingStore? source, bool durable) // every remove
}
public sealed class CultCacheBatch // an explicit value; nothing is visible until Commit returns
{
public CultRecordHandle<T> Upsert<T>(T document, CultRecordHandle<T>? handle = null)
public CultRecordKey Upsert(Type type, object document, CultRecordKey? key = null)
public void Remove(CultRecordKey key)
public void Expect(CultRecordKey key, object? current) // current = the instance this cache holds at key, or null = must be absent
public void ExpectUnchanged() // the home store's persisted content equals what this cache last loaded
}
public enum CultCommitOutcome { Committed, Mismatch, Contended }
// on CultCache:
public bool Commit(Action<CultCacheBatch> stage) // false = a condition failed: no write, no memory change, no notification
public CultCommitOutcome TryCommit(Action<CultCacheBatch> stage) // one non-blocking lock attempt; otherwise identical
public abstract class CacheBackingStore : IDisposable
{
protected CacheBackingStore(bool readOnly = false)
public bool IsReadOnly { get; } public bool IsDirty { get; protected set; } public bool FlushOnDispose { get; set; }
public IReadOnlyList<CultSchemaMigrationReport> LastSchemaMigrationReports
internal Action<CultStoredDocument> Loaded, Unloaded; // set by the cache at attach
public abstract void PullAll(); public abstract void Push(CultStoredDocument e); public abstract void Delete(CultStoredDocument e); public abstract void PushAll();
public abstract CultCommitOutcome CommitBatch(CultCommitRequest request, bool wait); // one durable step under the store's lock
}
public sealed class CultCommitRequest // built by Commit from the batch; identities are (schemaId, storedAt) captured at stage time
{
IReadOnlyList<CultStoredDocument> Upserts; IReadOnlyList<CultStoredDocument> Deletes;
IReadOnlyList<(CultRecordKey Key, string? SchemaId, string? StoredAt)> Expected; // null pair = must be absent
bool ExpectUnchanged;
}
Task-returning members stay Task-returning because CultNet, Aquarium, Ymir
and the Studio await them, but nothing inside awaits: they return
Task.FromResult/Task.CompletedTask and there is no async keyword in
CultCache.cs. The SemaphoreSlim, the AsyncLocal, and the _stateGate
lock collapse into _gate; Commit takes a synchronous Action because no
consumer awaits inside a batch.
2.1 Global documents
What the legacy cache did. Aetheria\...\CultCache.cs:44-53 instantiates
every DatabaseEntry subclass carrying [GlobalSettings] in the constructor.
GlobalSettingsAttribute (Attributes.cs:4) is applied to no type (grep of
Assets\Scripts and tools finds only the declaration and the editor's global
list at DatabaseView.cs:118, 164). The loop runs over an empty set. Aetheria
has never had a persisted global; the mechanism hid that nobody owned when one
would exist.
What CultLib does. new CultCache() and Create instantiate a default for
every [CultGlobal] type (CC:1300-1316, 2155-2186); OpenAsync does it
after the pull (CultCacheMessagePack.cs:90). [P1]: with a [CultGlobal]
type registered, new CultCache() then attach then pull then flush destroys
the file's existing records (attach pushes the invented global, the dirty
single-file store skips its pull at CC:2572-2573, the flush writes only the
invention); the OpenAsync order leaves the file byte-identical. No consumer
reads a global back (Q4).
Inventory after the cut.
| Global | Store | Read by | Existence owned by | Missing at main menu | Missing at resume | Missing at new game |
|---|---|---|---|---|---|---|
PlayerSettings |
Player | MainMenu (name, tutorial flag), ActionGameManager (credits) |
boot: ActionGameManager.Awake after AetheriaStores.Open, when GetGlobal<PlayerSettings>() is null, upserts one and flushes (Cut 10) |
cannot happen after boot | same | same |
SavedGame |
Run | MainMenu (resume), Galaxy(CultCache, SavedGame, ...) |
new game: ActionGameManager.BeginRun() creates the run store and writes it; Die() deletes the run store (Cut 10) |
no run file: Resume hidden; run file without SavedGame: refuse to resume, log the key, New Game only |
as main menu | new game deletes any run store first |
| catalog globals | Catalog | none exist | authored data; catalog is read-only | AetheriaStores.Open throws naming every [CultGlobal] type routed to the catalog with no record |
same | same |
CultLib's role. [CultGlobal] means exactly: at most one record of the
type per cache, GetGlobal<T>() returns it or null, and a write without a
handle keys it global:{SchemaId} (ResolveKey, CC:2195-2198, kept). The
cache never creates one. Siblings already do this: TS enforces a single
__global__ record on put and pull (CultLib\packages\cultcache-ts\src\cult-cache.ts:394-399, 691-713) and invents nothing; Python likewise
(CultLib\packages\cultcache-py\src\cultcache_py\cache.py:125-128, 186-187); Rust has no
global concept. The C# key global:{schemaId} versus the siblings' __global__
is an existing divergence, recorded, not changed (it would change bytes).
- Owner: the consumer code path that begins the global's lifecycle, per global above.
- Inputs: the hydrated cache (
GetGlobal<T>() == null). - Outputs: one
UpsertAsyncon the home store. - Derived:
GetGlobal<T>on a cache with no stores and no upserts isnull. - Forbidden writers (deleted):
InitializeGlobals(CC:2155-2186),MaterializeMissingGlobals(CC:1313-1316), the two-argument constructor (CC:1300-1307), theinitializeGlobalsplumbing inCultCacheMessagePack.cs:75, 84, 90, 98, 105,ContainsDurableRecord(CC:2413-2416,DMS:277-281). - Singleton enforcement (new, matching TS/Python):
Admitthrows for a[CultGlobal]descriptor whose_globalsentry holds a different key, before any store is touched, on writes and on loads. - Migration: none needed functionally (no reader). Tests
BackingStoreTests.cs:342, 358, 365create the global withUpsertAsyncfirst. AquaSynth's[CultGlobal]types stop receiving invented defaults; Cut 3's Soul step reads how AquaSynth obtains them and reports. - Invariants: loading never writes; no state exists that its owner did not create.
2.2 Store routing, attachment, dirtiness, read-only stores
Owner. _stores and Home(Type): among routed entries with a Homes
type assignable from the document type, the one whose type is most derived;
else the untyped store; else null, which is an error for every write once
any store is attached (zero stores is an in-memory cache).
Attachment is hydration. AddBackingStore(store, params Type[] homes)
validates (IsDirty false; no second untyped store; no homes type already
claimed by exact equality; no admitted record would change home), sets
store.Loaded = e => Admit(e, store) and store.Unloaded = e => Evict(e, store),
appends to _stores, and calls store.PullAll(). There is no interval in
which a store is attached but unread. PullAllBackingStoresAsync remains as
re-pull (CultMesh.DocumentFromStore polls at CultMesh.cs:1603).
Overwriting a store (decided 2026-09-13, operator: option A). The consumer
owns replacing a store's contents: open (which hydrates), Remove every
record it does not intend to keep, upsert, flush. The flush writes the whole
snapshot through the atomic replace, so the old contents are replaced in one
step; no CultLib API is added. PullOnOpen is deleted in Cut 3. Call sites:
AquaSynth\src\AquaSynth.Core\CultCachePatchDocument.cs:90-98
(WriteDefaultAsync) and AquaSynth\src\AquaSynth.Faust\AquaSynthDaemonService.cs:923
(WriteReceiptAsync) both write a single-document file and adopt the remove-all
form; today Create never pulls, so their PullOnOpen = false was already a
no-op. The File.Exists-style setters (IpaTrialResults.cs:175-189,
SpeechDistributedTraining.cs:262, Mimir BufferSmoke\Program.cs:1943, 3691, 3990, 4066, 7622) and the AquaSynth test's PullOnOpen = true just drop the
property, since hydrating a missing file is empty.
A record's home cannot change after admission. Because Home is computed
from the stores attached so far, attaching an untyped store first and a typed
store later would move the home of every admitted record of the typed store's
types, leaving a stale copy in the untyped file and a refusal on the next
reload. So the last validation in AddBackingStore is: for every distinct
Descriptor.DocumentType in _entries, Home(type) computed with the
candidate included must equal Home(type) computed without it; otherwise
throw InvalidOperationException("Attaching {store} would move {schema} from {oldHome} to {newHome}; attach routed stores before the untyped store."). This
is one loop at attach time and no new surface; the consequence is the
attach-order rule callers already want: routed stores first, the untyped store
(if any) last. AetheriaStores.Open attaches three routed stores and no
untyped store, so the check never fires there; OpenAsync attaches exactly
one untyped store to an empty cache.
Inputs. document.GetType() (always the runtime type); _stores; each
store's IsReadOnly.
Outputs. Exactly one store.Push or store.Delete per mutation, on the
home store, before _entries changes.
Derived state.
IsDirtyis_stores.Any(s => s.Store.IsDirty)when stores exist, else_dirtyInMemory.RecomputeDirtyState(CC:2279-2284) and the three_hasUnflushedMutations = _backingStores.Any(...)lines (CC:1459, 1484, 1991) go.- A store's
IsDirtyderives from its ownPush/Delete;PullAllsets it false (CC:2614;DMS:224).[P2-A]shows loading writing today. _globals,_names,_indexesstay keyed by concrete type;GetGlobal<T>,GetByName<T>,GetByIndex<T>enumerate keys assignable toT(0 ->null; 1 ->Get; >1 -> throw naming the candidates).[P2-D]shows all three exact today.Watch<T>()is_changes.Where(c => typeof(T).IsAssignableFrom(c.Descriptor.DocumentType)).Select(c => new CultCacheDocumentChange<T>(c.Kind, c.Key, (T?)c.Document, (T?)c.Previous));PublishChange'sActivator.CreateInstance(CC:2286-2301) goes.[P2-D]showsWatch<Base>receives nothing today.
Concurrency and commit semantics (Soul, Cut 3; operator decisions 2026-09-13, all option A).
- Lock order is the cache gate, then the store lock, on every path: attach, pull, write, flush, commit. A store's I/O blocks that cache's readers; no finer-grained locking. (Cut 3 as first landed took them in both orders and deadlocked a directory-store pull against an upsert, and a re-pull could erase a staged single-file write.)
- An unconditional
Commitbehaves exactly like a flush of its home store, and aCommitalso persists earlier staged writes to that store and clears dirty. Per store type (operator decision 2026-09-13, option A): a single-file store writes the cache's snapshot, last-writer-wins; a directory store lands its changed pages onto the current manifest under the commit lease, so other writers' records survive (the merge its page layout and lease were built for, asserted byDirectoryMessagePackBackingStore_ConcurrentInstances_MergeUnderOneCommitLeaseand relied on by Ymir and AquaSynth). Only conditional commits (Expect,ExpectUnchanged) protect against a concurrent change to the same records. - An attached store uses its cache's gate as its own lock
(
CacheBackingStore.Gate, Cut 3 fix5aad137), so cache and store locks cannot be taken out of order. The cache also takes the gate around each store's pull, which covers third-party stores that do not lock it themselves. - Observers never run under the gate (Soul, Cut 3 second pass):
Watchobservers andOnUpdateare published after the outermost gate exit on every path, because a subscriber that blocks on another thread which reads the cache would otherwise deadlock. A store adopts its loaded view before anything is published, so a throwing handler cannot leave the store holding records the cache dropped. - Each call publishes only the changes it admitted, on its own thread, after
the gate is released and before it returns (CultLib
544c087). OnlyOnUpdateexceptions reach the caller;Watchsubscriber exceptions follow R3's unhandled-exception handling. - Order is data, not scheduling (operator decision 2026-09-13). The cache
does not schedule delivery. Every admitted change gets the next value of a
per-cache, in-memory sequence under the gate that admits it, and each
published change carries it (
Sequence). Cross-thread delivery order is not guaranteed; a consumer that keeps a latest value drops a change whose sequence is lower than the one it applied (CultMesh.WatchRecordintoApplyCanonicalSnapshot). Rejected: save-order delivery with tickets and turn waits (CultLibbcae483, deleted), which made the cache a delivery scheduler, deadlocked againstCultNetDatabaseSubscriptionServer's_lifecycleGate, and could stall a cache on an interrupted wait; and a non-blocking delivery queue, which kept the same authority in the cache. Cross-process order stays withStoredAtand conditional commit. - Latest-value consumers subscribe first, then take the cache's one sequenced
read (document and current sequence under the gate) and ignore any change at
or below that sequence (operator decision 2026-09-13; Soul found CultMesh
mirrors' snapshot reads carried no sequence).
OnUpdateand the streams CultNet derives from it carry no sequence and are not order-protected; schema-alias handles and removals are not stale-protected. Both are documented, not fixed here. - Follow-ups outside this migration (found while landing the sequence, CultLib
4562340; none introduced by it):CultNetDatabaseSubscriptionServer.ApplyProjectedChangekeeps a latest value per record fromCultNetDatabaseChange, which carries no sequence (it comes fromOnUpdate, whose(previous, current)signature cannot, or from database publishes after the cache call), so a stale change can overwrite a newer one; fixing it means publishing CultNet changes fromcache.WatchwithSequence. The same holds forCultNetDatabase.WatchRecordand Mesh handles over a database.RefreshAsyncon the Mesh mirrors writes its value without a sequence, andObserveAsyncreads before subscribing, so a change between the two is missed. - One key lives in one store: a write or load that would put a key already held from another store throws and changes nothing.
OnUpdatefires for loads only, as before the migration; writers publish their own changes.- A missing single-file store keeps staged writes dirty and does not drop loaded records.
- A store that fails to hydrate on open (corrupt, or an unregistered schema) throws and is never overwritten; consumers such as Gjallar and AquaSynth's writers surface the error rather than deleting and rewriting.
LateRouteOverAdmittedTypeThrows: the reverse-order fixture holds only unrouted types in the untyped store, since a routed type there is a foreign record.
Read-only stores. CacheBackingStore(bool readOnly = false),
IsReadOnly; SingleFileMessagePackBackingStore(string filePath, bool readOnly = false); DirectoryMessagePackBackingStore(string manifestPath, string? recordDirectory = null, bool readOnly = false);
CultCacheOpenOptions.ReadOnly. Push, Delete, PushAll on a read-only
store throw InvalidOperationException("Backing store {path} is read-only.");
FlushAllBackingStores skips them.
Admit and Evict (the shared path).
Admit(stored, source, durable):
home = Home(stored.Descriptor.DocumentType)
if source != null and home != source: throw "{schema} record {key} was loaded from {source} but its home is {home}"
if source == null:
if _stores.Count > 0 and home == null: throw "no home store for {schema}"
if home?.IsReadOnly: throw
if descriptor.IsGlobal and _globals has a different key: throw
if source == null and !durable: home?.Push(stored) // store first; a batch has already committed
lock _gate: replace entry, reindex, _dirtyInMemory |= (_stores.Count == 0 and source == null)
publish Change; OnUpdate
Evict mirrors it with Delete. AddAsync, UpsertAsync<T>,
UpsertAsync(Type, object), Remove are the one-record case (durable: false); the load path is the store's Loaded/Unloaded callbacks (source
set); a committed batch admits each record with durable: true. [P2-C]
shows the current order leaves a document in memory after the store refused
it.
Atomic commit. Commit(Action<CultCacheBatch> stage):
Commit(stage):
batch = new CultCacheBatch(_registry, _handles) // Upsert builds CultStoredDocuments now; Remove records keys
stage(batch)
homes = distinct Home(type) over batch.Upserts and the existing entries for batch.Removes
if homes.Count > 1: throw "batch spans {a} and {b}; a commit lands in one home store" // nothing touched
validate every upsert as Admit does (home present, not read-only, global singleton)
home?.CommitBatch(upserts, deletes) // one durable step, restores its staging on failure
lock _gate: Admit(each upsert, null, durable: true); Evict(each delete, null, durable: true)
publish one Change per record, after the store accepted
Conditional commit (compare-exchange). The seven Rust variants
(compare_and_swap_entry :397, insert_entry_if_absent :422,
compare_and_swap_batch :441, append_if_snapshot_unchanged :495,
compare_exchange :713, compare_exchange_snapshot :759,
try_compare_exchange_snapshot :770, all in
CultLib\packages\cultcache-rs\src\lib.rs, expectations as
CultCacheExpectedEnvelope :291) collapse to two conditions on the batch:
Expect(key, current):currentmust be the instance the cache holds atkey(looked up through_handles; anything else throws) ornullfor "must be absent". The batch captures the record's identity,(SchemaId, StoredAt)from_entries[key], at stage time. Only named keys are constrained, so unrelated concurrent writes do not lose the race (Rust's per-entry family).ExpectUnchanged(): the home store's persisted record set must equal what the cache last loaded from it, compared as the ordered list of(key, SchemaId, StoredAt)(Rust's snapshot family; fences unknown inserts).
Identity is (SchemaId, StoredAt) rather than payload bytes because the
cache does not retain bytes and the in-memory object may have been mutated
since it was observed; it is sound only if every write to a key mints a
StoredAt strictly later than the record it replaces, so Push,
CommitBatch and the batch builder bump a minted StoredAt by one tick when
it is not later than the existing record's ("O" has 100 ns resolution and
two writes can land in one tick; StoredAtIsStrictlyIncreasingPerKey in
Cut 3 is the proof, since [P7] produced no result). Commit returns false
when a condition fails: no store write, no in-memory change, no notification.
TryCommit makes one non-blocking lock attempt and reports Contended
instead of waiting (Idunn's try_ use); it is the same path with wait: false, about ten lines. A conditional commit on a store with staged
single-record writes (IsDirty) throws: that view is neither what was
observed nor what is being committed, so flush first.
Store side. Single-file store: a lock file beside the store
(<path>.lock, FileMode.OpenOrCreate, FileShare.None, retry every 10 ms
for 30 s when wait, one attempt when not), mirroring
DirectoryMessagePackBackingStore.AcquireCommitLease (DMS:928-949);
under it: re-read the file, evaluate Expected against the re-read records
and ExpectUnchanged against the fingerprint taken at the last PullAll
or successful commit, apply upserts and deletes, write temp then
File.Replace (CC:2659-2694 unchanged), refresh Entries and the
fingerprint, release. Plain PushAll takes the same lock so two processes
never interleave a write, but compares nothing: a plain flush is
last-writer-wins, and processes sharing a store must all use conditional
commit; the contract says so. Directory store: conditions are evaluated
under its existing AcquireCommitLease against the manifest re-read from
disk (_durableIndex identities are the same (SchemaId, StoredAt)),
ExpectUnchanged against the manifest's record set, then its existing
content-addressed pages and manifest write. The identity and the lock are
proven by Cut 3's ConditionalCommitTests.cs (stale Expect detected after
a concurrent write, unrelated writes ignored, Expect(null) as create-once,
ExpectUnchanged failing on an unrelated insert, two writers racing on one
file finishing at exactly 2N); the probe meant to pre-establish them [P7]
never produced a result.
Parity: Rust already has both families and a try_ (with_exclusive_lock
:700 uses fs2 on a lock file); TS and Python have neither and are recorded
in the contract as not implementing conditional commit. Whether Rust's
fs2 lock and C#'s FileShare.None open on the same lock file exclude each
other across runtimes on one file is not established here and is a named
follow-up; no store is shared across runtimes today.
The batch is an explicit value: reads during stage see committed state
only, matching every consumer with a batch primitive (Rust put_prepared_batch
requires one store per batch, CultLib\packages\cultcache-rs\src\lib.rs:2174-2186; Ghostlight and Odin pass
explicit compare_and_swap_batch/compare_exchange values, section 2.0). No
AsyncLocal, no ambient overlay. The store side is the existing
CacheBackingStore.CommitBatch (CC:2425-2452: stage, PushAll, restore on
failure; DMS:308-351: pages then manifest). For a zero-store cache the
batch admits in memory. Siblings: Rust already matches (one store per batch,
all-or-nothing); TS has no batch and Python's put_envelopes is per type and
not all-or-nothing across types; both are recorded in the contract as not yet
implementing the primitive, with no bytes at stake and no cut in this
migration.
Forbidden writers. The replication loops (CC:2097-2101, 2135-2139);
attach-time push (CC:1436-1439); typeof(T) at CC:1632, 1641;
CND:875, 913 taking the descriptor from T (they take
_cache.Registry.GetRequired(document.GetType())); SingleFileBackingStore.PullAll's
dirty early-return (CC:2572-2573) stays: attach-time pull always sees a
clean store, and re-pull must not erase staged mutations.
Named demotions. Replication is no longer an owner of durability. Attach-time
push is no longer an owner of a store's contents. _hasUnflushedMutations is
no longer an owner once a store exists. typeof(T) is no longer an owner of
schema. Exact DocumentType is no longer an owner of lookups or watches. The
cache is no longer an owner of any global's existence. The ambient
transaction is no longer an owner of visibility; a batch is a value and the
store's commit is the boundary.
2.3 Serialization options
Owner. The assembly that declares a document. [assembly: CultCacheFormatterResolver(typeof(R))] (AllowMultiple = true; R exposes
public static readonly IFormatterResolver Instance or a public parameterless
constructor). CultDocumentMessagePackSerialization.OptionsFor(Assembly)
builds and caches
Standard.WithResolver(CompositeResolver.Create(consumers..., CultDocumentResolver.Instance, StandardResolver.Instance)).WithSecurity(CultMessagePackSecurity.Instance)
per assembly; Options (static) stays as the base for assemblies declaring
nothing and for the store envelope.
Inputs. type.Assembly of the document. Outputs. one options instance
per assembly, used by SerializeUntyped/DeserializeUntyped
(CultDocumentMessagePackSerialization.cs:84-121) and by the generator's
emitted var options = ... (CultDocumentMessagePackGenerator.cs:290, 308,
which becomes OptionsFor(typeof(X).Assembly)).
Slot authority and generic documents (operator decisions 2026-09-13).
MessagePack's integer [Key] is the single slot authority for schema identity,
catalog, compatibility and serialization. GameCult.Caching references
MessagePack.Annotations directly and matches KeyAttribute and
IgnoreMemberAttribute by type instead of by name string: the core was once
meant to be serializer-independent, but .cc is canonically MessagePack, so
that indirection is dropped. A generic document's declared resolvers come only
from the document type's own assembly (typeof(Doc<X>).Assembly).
Generator and registry agreement (Soul, Cut 4). Old-versus-new consumer
probes found what the single agreement test missed: per-declaring-type accessor
names collide when two documents share a base with [CultName]/[CultIndex];
the generator read a base declaration where reflection read the override, which
changed ids and in one case bytes; duplicate slots (including new-hidden
members) went unchecked once MessagePack's analyzer stopped reaching consumers;
inherited private setters stopped compiling; and the typed
Serialize<T>/Deserialize<T> helpers bypassed per-assembly options. The fixes
name accessors per document, use the most-derived declaration in both paths,
reject duplicate slots and string keys with one message each, and route the
typed helpers through the untyped path, proven by a descriptor-equality sweep
across member shapes with a byte pin for overrides.
The generator is deleted (operator decision 2026-09-13). With .cc
canonically MessagePack, CultLib's source generator only duplicated the
reflective registry: every runtime read of its output already fell back to
reflection and MessagePackSerializer (Unity always ran that way), no consumer
builds AOT, IL2CPP or trimmed, no benchmark or commit shows a speed benefit, and
the duplication caused every Cut 4 defect below. The reflective
CultDocumentRegistry is the only descriptor authority and keeps every
rejection rule; payloads go through MessagePackSerializer with
OptionsFor(assembly). MessagePack's own generator stays contained. If an AOT
target ever appears, MessagePack's own AOT generator is the answer, not a
second copy of the rules. The generator member-discovery and sweep work below
is superseded; the rules it settled now live in the registry alone.
The first deletion attempt showed the fallback claim was incomplete: the
generated codec was the only writer for [CultDocument] types without
[MessagePackObject] (MessagePack's resolver refuses them), and the generator
named nested member types Outer.Inner where reflection uses Outer+Inner.
Operator decisions: every [CultDocument] must carry [MessagePackObject]
(the registry rejects one without it), and nested member type names keep
reflection's + form, after a scan confirms no persisted store holds the dot
form. Follow-ups: Delvehold drops its two analyzer references when it re-pins
CultLib; EveUnity's GenericWorldCaptureTests.cs:65 (both projects) moves
off the deleted Deserialize<T> when it re-pins.
Overrides (Cut 4 fix, CultLib 7c4bc2b). The "most-derived declaration"
rule proposed after Soul's review was wrong: MessagePack itself reads the base
declaration's attributes (an [IgnoreMember] override still serializes at the
base slot; a re-keyed override throws a duplicate key). Both the generator and
the registry therefore reject any override whose [Key] or [IgnoreMember]
differs from its base declaration, and accept overrides that repeat or omit
them, pinned against MessagePack's own bytes. Typed
Serialize<T>/Deserialize<T> are deleted rather than rerouted.
Follow-ups outside this migration: a global-namespace document type is named
<global namespace>.Type by the generator and Type by CultSchemaTypeNames,
so its schema id differs between builds (fixing it changes those ids); and the
generator emits typeof(Doc<T>) for generic document types, which does not
compile, so a generic document cannot live in an assembly that runs the
generator.
Security. CultMessagePackSecurity : MessagePackSecurity copies
UntrustedData and overrides GetHashCollisionResistantEqualityComparer<T>()
to return, for CultRecordRef<TDoc>, a comparer over Key.Value built from
GetEqualityComparer<string>() [P5].
Forbidden writers. No mutable static, no registration method, no first-use ordering rule.
3. Wire-parity plan
| Change | Bytes on disk or wire | Runtimes that change | Verified by |
|---|---|---|---|
| One home store per type; mirrors deleted | none; every routed file is a complete cultcache.store.v1 snapshot |
C# (Cut 3), TS, Rust, Python (Cut 5) | C# RoutedStoresWriteTheSameBytesAsSingleStores; the C# interop peer's write-routed mode writes catalog.cc and run.cc and the writer-by-reader loop in CultLib\packages\cultcache-ts\test\cult-cache.test.ts:536-617 reads both with TS, Rust and Python readers |
| Attach hydrates; loading never writes; read-only stores | none | C# only (sibling attach does not read; sibling pull does not write) | Cut 3 tests |
| Globals never invented; singleton enforced | none (key divergence recorded) | C# only | Cut 3 tests |
| Runtime type decides schema | none for existing records | C# only | fixture ids in cultcache-schema-compatibility.md:20-24 unchanged; UpsertWeaponThroughGearHandleReloadsAsWeapon |
| Assignable lookups and watches | none | C# only | Cut 3 tests; Mesh and Networking suites |
| Subtraction (SoA parked, managed documents, legacy directory formats, wrappers) | none; v4 directory manifests and v1 single files unchanged | C# only | full suites at their prior pass counts minus the deleted tests; external consumers build |
| Atomic commit becomes an explicit batch on one home store | none (the store's commit is unchanged: single-file one replace, directory pages then manifest) | C# only; Rust already matches; TS and Python recorded as not implementing it | Cut 3 tests BatchIsAllOrNothingOnStoreFailure, BatchAcrossTwoHomesThrows, BatchObserversSeeOnlyCommittedRecords |
Conditional commit (Expect, ExpectUnchanged) and the single-file lock file |
none in the store file; a new <path>.lock sidecar beside single-file stores (the directory store already has .commit.lock) |
C# gains what Rust has (compare_exchange :713, compare_exchange_snapshot :759, try_ :770 in CultLib\packages\cultcache-rs\src\lib.rs); TS and Python recorded as not implementing it; cross-runtime lock exclusion on one file is a follow-up probe |
ConditionalCommitTests.cs (Cut 3), [P7] |
| Per-assembly options, security comparer | payload bytes of consumer-declared schemas only | C# only | InteropNoteBytesUnchanged; RefKeyedDictionaryRoundTrips |
| Contract text | none | docs in all four | review |
The hosted workflow (.github\workflows\cultnet-interop.yml) tests CultNet
frames only; .cc parity is the CultLib\packages\cultcache-ts test, run by npm test and on
cultcache-ts-v* tags. Rust writes a stub catalog and second-precision
storedAt (CultLib\packages\cultcache-rs\src\lib.rs:2397-2433), a pre-existing byte-parity gap this cut
neither widens nor closes.
4. Cut sequence
Each cut is an independently executable Hands task with its own Soul check. Build host for every step is the Windows workstation. Cuts 2 and 3 are kept separate so Soul can falsify pure subtraction (no behavior change) apart from the behavior change.
Cut 0. Commit the pending ServerShared edits (done)
- Done on
codex/aetheria-state-rebuild: the five ServerShared edits are6bd3e176, verified by the headlessAetheria.SharedandAetherDbbuilds, a Unity 6000.3.24f1 batchmode compile (the agent can run Unity headless when the editor is closed), andAetherDb doctor,station-fit,loadout. The 6000.3 settings reserialization is560779a4; the TMP fallback atlas that batchmode cleared was restored, not committed. - Consequence for the cuts below: "operator Unity recompile" steps can be a batchmode compile run by the agent while the editor is closed. A play smoke still needs the operator.
Cut 1. CultLib contract and red tests
- Repo/branch:
F:\Projects\CultLib,codex/cultcache-store-routing. - Adds
src\GameCult.Caching\Contracts\cultcache-store-composition.md(sections 2.1-2.3 as contract: routing, attachment, dirtiness, read-only, globals, options ownership, value-type encoding, the explicit-batch commit); amendscultcache-persistence-format.md:42-55("Transaction Visibility" becomes: a commit is an explicit batch of records that resolve to one home store; the store commits it as one durable step; nothing is visible, to the committing flow or to observers, until the store has accepted it; a batch may carry conditions, per-record(schemaId, storedAt)identity or whole-store unchanged, evaluated under the store's exclusive lock, and a failed condition is a lost race, not an error; conditional commit is the only write protected against a concurrent change to the same records: a plain flush or unconditional commit on a single-file store writes the cache's snapshot and is last-writer-wins, and on a directory store lands its changed pages onto the current manifest, last-writer-wins per key, so processes that must not overwrite each other's changes use conditional commit; batch and conditional commit are specified for C# and not yet implemented there; Rust implements both; TS and Python implement neither yet) andcultcache-schema-compatibility.md(runtime type decides schema; lookups assignable); amendsdocs\runtime-parity-scope.md:23-27, 33(SoA claim retracted); rewritesCultLib\README.md:240-264, the generator README, andCultLib\packages\cultcache-rs\README.md:216-241. - Adds
tests\GameCult.Caching.Tests\StoreRoutingTests.cs, compiling against today's API, red for the stated reason:LoadingNeverWritesASecondStore(seed A; attach A, pull, attach B, flush; B's file must not exist). Red:[P2-A].UpsertWeaponThroughGearHandleReloadsAsWeapon. Red:[P2-E].GetByNameMatchesAssignableTypes. Red:[P2-D].WatchMatchesAssignableTypes. Red:[P2-D].GetGlobalMatchesAssignableTypes(after an explicit upsert). Red:[P2-D].ConstructingACacheInventsNothing(registry with a[CultGlobal]type;new CultCache(registry).AllEntriesempty). Red:[P1].AttachThenFlushLeavesASeededFileByteIdentical(seeded file, registry with a[CultGlobal]type; attach, pull, flush; bytes unchanged, record loads). Red:[P1].RefusedPushLeavesNothingInMemory(store whosePushthrows; after the failed upsertGet(key)null). Red:[P2-C].
- Command:
dotnet test tests\GameCult.Caching.Tests --filter FullyQualifiedName~StoreRoutingTests. - Soul: eight red for the stated reasons; nothing under
src\changed.
Cut 2. CultLib subtraction (no behavior change)
- Repo/branch: same, after Cut 1. Every deletion here has no consumer outside tests per the audit; behavior for every kept member is unchanged.
- Deletes, in this order:
- Park SoA, as its own commit so Soul can check it apart from the rest:
git tag -a parked/cultcache-soa c2a9a6e(or the branch commit before this one) with a message stating the intent ("ECS-style structure-of-arrays columns over cached documents, chasing performance without compromising document ergonomics"), the span (CultManagedDocument.cs:133-414:CultSoaTable<T>,CultSoaColumn<T>,CultCacheSoaStore,CultCacheSoaTypeTable,CultCacheSoaMember;CC:1419-1422Soa<T>; the_soafield and itsUpsert/Removecalls atCC:1970, 1987, 2094, 2133; the SoA tests inBackingStoreTests.cs), and that nothing outside tests consumed it. Adddocs\parked-features.mdnaming the tag, the span, and the restore path (git show parked/cultcache-soa:src/GameCult.Caching/CultManagedDocument.csand re-hook_soainAdmit/Evict). Amenddocs\runtime-parity-scope.md:23-27, 33to say the SoA table is parked at that tag, not that the claim was wrong. Then delete the span. Nothing else is parked: no other surface on this list carries a stated design reason; if Hands find one in a commit message, they stop and flag it. CultManagedDocument.cs:72-131(CultManagedDocument<T>);CC:1387-1396(Document<T>);CND:855-864(Document<T>).- CultNet's transaction wrapper only:
CND:519-555,:305(RequireTransactionsForAuthoritativeWrites),:872, 898-901, 1791-1796(tests only). The cache's own transaction machinery is not touched here; Cut 3 replaces it in the commit that landsCommit. - Wrappers and unused members:
CC:1519-1523(FlushAsyncbecomes the one-linerFlushAllBackingStores(); return Task.CompletedTask;— the only wrapper kept, because both names have consumers),:1525-1558(FlushBackingStore,FlushBackingStoreCore),:1560-1575(PrepareForReloadOrShutdown×2),:1467-1490(PullBackingStoreRecordsAsync),:1731-1738(TryGet<),:1748-1760(GetStoredDocuments<, fold intoGetAll<T>),:1787-1794(TryGetByName),:1810-1817(TryGetByIndex),:1819-1825(Resolve<),:1318-1325(Logger),:1332-1335(LastSuccessfulFlushAtUtc) and store:2365-2368,CacheBackingStore.Logger(:2350-2354), thesoftparameter everywhere in the two Caching projects exceptCultCache.FlushAsync(bool soft = false), which Studio reflects on (CultCacheStudioWindow.cs:739) and keeps until Cut 6,EntryAdded/EntryUpdated/EntryDeleted(:2383-2391; replaced byprotected internal Action<CultStoredDocument>? Loaded, Unloaded, sinceDirectoryMessagePackBackingStorelives in another assembly), theGetAwaiter().GetResult()subscriptions (:1432-1434;AddStoredDocumentInternalbecomes synchronousvoid, itsasyncandawait Task.CompletedTaskgo). CultCacheMessagePack.cs:ConfigureCache,ConfigureStore,DirectoryStorePath,DirectoryStoreHydrationFilter,ConfigureDirectoryStoreand their uses (:32-40, 47-61, 109, 113-118, 127).OpenAsynckeeps its behavior here (pull, then its existing materialization):Createnever pulls, soTask.FromResult(Create(...))is only correct once attach hydrates, and moves to Cut 3.DMS:HydrationFilter(:46, 635),ReadStageProbe,FlushStageProbe, stage constants and every?.Invoke(:158, 245, 418, 456),ReadPersistedGeneration,PullSelected/PullSelectedCore(:229-274) together with the baseCacheBackingStore.PullSelected(CC:2402-2409) andCultPersistedRecordMetadata(CC:2304-2323), which the directory store and open options use until this step,LoadLegacyRecords,_legacyInlineRecords,LegacyRecordPath,MetadataRecordPath,_needsIndexUpgrade,_manifestUsesMetadataPages,_manifestUsesImmutablePages, the v2/v3 format constants and every branch on them. A missing manifest is an empty store (the store synthesizes av1.directorymanifest for it today and keeps treating it as empty); an existing manifest whoseFormatVersionis not the v4 constant throwsInvalidOperationException("Directory store {path} is {format}; only {v4} is readable.").CultDocumentMessagePackSerialization.cs:144-175(SerializeSchemaCatalog,DeserializeSchemaCatalog).- Every
///line in all eight files of the two Caching projects;<NoWarn>$(NoWarn);CS1591</NoWarn>inGameCult.Caching.csprojandGameCult.Caching.MessagePack.csproj. Comments that carry an invariant (e.g. the dirty-pull guard atCC:2568-2571) stay as//. - Tests that exist only to exercise the deleted surface (SoA, managed
documents, stage probes, legacy directory formats, selective hydration,
the CultNet transaction wrapper) are deleted with it; the cache
transaction tests stay until Cut 3 rewrites them against
Commit;tests\GameCult.Caching.Tests\README.mdis updated.
- Park SoA, as its own commit so Soul can check it apart from the rest:
CultMesh.FlushAsync(bool soft)andCultNetLocal.FlushAsync(bool soft)keep their signatures and callFlushAsync(); the parameter is dead, and its removal together with the four external call sites (MimirEveDashboard:900,CultMeshMedia:422; BrokkrBrokkrCultMeshMirror.cs:68-124) is a named follow-up, not part of this migration.- Commands:
dotnet build CultLib.sln;dotnet test tests\GameCult.Caching.Tests tests\GameCult.Networking.Tests tests\GameCult.Mesh.Tests tests\GameCult.Geometry.Tests;dotnet buildofF:\Projects\Aquarium\src\Aquarium.Epiphany,F:\Projects\Ymir\src\Ymir.Core,F:\Projects\AquaSynth(its .NET projects),F:\Projects\Mimir(its .NET projects),F:\Projects\Gjallar\src\Gjallar;rg "ConfigureCache|ConfigureStore|DirectoryStorePath|ConfigureDirectoryStore|FlushBackingStore\(|PrepareForReloadOrShutdown|TryGetByName|TryGetByIndex|ExecuteTransactionAsync|\.Soa<|\.Document<|LastSuccessfulFlushAtUtc|HydrationFilter"over those five repos, Delvehold, Brokkr, Eve, EveUnity, EvePlugins must be empty (Brokkr, Eve*, Delvehold are not built here; the grep is the proof). - Behavior changes Cut 2 did make (Soul, Cut 2), recorded rather than reversed:
(B1) an exception while the cache admits a loaded record now propagates out
of
PullAll, where the R3Subjectpath swallowed it; Cut 3'sAdmitmakes load all-or-nothing. (B2) attaching one store to a second cache silently replaces the first cache'sLoaded/Unloaded; Cut 3 refuses it. (B3) a manifest deleted while the process runs empties the store on the next flush, since a missing manifest is an empty store. (B4) a v1 single-file snapshot opened as a directory store throws instead of converting. Also: a clean flush on a fresh directory store writes nothing, and orphan pages with no manifest are ignored. Atomic replace, pages-before-manifest ordering, content-addressed pages and both leases are unchanged in code, but their tests went with the stage probes; Cut 3 restores coverage. - Soul:
git tag -l parked/cultcache-soaresolves to a commit whoseCultManagedDocument.csstill holdsCultSoaTable, anddocs\parked-features.mdnames it; Cut 1's eight tests still red for the same reasons (no behavior moved); every kept test passes; the five external builds green; the grep empty;wc -ldelta of the two Caching projects againste9b91c1reported (the ambient transaction machinery stays until Cut 3, so the 2.0 size target is checked there);rg "GetAwaiter\(\)\.GetResult\(\)" src\GameCult.Cachingempty (theasync |AsyncLocal|SemaphoreSlimemptiness check moves to Cut 3);rg "///" src\GameCult.Caching src\GameCult.Caching.MessagePackempty;cultcache.store.v4directory manifests and v1 single files written before the cut still open.
Cut 3. CultLib routing, attachment, globals, read-only, lookups
- Repo/branch: same, after Cut 2.
- Files:
CC;CultDocumentMessagePackSerialization.cs(SingleFileMessagePackBackingStorector);DMS(ctor,:277-281);CultCacheMessagePack.cs(ReadOnly,initializeGlobalsplumbing);CND:875, 913;tests\GameCult.Caching.Tests\StoreRoutingTests.cs,BackingStoreTests.cs:342, 358, 365;tests\GameCult.Caching.InteropPeer\Program.cs. - Deletes first: 2.1's forbidden writers and 2.2's forbidden writers.
- New behavior: sections 2.1 and 2.2 exactly, in the shape of 2.0.
- Interop peer: mode
write-routed <catalog.cc> <run.cc>attaching two routed single-file stores (interop-note-> catalog,interop-run-note-> run), one record each, flush.readunchanged. - Cut 1 fixtures this cut rewrites (Soul, Cut 1):
LoadingNeverWritesASecondStoreattaches its second store with a home type (e.g.AddBackingStore(second, typeof(RoutingOther)),RoutingOtheradded to the registry), because a second untyped store is now a registration error and the Cut 1 form could not name a home type against the old API.StoreRoutingTests.GlobalRegistryandBackingStoreTests.cs:332-334stop setting<IsGlobal>k__BackingFieldby reflection; their fixtures become real[CultGlobal]types, safe once nothing invents globals. Soul:rg "k__BackingField" testsempty. - Tests that pass after: Cut 1's eight, plus in
StoreRoutingTests.cs:RoutedStoresWriteTheSameBytesAsSingleStores(pinstoredAtthroughUpsertAsync(Type, object, key)on aCultStoredDocumentbuilt with a fixed timestamp, or compare after normalizingstoredAt);CatalogRecordNeverLandsInRunStore;AttachAfterDirtyThrows;SecondUntypedStoreThrows;DuplicateHomeTypeThrows;WriteWithoutHomeThrows(both stores clean,Getnull);ForeignRecordIsRefusedOnLoad(attach throws naming key and stores;AllEntriesempty);LateRouteOverAdmittedTypeThrows(attach an untyped store holding aNote, then attach a store routed toNote; throws naming both stores;_entriesunchanged; the untyped store not dirty; the reverse order succeeds);ReadOnlyStoreRefusesWrites(throws; file bytes unchanged;Getnull;IsDirtyfalse);ReadOnlyStoreIsNotFlushed;GlobalSingletonIsEnforced(second key throws; a file with two records of a global type is refused at attach);AmbiguousAssignableLookupThrows. - Durability coverage restored (Soul, Cut 2), without a public probe: faults
come from real file locks.
tests\GameCult.Caching.Tests\DirectoryStoreDurabilityTests.cs:FailedManifestReplaceKeepsPreviousGeneration(hold the manifest withFileShare.None; a dirty flush throws; after release a reopen reads the old values,IsDirtystays true, and the next flush commits);SameStoredAtDifferentPayloadWritesADistinctPage;PullAllWaitsForHeldCommitLease(hold<records>\.commit.lock;PullAllhas not returned within 100 ms and returns after release);MutationBlockedBehindFlushStaysDirty;FlushNeverOpensUnchangedPages(a clean page held withFileShare.None; flush succeeds);MissingManifestIgnoresOrphanPagesAndFlushDeletesThem;TamperedPageFailsLoadNamingPage.DirectoryStoreHonorsConditionscovers the conditional-commit path. - Load and attachment:
PullAllAdmissionFailureLeavesStoreAndCacheConsistent(a record that failsAdmitleaves neither the store's entries nor the cache partly updated);StoreAttachedToSecondCacheThrows(AddBackingStorerefuses a store whoseLoadedis already set). DecideResolveLegacyUncataloguedRecordCatalog(DMS): delete it under the target invariant that legacy formats are read only by the importer, unless a v4 store can reach it, in which case test it against v4. - CultNet:
Commitmust not publish CultNet puts or deletes staged in a batch before the store commits. AddCultNetPutInsideCommitPublishesOnlyAfterCommit, or makeCultNetDatabasewrites refuse inside a batch; pick the smaller. - Commands:
dotnet build CultLib.sln; the four test projects as Cut 2; the five external builds as Cut 2;rg "UpsertAsync<|AddAsync<|PutAsync<"over Delvehold, AquaSynth, Mimir, Gjallar reviewed for a base-typedT(none expected);rg "GetGlobal<|global:" F:\Projects\AquaSynthto report how its[CultGlobal]types are read now that nothing invents them. - Soul: every test; schema-compatibility fixture ids unchanged; Mesh,
Networking, Geometry suites at their Cut 2 counts; external builds green;
the AquaSynth global report written into this document's section 7;
CCat or below the 2.0 shape's size;rg "MaterializeMissingGlobals|InitializeGlobals|ContainsDurableRecord|PullOnOpen|initializeGlobals|ExecuteTransactionAsync|VisibleStoredDocuments" src testsempty, andrg "AsyncLocal|SemaphoreSlim" src\GameCult.Cachingempty (Mesh and Networking useSemaphoreSlimfor unrelated reasons). - Atomic commit, in the same commit as the routing change: delete
CC:1577-1622(ExecuteTransactionAsync×2),:1907-1921(VisibleStoredDocuments),:1923-2066(CommitTransaction,CultCacheTransaction), every_ambientTransactioncheck (:1449, 1474, 1497, 1536, 1630, 1674, 1714, 1832, 1860),_transactionGate; addCultCacheBatchandCommit(Action<CultCacheBatch>)as in 2.2; keepCacheBackingStore.CommitBatch(CC:2425-2452, minus itssoft) andDMS:308-351. Tests (behavioral):BatchIsAllOrNothingOnStoreFailure(a store whosePushAllthrows on the second call: after the failed commit no record of the batch is inGet, the store's file is unchanged,IsDirtyis false);BatchAcrossTwoHomesThrows(one catalog and one run record: throws before either store is touched; bothIsDirtyfalse; neither key readable);BatchObserversSeeOnlyCommittedRecords(Watch<T>receives exactly one change per committed record, none beforeCommitBatchreturned, none for a failed batch);BatchReadsSeeCommittedStateOnly(insidestage,Getof a key upserted earlier in the same batch returns the pre-commit value);SingleUpsertAndBatchShareOneAdmissionPath(a global singleton violation is refused identically throughUpsertAsyncand through a batch). - Conditional commit, same commit as the batch: files
CC(CultCacheBatch.Expect,ExpectUnchanged,CultCommitRequest,CultCommitOutcome,Commitreturningbool,TryCommit, theStoredAtbump in the batch builder andPush),CultDocumentMessagePackSerialization.cs(SingleFileMessagePackBackingStore: lock file, fingerprint afterPullAll,CommitBatch(request, wait),PushAllunder the lock),DMS(CommitBatch(request, wait)evaluating conditions underAcquireCommitLeaseagainst the re-read manifest). Tests (behavioral,tests\GameCult.Caching.Tests\ConditionalCommitTests.cs):StaleExpectFailsWithNothingChanged(two caches on one file; A commits a new value; B'sExpect(key, itsInstance)commit returns false; B's file bytes hash,Get,IsDirtyandWatchcount unchanged);ExpectNullIsCreateOnce(two caches bothExpect(key, null)and upsert; the second returns false);PerEntryCommitSurvivesUnrelatedWrite(A writes keyb; B's commit expecting onlyareturns true and the file holds both);ExpectUnchangedFailsOnUnrelatedInsert(A insertsc; B'sExpectUnchangedcommit returns false);TwoWritersRacingExactlyOneWins(in-process first: twoSingleFileMessagePackBackingStoreinstances on one file driven from two threads, each performing N conditional increments of one record with observe-outside, re-check-under-lock; the final value is2Nand each writer reports at least oneMismatch; this proves the lock property because the lock is aFileShare.Nonehandle, which excludes within a process exactly as across processes);TwoProcessesRacingExactlyOneWins(the cross-process form, only if the in-process test is judged insufficient: the test launches exactly two children with an explicit host,dotnet <path-to-child.dll>, neverEnvironment.ProcessPath; the child role is an environment variable,CULTCACHE_RACE_CHILD=1, checked before any other logic in the child'sMain; the childMainthrows if it is ever asked to spawn; the parent assertsProcess.GetProcessesByNameshows at most two children at any sample and fails the test otherwise;Nis bounded and every loop has an iteration cap);TryCommitReportsContended(the test holds<path>.lockwithFileShare.None;TryCommitreturnsContendedat once with bytes unchanged;Commiton another thread waits and succeeds after release);PlainFlushNeverInterleaves(one process flushes in a loop while another commits conditionally; every read of the file deserializes);StoredAtIsStrictlyIncreasingPerKey(a thousand upserts of one key in a loop produce a thousand distinctStoredAts);DirtyStoreRefusesConditionalCommit;CrossStoreConditionalBatchThrowsBeforeAnyStore(both stores' files unchanged, neither lock file created);DirectoryStoreHonorsConditions(the four condition tests repeated against aDirectoryMessagePackBackingStore).BackingStoreTests.cstransaction tests (:1362, 1412, 1422, 1457, 1514, 1544, 1585, 1593) are rewritten againstCommitwhere they prove durability ordering, deleted where they proved the ambient overlay.
Cut 4. CultLib serialization options and security
- Repo/branch: same branch; files disjoint from Cut 3 except the store constructor; may run in parallel with Cut 3.
- Files:
CultDocumentMessagePackSerialization.cs, newCultCacheFormatterResolverAttribute.cs,CultMessagePackSecurity.cs,CultDocumentMessagePackGenerator.cs:290, 308,GameCult.Caching.MessagePack.csprojandGameCult.Networking.csproj(each gains<PackageReference Include="MessagePackAnalyzer" Version="3.1.7" PrivateAssets="all" />beside itsMessagePackreference, so MessagePack's source generator stops flowing to consumers[P6]; CultLib never registers a generated resolver),tests\GameCult.Caching.Tests\SerializationOptionsTests.cs,AssemblyInfo.cs, and the member discovery inCultDocumentMessagePackGenerator.cs(:58-61, 80, 116, 204-207). - Generator member discovery (Soul, Cut 1). Today the generator walks only
members declared on the class (
:80) and emits a codec only when those slots are dense from 0, so a derived document's generated descriptor lists only its own members while the reflective one (CultCache.cs:1115, 1125) includes inherited ones: the two builds hash different schema ids and catalogs for the same type. The generator now discovers members along the base-type chain exactly asCultDocumentRegistrydoes (public instance fields and settable properties, inherited included,[IgnoreMember]excluded), and density is computed over that full set. Unkeyed ordering (generator by name, reflection by metadata token) is closed by requiring[Key]on every persisted member of a[CultDocument]type: a generator diagnostic error, and the reflective registry throws the same message. First step of the cut:rgevery consumer (CultLib src, Aquarium, Ymir, Mimir, AquaSynth, Gjallar, Delvehold) for[CultDocument]types with unkeyed members and list them; if any has a persisted store, stop and report before adding the rule. - Deletes first:
.WithSecurity(MessagePackSecurity.UntrustedData)at:55. - New behavior: section 2.3.
public sealed class CultCacheFormatterResolverAttribute : Attribute { public CultCacheFormatterResolverAttribute(Type resolverType); public Type ResolverType { get; } };public static MessagePackSerializerOptions OptionsFor(Assembly documentAssembly);public sealed class CultMessagePackSecurity : MessagePackSecurity { public static readonly CultMessagePackSecurity Instance; }. - Tests:
DeclaredResolverEncodesValueTypeAsPositionalArray(test assembly declares a resolver forstruct Pair(float A, float B)writing[f,f]; reflective and generated paths both emit the two-element array and round-trip);GeneratedAndReflectiveDescriptorsAgreeForDerivedDocuments(forRoutingWeapon : RoutingGearthe generated and reflectiveSchemaIdare equal, the catalog listsName@0, Damage@1, a codec is emitted, andUpsertWeaponThroughGearHandleReloadsAsWeaponpasses through it);UnkeyedDocumentMemberIsRejected; schema-compatibility fixture ids unchanged;RefKeyedDictionaryRoundTrips;InteropNoteBytesUnchanged(checked-in constant captured onmain);UnknownAssemblyGetsBaseOptions;RefKeyedDictionaryCompilesInAConsumer: a test-only console project undertests\that referencesGameCult.Caching.MessagePackand declares a document withDictionary<CultRecordRef<T>, float>builds without an analyzer-removal target (this is the build[P5]could not do). - Commands:
dotnet build CultLib.sln;dotnet test tests\GameCult.Caching.Tests tests\GameCult.Networking.Tests;dotnet build F:\Projects\Aquarium\src\Aquarium.EpiphanyandF:\Projects\Ymir\src\Ymir.Core(they receive the analyzer change through Networking and Caching.MessagePack). - Soul: the five tests;
rg "MessagePackSecurity.UntrustedData" srcfinds only the copy-constructor argument;obj\**\MessagePack.SourceGeneratoris absent from the consumer test project's build output.
Cut 5. Sibling runtimes: delete mirrors
- Repo/branch: landed on
codex/cultcache-store-routingwith Cuts 1-4 (planned ascodex/cultcache-one-home-store), independent of Cuts 2-4; three language-scoped tasks, parallel. - TypeScript (
CultLib\packages\cultcache-ts, all TS lines below in itssrc\cult-cache.ts): deletemirrors(src\cult-cache.ts:18), the three mirror pushes (:402, 448, 503), theslice(1)lists (:663-677);#resolveRoute(type): CacheBackingStore | undefined;addBackingStore(:180-188) throws on a second untyped store or a claimed type. Tests:rejects a second generic backing store,rejects a type registered to two stores,routes each type to its home store; the writer-by-reader loop (:536-617) adds the two files from the C#write-routedmode. Command:npm testinCultLib\packages\cultcache-ts. Version0.13.5->0.14.0. - Rust (
CultLib\packages\cultcache-rs, all Rust lines below in itssrc\lib.rs): delete the four mirror loops (src\lib.rs:2092-2094, 2213-2215, 2252-2254, 2323-2325) and theroute.len() != 1branch (:2174-2181);fn resolve_route_index(&self, type_id: &str) -> Option<usize>replacesresolve_route_indices(:2363-2380);add_backing_store(:1950-1959) returnsResult<()>and errors on a second generic store or a claimed type; callers (src\lib.rstests,examples\cultcache_interop.rs:77, both underCultLib\packages\cultcache-rs) take theResult. Tests:second_generic_store_is_rejected,type_claimed_twice_is_rejected;type_specific_store_routes_before_generic_storestays. Command:cargo testinCultLib\packages\cultcache-rs. Version0.1.0->0.2.0. - Python (
CultLib\packages\cultcache-py):stores_by_type: dict[str, BackingStore],generic_store: BackingStore | None(CultLib\packages\cultcache-py\src\cultcache_py\cache.py:23-24, all Python lines below in that file);add_backing_store(:100-102) raises on a claimed type,add_generic_store(:104-105) on a second store;_store_for_type(type) -> BackingStoreraises when none (:300-302); the four write loops (:199-201, 218-219, 239-241, 269-270) become single calls;_all_specific_stores(:304-311) deleted;pull_all_backing_stores(:111) iterates the distinct stores. Tests:test_second_generic_store_rejected,test_type_claimed_twice_rejected,test_types_route_to_home_store. Command:python -m unittest discover -s testsinpackages\cultcache-pywithPYTHONPATH=src(pytest is not installed; the suite is unittest). Soul, Cut 5: the siblings did not enforce C#'s "a record's home cannot change after admission" or refuse a record loaded from a store that is not its home, and TS and Rust rejected zero-store writes the contract treats as in-memory; all three are brought to the C# reference in a follow-up commit on the same branch, and Python'sadd_backing_store(store, [])becomes a generic store. A later Soul pass over the sibling series found TS and Python write paths touching the store before validation and accessors ran, TS open to async interleaving, Python accepting a global under any key, and Rustload_soanon-atomic. Operator decisions (2026-09-14, all option A): a TS cache serializes attach, pull, writes and registrations through one per-cache queue (its own mutations only, not observer delivery); TS and Python store a global only under__global__; Rust deletes the uncalledload_envelopeand makesload_soaatomic with the home check; cross-runtime error wording stays as is. Every sibling write validates everything before touching a store, and a refused write changes neither store nor cache. A further Soul pass (after CultLib15c6a5d) found the TS queue could deadlock when a store awaited the same cache and swallowed rejections of unawaited calls, Python's reentrant lock let a nested write corrupt a load or registration, a Python global stored under a legacy key made the cache unloadable after oneput_global, and the Rust batch was all-or-nothing only for stores with an atomicpush_all. Operator decisions (2026-09-14): (B) a global stored under a key other than__global__loads as a compatibility shim that never writes; the first write to that global stores it under__global__and deletes the legacy record in the same validated write, and the shim is removed once no store holds a legacy-key global; two globals of one type on disk are still refused. (A) Re-entrant mutation from inside a store, decoder, accessor or updater is forbidden in Python with a clear error. TS first implemented it with an AsyncLocalStorage guard, which Soul showed refused the ordinary write-back pattern (a store's change handler callingputwithout the store waiting, which simply queues) while still missing waits that escape the async context; operator decision (A): the TS guard is deleted and the contract states the precise rule for every runtime: a store call must not wait for a write to its own cache to finish; write-backs that are not awaited by the store queue normally. Legacy global retirement stays two-step, and a crash leaving both records on disk stays a loud refusal at load. (A) A Rust store keeps receiving its full current view on a batch, and the defaultpush_allfails closed instead of wiping rows partway. Version0.2.0->0.3.0. - Soul: the nine tests;
rg -n "mirror" packages\cultcache-ts\src packages\cultcache-rs\src packages\cultcache-py\srcempty;npm testgreen including the routed-file reads.
Cut 6. CultCache Studio: compile-time reference and drawers
- Repo/branch: CultLib,
codex/cultcache-studio-drawers, after Cut 3. - Files:
src\GameCult.Unity\Assets\Caching\package.json(1.0.0->1.1.0;"dependencies": { "org.gamecult.cultlib": "1.0.57" }),Editor\GameCult.Unity.Caching.Editor.asmdef(referenceGameCult.CultLib),Editor\CultCacheStudioWindow.cs, newEditor\CultCacheStudioDrawers.cs,Runtime\CultCacheInspectorAttributes.cs(one new attribute). - Deletes first: the reflection bridge
CultCacheBridge(:683-790) and thePullOnOpenline (:687); the disabled-text-field fallback inDrawValue(:326-364). The window callsCultCacheMessagePack.OpenAsync,cache.UpsertAsync(Type, object, key),cache.Remove(key),cache.FlushAsync(),cache.IsDirty,cache.Registry.AllDescriptors,cache.AllStoredDocumentsdirectly. - New behavior:
[AttributeUsage(Class)] CultInspectorDrawerAttribute(Type memberType); drawers discovered byTypeCache.GetTypesWithAttribute<CultInspectorDrawerAttribute>()implementingICultInspectorDrawer { object Draw(string label, object value, FieldInfo member); }; built-ins forIDictionary(recursive keys and values, add/remove), abstract or interface members (subtype popup from the member type's[MessagePack.Union]attributes only),CultRecordRef<T>(popup of documents assignable toTby[CultName], plus the raw key); vector and matrix drawers target CultMath types only, and the Studio package takes no Unity.Mathematics dependency. Unclaimed types render a visible error row. - Soul, Cut 6 (after CultLib
8be174b): expanding a foldout dirtied and rewrote records, a throwing drawer broke the pane, multi-dimensional arrays threw, empty-ref dictionary keys could produce an unloadable store,Newon a directory store wrote nothing, and drawers could only claim whole types while Aetheria's[InspectableColor],[InspectableType],[InspectableText]and[InspectableAnimationCurve]need attribute claims. Operator decisions (2026-09-14): theCultInspector*attributes move into CultLib's engine-free core so headless shared models can use them; a drawer claims a member type or an attribute (attribute first), receives the value type, and can fall back to a public default draw; opening any directory store creates no folder or lock file (only a write does); no by-name reflection on CultLib types remains. Game data stores never live under a UnityAssetsfolder: CultCache exists so Unity does not manage game data, so the Studio'sNewrefuses anAssetspath andOpenwarns on one. Cut 8's manifest addsorg.gamecult.cultmathby git URL, since Unity does not resolve package dependencies from git. The operator's design goal is that CultUI, descended from Aetheria'sPropertiesPanel, can recreate the Studio at runtime with little adjustment, so the inspection logic (member list and metadata from the registry, claim resolution, value kinds, union and ref choices, edit validation) lives in an engine-free model in CultLib core, and the editor's IMGUI Studio is a thin lowering of it. The runtime CultUI lowering is a follow-up outside this migration. - Soul, Cut 6 second pass (after CultLib
4716c30, 148/148 tests, 7 mutations):- Held: foldouts, drawer conflicts, multi-dimensional arrays, key refusal,
NewandAssetsrules, directory open creating nothing (its test fails against the old store), deep copy-then-commit. - Defects, fixes dispatched:
- A throwing drawer's in-place partial edit could be saved by a later change.
- IMGUI still decided refused-key handling, element-add choices and integer narrowing.
- Keys equal by
Equalsbut serialized differently (0.0/-0.0) passed refusal and then threw inAdd. - Three model tests survived removal of their rules.
- A
new-hidden member gave two candidates for one slot. - The Studio README still described CultMath drawing.
- Operator decisions (2026-09-14):
CultCache.FlushAsync(soft)is deleted, with Mimir'sMimir.CultMeshMediacall edited in the same pass.- A directory store read with no
.commit.lockre-checks the manifest generation and page addresses after loading and reloads on mismatch (bounded, then throws); opening still creates nothing. - The by-name reflection that remains on cache change objects in
GameCult.Networking(CultNetDatabaseServer,CultNetDatabaseSubscriptionServer,CultNetDocumentRegistry,CultNetDatabase) andGameCult.Mesh(CultMesh.cs) is a follow-up outside this cache-only migration. - The constructor-matching composite drawing
(
CultInspectorModel.Composite) is deleted. It guessed from parameter names and misplaced values when a constructor rewrote its inputs (rect(min, max)). Structs draw by writable public fields; readonly and get-only structs (CultMath matrices,quaternion) are unsupported until their explicit drawers land after the CultMath merge.
- Held: foldouts, drawer conflicts, multi-dimensional arrays, key refusal,
- Verification (operator decision 2026-09-14): the Studio assemblies compile in
batchmode; the manual click-through happens in Aetheria after Cut 7 releases
the packages and Cut 8 wires them in, against the tagged package rather than
a scratch build. CultLib follow-up outside this migration:
src\GameCult.Unityhas no committedPackages\manifest.json(the root.gitignoreexcludesPackages/*) and its demo UI assembly does not compile (ZLinqnever restored; Unity.Mathematics inAssets\UI). Original plan: batchmode compile ofsrc\GameCult.Unity; then the operator opens a.ccwith each member kind, edits, saves, and confirms open-then-close without edits leaves the file bytes unchanged.
Cut 7. CultLib release
- Repo/branch: CultLib
mainafter Cuts 1-6 merge. - Files:
unity\org.gamecult.cultlib\package.json(1.0.56->1.0.57);Runtime\Plugins\*.dllviapowershell -File scripts\build-unity-package.ps1 -UpdateTemplate;unity\org.gamecult.cultlib\README.md:15,docs\nuget-packaging.md:22; the three package versions from Cut 5. - Tags on one commit:
cultlib-unity-v1.0.57,caching-unity-v1.1.0,cultcache-ts-v0.14.0,cultcache-py-v0.3.0; pushed; the last two runpublish-packages.yml. - Verification: committed DLLs byte-identical to a fresh build;
GameCult.Caching.dllexposesAddBackingStore(CacheBackingStore, Type[])and lacksMaterializeMissingGlobals,ExecuteTransactionAsync,Soa(reflection from a throwaway script);git ls-remote --tags originlists the four tags; the publish jobs succeed.
Cut 8. Aetheria onto CultMath and CultCache (8a, then 8b)
Refreshed 2026-09-14. file:line is at Aetheria 59bc5753; CultLib facts are at
main ae194d5. The cut is split because the math swap touches ~130 files on
its own and can be proven on the legacy cache. 8a lands and passes verification
before 8b starts.
Probes behind 8a (scratch copies; nothing committed):
- [P8a-1] ServerShared and AetherDb were built headless with
Unity.Mathematicsreplaced byCultMathand aProjectReferencetoCultMath.csproj. Removingusing static …noiseleft 4 errors (listed in 8a); patching those left 0. - [P8a-2] Unity's generated
Assembly-CSharp.csprojwas built withdotnet build: 0 errors unmodified. With the swap,using CultMath.UnityBridge, the committedCultMath.dll, and the ServerShared patches, it gave 76 errors in 17 files.Assembly-CSharp-EditorandTestswere not probed. - [P8a-3] MessagePack 3.1.7
StandardResolveron CultMathfloat3, on a[MessagePackObject]holding one, and onfloat2x2throwsFormatterNotRegisteredExceptioneach time. The formatters cannot be deleted.
Math audit:
- Not used:
float4x4,transpose,determinant,_11names. Thedeterminanthits (AetheriaMath.cs:98-112,NIH\MIConvexHull) are locals and comments; thehalfhits are locals.float2x2/float3x3,int3/int4,double2/double3,quaternion.LookRotation,Randomandsnoiseall compile against CultMath. - Accepted by Cut 6b:
hash,normalize,Random,snoiseand NaN rules differ, so galaxies per seed change. - Shape change:
hash(float2)returnsfloat, notuint(ZoneGenerator.cs:47). - No implicit conversions: CultMath has none to or from
Vector*,QuaternionorColor. The bridge is extension methods (CultMath.UnityBridge.UnityConversions):ToCultMathonVector2/3/4,Color,Quaternion,Vector2Int/3Int;ToUnityback;float4.ToColor(). There is noVector3tofloat2and nofloat3toColor. - Gaps (Q8-1):
frac(double)(Zone.cs:170, 241, 255);int2(float2)(EntityInstance.cs:385, 388); scalarclamp(int, int, int)(PropertiesPanel.cs:280, whereclampreturnsfloatinto anint).
Operator questions (both ruled 2026-09-14: Q8-1 A, landed as CultMath 0.2.1; Q8-2 B, port both drawers):
- Q8-1: CultMath gaps.
- A: a CultLib pass adds the three gaps to
packages\cultmath\src\CultMath\math.cs, each checked against dxc (all three are HLSL intrinsics or casts), rebuilds the Unity DLL, and tagscultmath-unity-v0.2.1. 8a pins that commit and tag. - B: Aetheria works around them locally: a double frac helper in
Zone,new int2((int)p.x, (int)p.y), andMath.Clamp. - Recommended: A. Cut 6b ruled that gaps are filled in CultMath, not
worked around in Aetheria. Unprobed
Assembly-CSharp-EditorandTestsmay add gaps; the CultLib pass should first run 8a's Unity compile against a local build to catch them.
- A: a CultLib pass adds the three gaps to
- Q8-2, 8b: two catalog markers had Database Tools drawers.
[InspectableSchematicShape](ItemData.cs:286, drawerAetheriaInspectors.cs:158) and[InspectableTemperature](5 floats, drawerFloatInspector.cs:33).- A: delete both markers; the Studio shows its default rows; add a drawer only if the click-through shows pain (the rule already applied to CultMath drawers).
- B: port both into 8b's drawers.
- Recommended: A.
Cut 8a. CultMath swap on the legacy cache
- Repo/branch: Aetheria,
codex/cultcache-cutoverfromcodex/aetheria-state-rebuild. Depends on Cut 7 and CultMath 0.2.1. - First: capture
dotnet run --project tools\AetherDb --census,factionsandhardpoint-fitto scratch. - Deletes first:
Aetheria.Shared.csproj:18-19(theMathematicsSourcecomment and property) and:28(theLibrary\PackageCachecompile include)."Unity.Mathematics"atAetheria.Shared.Unity.asmdef:6andTests.asmdef:7."com.unity.mathematics": "1.3.3"atPackages\manifest.json:12. Burst and Collections still resolve it transitively.- The nine
using static Unity.Mathematics.noise;lines, sincesnoiseis on CultMath'smath:ServerShared\Behaviors\Behaviors.cs:14,ServerShared\Settings.cs:12,ServerShared\GlobalData.cs:12,ServerShared\Environment.cs:6,Zone Display\VolumeSampling.cs:12,Gameplay\Weapons\Lightning.cs:7,Gameplay\Weapons\GuidedProjectile.cs:7,UI\HUD\PlaceUIElementWorldspace.cs:4,UI\Menu\SectorMap.cs:12. Assets\Scripts\CultCache\UnityExtensions.cs:51-52(float4.ToColor,Color.ToFloat4). They duplicate the bridge'sToColor/ToCultMath, and:51is ambiguous once both namespaces are imported.:48-49stay (the bridge has nofloat3colour).
- Changes. The worklist is
rg -l "Unity\.Mathematics" Assets\Scripts tools Aetheria.Shared, 133 paths: 77 under ServerShared (including its asmdef and the 6 files underServerShared\CultCache), 21 in Gameplay, 16 in UI, 7 inAssets\Scripts\CultCache, 4 in Zone Display, 3 in Tests (including the asmdef),Scripts\UnityExtensions.cs,Editor\NameTools.cs, 2 intools\AetherDb, and the csproj.- Usings.
using Unity.Mathematics;becomesusing CultMath;.using static Unity.Mathematics.math;becomesusing static CultMath.math;.using Random = Unity.Mathematics.Random;becomesusing Random = CultMath.Random;.Agents\States\Combat.cs:8becomesusing float2x2 = CultMath.float2x2;. Tests.asmdef:17:precompiledReferencesgains"CultMath.dll". The asmdef overrides references, so the auto-referenced plugin is invisible to it.Aetheria.Shared.Unity.asmdefneeds nothing: it does not override, and the plugin is not explicitly referenced.- ServerShared, from [P8a-1]:
Zone.cs:170, 241, 255takefrac(double)under Q8-1 A, and:256compiles unchanged.ZoneGenerator.cs:47:^ (uint) BitConverter.SingleToInt32Bits(hash(galaxyZone.Position)).ServerShared\CultCache\Serialization\MathResolver.cs:55: replaceArrayFormatter<float2?>withArrayFormatter<int2?>.- Otherwise
MathFormatters.cs,MathResolver.csandJsonConverters.cschange only their usings; the wire shape is unchanged ([P8a-3]).
- Unity side, from [P8a-2]: add
using CultMath.UnityBridge;and use.ToUnity(),.ToCultMath(),.ToColor(), or.ToCultMath().xyfor aVector3becoming afloat2.- Errors per file:
Gameplay\FieldDriver.cs17,Gameplay\Weapons\GuidedProjectile.cs13,Gameplay\EntityInstance.cs11,Gameplay\ActionGameManager.cs6,UI\Menu\SectorRenderer.cs5,UI\Menu\MapMenuInput.cs5,Gameplay\HullCollider.cs4,Gameplay\Weapons\GuidedProjectileManager.cs3,UI\HUD\PlaceUIElementWorldspace.cs2,Gameplay\GridObject.cs2,Gameplay\ShipInstance.cs2. One each inUI\Properties Panel\PropertiesPanel.cs,Zone Display\ZoneRenderer.cs,UI\Menu\MapRenderer.cs,Gameplay\ItemPickup.cs,Gameplay\ShieldManager.cs,UI\FieldTester.cs. - 71 of the 76 are Vector/CultMath conversions. 15 of those are CultMath
mathcalls handed a Unity vector. - The other five:
EntityInstance.cs:385, 388andPropertiesPanel.cs:280are Q8-1 gaps;FieldDriver.cs:126istransform.rotation * direction.ToUnity();GuidedProjectile.cs:139passesfloat3wherefloatis expected in itsnoise(…)calls, so check which overload bound before and bind that one explicitly.
- Errors per file:
- Not probed; fix from the batchmode log:
Assembly-CSharp-Editor(Editor\NameTools.cs, and the Database Tools filesCultCache\Editor\DatabaseInspector.cs,Inspectors\AetheriaInspectors.cs,AnimationCurveInspector.cs,EnumValuesInspector.cs,IntInspector.cs,MathematicsInspector.cs) andTests(BresenhamTest.cs,ShapeTestScript.cs). The Database Tools get the minimal compile fix only: 8b deletes them, but 8a must leave a working editor.
- Usings.
- Adds:
Packages\manifest.json:"org.gamecult.cultmath": "https://github.com/GameCult/CultLib.git?path=/packages/cultmath/unity/org.gamecult.cultmath#cultmath-unity-v0.2.1"The package declares no dependencies.Directory.Build.propsat the Aetheria root:CultLibRootfromCULTLIB_ROOT, else$(MSBuildThisFileDirectory)..\CultLib.CultLibRevisionisf0605367e0d7e57941a57bacb0b8cb8d893073be(CultMath 0.2.1 onmain).GitExecutableas inF:\Projects\Delvehold\Directory.Build.props.- Nothing else. Not Delvehold's
TargetFramework/Nullable/ImplicitUsings/LangVersiondefaults, which would restyle AetherDb and IDE builds of Unity's csprojs, and not itsCultLib-aetheria-authorityfallback.
Directory.Build.targets: Delvehold'sVerifyCultLibRevision(HEAD equals the pin; clean worktree), with the existence check on$(CultLibRoot)\packages\cultmath\src\CultMath\CultMath.csproj. It is the only working pin for a sibling checkout.Aetheria.Shared.csproj:<ProjectReference Include="$(CultLibRoot)\packages\cultmath\src\CultMath\CultMath.csproj" />. CultMath targetsnet8.0;netstandard2.1, and the netstandard2.1 build resolves.LangVersion9 compiles against it ([P8a-1]).
- Authority map:
- Math semantics (vectors, matrices,
Random, noise) are owned by CultMath, following HLSL as dxc compiles it. Unity.Mathematics owns nothing in Aetheria and stays resolved only as a Burst/Collections dependency. - Engine conversion is owned by
CultMath.UnityBridge. Aetheria'sUnityExtensionskeeps only what the bridge lacks:float3colour, and the curve, gradient and texture helpers. - Math wire shape stays with
MathFormatters, through the legacy cache's resolver until 8b. - Forbidden: the
Library\PackageCachemath sources in the headless build, and implicit engine conversions.
- Math semantics (vectors, matrices,
- Verification:
dotnet build Aetheria.Shared\Aetheria.Shared.csprojanddotnet build tools\AetherDbare green.- Negative: the pin guard fails with CultLib at another commit and with a dirty CultLib.
- Unity 6000.3.24f1 batchmode compile with the editor closed
(
-batchmode -nographics -quit -projectPath F:\Projects\Aetheria -logFile <scratch>): UPM resolves the cultmath URL, and the log has noerror CS. census,factionsandhardpoint-fitequal the captures, because the legacy cache still readsAetherDB.msgpackthrough the retargeted formatters.doctorandstation-fitrun to completion; generation output differs by design.- Negative:
rg "Unity\.Mathematics" Assets\Scripts tools Aetheria.Sharedis empty. The package stays resolved, soAssembly-CSharpwould still compile a stray using; this rg is the check. - Negative:
rg "PackageCache" Aetheria.Sharedis empty, andrg "com.unity.mathematics" Packages\manifest.jsonis empty. - Operator play smoke, run at Aetheria
d3db1730or earlier, because 8b stops runtime play until Cuts 9 and 10:- Start a new game and fly through one zone.
- Fire any weapon. Turret aiming uses
first_order_intercept. - Open the sector map. Link labels should sit on one side of their line rather than centred.
- Optional: enter a no-fly zone to draw aggro, then fire a guided weapon at a hostile. Guided weapons lock only onto hostiles.
- Optional: go through a wormhole. The mid-animation rotation differs
slightly because of
LookRotation.
- Commit: 8a is one commit.
Cut 8b. Data model cutover and AetherDb
-
Repo/branch: same, after 8a is verified.
-
Deletes first (file lines at
59bc5753):- Under
Assets\Scripts\ServerShared\CultCache\:CultCache.cs(437),DatabaseEntry.cs(92),Attributes.cs(146; survivors move, below).Serialization\JsonKnownTypes\**(13 files, 342 lines including the.csproj),Serialization\TypeFormatterResolver.cs(66),Serialization\RegisterResolver.cs(37).Serialization\JsonConverters.cs(169). The only otherJsonConvertuse is a comment,InputDisplayLayout.cs:92.ReflectionExtensions.cs(128) andCollectionExtensions.cs(76), once their live members move intoServerShared\Extensions.cs:GetAllChildClasseswith its privateLoadableTypes(Behaviors\StatModifier.cs:48-49,UI\Menu\TradeMenu.cs:152,UI\Menu\TradeMenuDebug.cs:138);SplitCamelCaseandFormatTypeName(Behaviors.cs,TradeMenu.cs,TradeMenuDebug.cs,PropertiesPanel.cs);MaxBy/MinBy(Galaxy.cs,Zone.cs,ZoneGenerator.cs,ActionGameManager.cs,ZoneRenderer.cs).- Dead with the files:
GetAllInterfaceClasses,GetParentTypes,GetAllGenericChildClasses,IsAssignableToGenericType,GetFullName,GetHashSHA1,WrapAwait.
Assets\Plugins\MessagePack\**(205 files including.meta; 97.cs, 30,088 lines; asmdef).Assets\Plugins\System.Runtime.CompilerServices.Unsafe.dlland its.meta.org.gamecult.cultlibships a DLL of the same name, which Unity rejects as a duplicate plugin.Assets\Scripts\CultCache\Editor\**(35 files including.meta; 17.cs, 1,978 lines).Assets\Scripts\CultCache\UnityExtensions.csandXKCDColors.csare not cache code and stay.Aetheria.Shared.csproj::23(the vendored MessagePack include) and:33(System.Runtime.CompilerServices.Unsafe, needed only by the vendored MessagePack); the comment at:6drops its MessagePack clause."MessagePack"atAetheria.Shared.Unity.asmdef:5.- The root
[Union]list, and everyJsonKnownTypesattribute andusing(10 files outside the folder). - Tags 4, 5, 6, 14, 20.
GalaxyMapLayerData(GlobalData.cs:15-16),PlayerData(PlayerData.cs:9-10),GlobalSettingsAttribute.- AetherDb
doctorandmigrate-products(Program.cs:21, 31), andAetherDb.Save()(AetherDb.cs:37).
- Under
-
Inspector attributes. Map onto CultLib where CultLib already carries the meaning; keep Aetheria's attribute only where it does not. That splits no vocabulary between two owners. Readers were counted after the Database Tools are deleted.
Aetheria attribute Sites Remaining reader Fate InspectableDatabaseLink(T)10 none deleted; the member type CultRecordRef<T>names the target and gets the Studio's ref pickerGlobalSettingsreader only ( CultCache.cs:48)none deleted; [CultGlobal]InspectableText3 none [CultInspectorTextArea]InspectableTexture,InspectablePrefab4, 12 none [CultInspectorAssetPath]with no type, since ServerShared is engine-free and the Studio falls back toObject;InstantWeapon.cs:21sits on abooland is droppedInspectableRangedFloat,RangedFloat2 ( Weapon.cs:27, 30), 1 (Corporations.cs:48)PropertiesPanel.cs:588[Inspectable, CultInspectorRange(0, 1)]and[CultInspectorRange(0, 1)];PropertiesPanel.cs:588, 599readCultInspectorRangeAttributeInspectableRangedInt,InspectableEnumValues,InspectableTextAsset,Tooltip,Name0 PropertiesPanel.cs:599(RangedInt)deleted DatabaseCategory, class-levelOrder,InspectorHeader12, 2, 3 ( FieldDriver.cs)none deleted with their uses InspectableSoundBank,InspectableAudioParameter4, 3 none (no Database Tools drawer existed) deleted; plain uintrowsInspectableType,InspectableColor,InspectableAnimationCurve,InspectableTemperature,InspectableSchematicShape2, 2, 7, 5, 1 Aetheria Studio drawers (Temperature ported from FloatInspector.cs:33, SchematicShape fromAetheriaInspectors.cs:158, per Q8-2 B)kept Inspectable,PreferredInspectorAttribute,RuntimeInspectable219, base, 0 PropertiesPanel.cs:396-623,TradeMenu.cs:153, 250kept; the runtime panel's opt-in, and not read by the Studio Survivors move to
ServerShared\Attributes.cs, which already holdsRuntimeInspectable. -
Kept and moved:
MathFormatters.csandMathResolver.csmove toServerShared\Serialization\([P8a-3]). They cover every serialized math member:float2,float3,float4[],int2,bool2[,],List<int2>,Dictionary<int2, …>. Noquaternion, matrix,int3/int4ordouble*member is serialized, so no formatter is added. -
Adds:
- Pin and references:
Directory.Build.targetsalso checks$(CultLibRoot)\src\GameCult.Caching\GameCult.Caching.csprojexists.Aetheria.Shared.csprojgainsProjectReferences to$(CultLibRoot)\src\GameCult.Caching\GameCult.Caching.csprojandGameCult.Caching.MessagePack.csproj. No analyzer handling: Cut 4 keeps MessagePack's generator inside CultLib, and both bodies serialize throughDynamicObjectResolver(Aetheria's backend is Mono,ProjectSettings.asset:660-661). Newtonsoft stays (out of scope).
ServerShared\AssemblyInfo.cs:[assembly: CultCacheFormatterResolver(typeof(MathResolver))].MathResolver.Instanceis public static, which satisfiesCultDocumentMessagePackSerialization.cs:62-69.Packages\manifest.json:"org.gamecult.cultlib": "https://github.com/GameCult/CultLib.git?path=/unity/org.gamecult.cultlib#cultlib-unity-v1.0.57""org.gamecult.caching.unity": "https://github.com/GameCult/CultLib.git?path=/src/GameCult.Unity/Assets/Caching#caching-unity-v1.2.0"caching.unitydeclaresorg.gamecult.cultlib: 1.0.57, satisfied by the manifest entry of the same version;cultlibandcultmathdeclare nothing. Nothing is left for Unity to resolve from a registry.Aetheria.Shared.Unity.asmdefreferencesGameCult.CultLiband keepsnoEngineReferences: true.
- Document attributes:
[CultDocument("aetheria.<lowercase type>", "1")]on every concrete document type in Q7, with[MessagePackObject]and integer[Key]s.[CultGlobal]onSavedGameandPlayerSettings.[CultName]on existingNamemembers.[MessagePackObject]is removed from the non-union abstract bases (ItemData,CraftedItemData,EquippableItemData,BodyData,AgentTask); value unions keep theirs.
- References:
GuidandDatabaseLink<T>becomeCultRecordRef<T>.Dictionary<Guid, float>becomesDictionary<CultRecordRef<T>, float>with[CultReference(typeof(T), many: true)].List<Guid>becomesList<CultRecordRef<T>>.- Slots are unchanged. The legacy
Key(0)slot is left unclaimed: the importer writesnil, and MessagePack skips unclaimed slots.
RequireBehaviorbecomesstring(Behaviors\StatModifier.cs:22-23), compared asb.GetType().Name == _data.RequireBehaviorat:73, 80.ServerShared\AetheriaStores.cs:public static class AetheriaStores { public static readonly Type[] CatalogTypes = { typeof(ItemData), typeof(Faction), typeof(FactionProductData), typeof(PersonalityAttribute), typeof(NameFile) }; public static readonly Type[] RunTypes = { typeof(OrbitData), typeof(BodyData), typeof(SavedZone), typeof(SavedGame) }; public static readonly Type[] PlayerTypes = { typeof(PlayerSettings), typeof(InputLayout) }; // Attaches (hydrates) the catalog read-only unless catalogWritable, then the run and player stores when given. // Throws when a [CultGlobal] type routed to the catalog has no record. public static CultCache Open(string catalogPath, string? runPath = null, string? playerPath = null, bool catalogWritable = false); }- Q8 identity edits: the worklist
rg "DatabaseLink|DatabaseEntry|\.ID\b|LinkID" Assets\Scripts tools -g "!**/CultCache/**"has 140 matches in 30 files, 90 of them in ServerShared.DatabaseLinkBase.Cachegoes;ItemManager.GetDataresolves. Assets\Scripts\Editor\CultCacheDrawers.cs:- It is in
Assembly-CSharp-Editor, which sees the auto-referencedGameCult.Unity.Caching.Editor. - Each class is
[CultInspectorDrawer(typeof(<attribute>))]implementingICultInspectorDrawer.Draw(CultInspector inspector, string label, Type type, object value, MemberInfo member), and returnsinspector.DrawDefault(...)for any type it does not handle. - Port each drawer from its Database Tools file before that file is
deleted, in the same commit:
InspectableType: a popup of the simple names inattribute.Type's[Union]list, writing thestring. Port fromInspectors\TypeInspector.cs.InspectableColor:float3(Corporations.cs:33, 36) andfloat4throughEditorGUILayout.ColorField. Port fromInspectors\MathematicsInspector.cs:40-100.InspectableAnimationCurve:float4[]keyframes (Launcher.cs:12-46, six members) andBezierCurve(ItemData.cs:390) throughEditorGUILayout.CurveFieldandToCurve(CultCache\UnityExtensions.cs:38, 43). Port fromInspectors\AnimationCurveInspector.cs.InspectableTemperature: the fivefloatmembers. Port the Database Tools behaviour fromInspectors\FloatInspector.cs:33.InspectableSchematicShape:ItemData.cs:286. Port fromAetheriaInspectors.cs:158.
- It is in
tools\AetherDb:AetherDb.Open(AetherDb.cs:30) becomesAetheriaStores.Open(root\GameData\Aetheria.cc, catalogWritable: command == "clear-boss-hulls" && apply).census,factions,station-fit,hardpoint-fit,loadout,settings,settings-dumpandclear-boss-hullsare rewritten overCultRecordRefandTryGetHandle.savereadsGameData\run.ccwhen present.- The help line (
Program.cs:33, which lists four commands) lists every command. OpenWithNameFiles(:34) is Cut 9's delete.- It must compile; it cannot run until Cut 9.
tests\Aetheria.Shared.Tests(xunit, net10.0) with a temp-directory catalog fixture built throughOpen(catalogWritable: true):OpenThenFlushLeavesEveryFileByteIdentical(run and player seeded with their globals)WeaponWrittenThroughGearHandleReloadsAsWeaponCatalogRefusesWritesSavedZoneNeverLandsInCatalogFactionIsASingletonInstanceMissingCatalogGlobalIsLoud
- Pin and references:
-
Authority map:
- Persistence, routing, dirtiness: CultLib
CultCache, composed only inAetheriaStores.Open. The in-treeCultCache.cs,DatabaseEntry/DatabaseEntry.IDandDatabaseLinkBase.Cacheare deleted, not demoted. - Record identity: the record key.
ItemManager.GetDatais the one resolution path; reference equality replaces ID equality. - Schema: runtime type plus
[CultDocument]. The root[Union]and JsonKnownTypes are deleted. - Math wire shape:
MathResolver, declared by assembly attribute.RegisterResolver.cs(static registration) is deleted. - Catalog editing: the Studio (
org.gamecult.caching.unity) plus Aetheria's five drawers. The Database Tools are deleted. - Inspector metadata: CultLib's
CultInspector*owns text, range and asset path. Aetheria's attributes own only type, colour, curve, temperature and schematic shape.[Inspectable]andRuntimeInspectablebelong to the runtimePropertiesPaneland decide nothing in the Studio.
- Persistence, routing, dirtiness: CultLib
-
Commands:
dotnet build Aetheria.Shared\Aetheria.Shared.csprojdotnet build tools\AetherDbdotnet test tests\Aetheria.Shared.Tests- Unity batchmode compile as in 8a.
- The operator accepts the two new UPM git URLs on first editor open.
-
Soul:
- The headless build is green with the pin guard, which refuses a dirty
CultLibRoot. The six tests pass. - Negative:
rg "DatabaseEntry|DatabaseLink|JsonKnownTypes|TypeFormatterResolver|MultiFileBackingStore|GlobalSettings|ReflectionExtensions|CollectionExtensions" Assets toolsis empty. - Negative:
rg "Inspectable(DatabaseLink|Text\b|Texture|Prefab|RangedFloat|RangedInt|EnumValues|TextAsset|SoundBank|AudioParameter)|DatabaseCategory|\[RangedFloat|InspectorHeader" Assets toolsis empty. Assets\Plugins\MessagePackandAssets\Plugins\System.Runtime.CompilerServices.Unsafe.dllare gone; the asmdef has noMessagePack.- The manifest pins
cultlib-unity-v1.0.57,caching-unity-v1.2.0and the 8a cultmath tag. The batchmode compile is clean. rg "ReactiveProperty|ReactiveCollection" Assets\Scripts\ServerSharedshows no member of a document or an embedded value.
- The headless build is green with the pin guard, which refuses a dirty
-
After 8b: the operator's Studio click-through, against a store from the test fixture or from Cut 9's catalog. It decides whether any CultMath row drawers are worth adding.
Cut 9. One-shot importer
Refreshed 2026-09-14 against Aetheria 20db3a93 (codex/cultcache-cutover, 8b
ended at 9bdf6ef2) and CultLib 0f2c1f0, the pin in Directory.Build.props.
file:line is at those revisions. Cut 9 is headless and needs no Unity.
- Repo/branch: Aetheria
codex/cultcache-cutover, after 8b. - Inputs, all present at HEAD:
GameData\AetherDB.msgpack(46,150 bytes, LFS).GameData\NameFile\*.msgpack(12 files, LFS).GameData\KeyboardLayouts\ansi104.msgpack(LFS) andansi104.json.GameData\Aetheria.ccdoes not exist.- 30 empty per-type folders under
GameData\(AgentTask…WeaponItemData), which git does not track. - 8b already removed
OpenWithNameFiles/withNameFiles(tools\AetherDb\AetherDb.cshas neither), so no delete is owed here.
InputLayoutlives in the catalog (Q9-1 A, operator 2026-09-14). 8b routed it to the player store (AetheriaStores.cs:11).- It is a physical keyboard shape plus the Input System path of each key.
Only the dev-only
InputDisplayLayout.AssociateInputKeys(InputDisplayLayout.cs:460-492, no caller) ever wrote it. - Player rebinds live in
PlayerSettings.InputSettings.InputActionMap(InputDisplayLayout.cs:526-528), not in the layout. - The runtime key is
LayoutFile.name, which isansi104: the TextAssetAssets\Resources\ansi104.jsonis referenced byAssets\Prefabs\UI\Input Display Container.prefab. - Q7's row already reads
Catalog.
- It is a physical keyboard shape plus the Input System path of each key.
Only the dev-only
- Deletes first: none in code. The legacy data is deleted after verification, in the same commit (below).
- Changes:
AetheriaStores.cs:9, 11:typeof(InputLayout)moves fromPlayerTypestoCatalogTypes.PlayerTypesbecomes{ typeof(PlayerSettings) }.tests\Aetheria.Shared.Tests\AetheriaStoresTests.cs:46: theInputLayoutupsert moves into the constructor fixture (:27-33, where the catalog is writable). Otherwise the read-only catalog refuses it, andOpenThenFlushLeavesEveryFileByteIdenticalwould fail for the wrong reason..gitattributes: addGameData/*.cc filter=lfs diff=lfs merge=lfs -textbefore the.ccis staged. The rule is scoped toGameDatabecause.voidbot/state/aetheria.ccis a tracked plain-git.cc, and a global*.ccrule would renormalize it..gitignore: addGameData/*.lock. Every single-file commit or flush creates<file>.lock(CultCache.cs:2201).tools\AetherDb\Program.cs:18-31: addcase "legacy-census"andcase "import", and list both in the help line at:30.
- Adds:
tools\AetherDb\Import.cs,static class Import, about 250 lines. Cut 10 deletes it.LegacyCensus(): prints per-tag counts, the name-file count and the layout count. It writes nothing.Run():- Refuses when
GameData\Aetheria.ccexists. The import is one-shot, with no merge. - Opens
AetheriaStores.Open(catalog, catalogWritable: true)and stages every record in onecache.Commit(batch => batch.Upsert(type, document, new CultRecordKey(key))). The single-fileCommitBatchwrites that as one file replace (CultCache.cs:2124-2154). - Disposes the cache, reopens it read-only so the 8b catalog-global check runs, and prints per-type counts and every ref that resolves to nothing.
- Refuses when
- Legacy shape
[P5]:AetherDB.msgpackis an array of 167[tag, payload]pairs; each name file is[9, payload]with three slots. - Tag table. Source: the legacy union,
git show d3db1730:Assets/Scripts/ServerShared/CultCache/DatabaseEntry.cs.- 0
SimpleCommodityData - 1
CompoundCommodityData - 2
GearData - 3
HullData - 9
NameFile - 13
Faction - 17
PersonalityAttribute - 29
CargoBayData - 30
DockingBayData - 31
WeaponItemData - 32
FactionProductData - Any other tag throws. That includes 15, 16 and 25-28: those are run
types, the catalog refuses them by routing, and
[P5]shows none in the file.
- 0
- Payload rewrite. It is driven by reflection over the target type's
[Key]members, and[Union]for abstract member types.- Precondition, asserted once: no concrete catalog document type declares
[Key(0)]. - Slot 0 is a 16-byte
binGuid. It becomes the record key (ToString("D")) and is written asnil. CultRecordRef<T>members may hold abin16, a legacyDatabaseLink[bin16], ornil. Each becomes aDstring ornil. An all-zero Guid becomesnil: itsDstring would be a set key that resolves to nothing, soFaction.BossHullwould read as dangling instead of unset.- The same rewrite applies to each element of a
CultRecordRef<T>[]orList<CultRecordRef<T>>, and to each key of aDictionary<CultRecordRef<T>, V>.
- The same rewrite applies to each element of a
StatModifierData.RequireBehavior(Behaviors\StatModifier.cs:24, astring) holds a legacy assembly-qualified name. Keep the simple name: the text before the first,, then after its last..- Nested values:
[MessagePackObject]types recurse by[Key].[Union]types read[tag, payload]and recurse into the tagged subtype. Elements of arrays and lists, and dictionary values, recurse the same way. - Everything else is copied raw.
- Deserialize: the rewritten bytes go through
CultDocumentMessagePackSerialization.DeserializeUntyped(type, bytes, registry). A throw names the tag, the record index and the legacy key.
- Precondition, asserted once: no concrete catalog document type declares
- Keyboard layout:
ansi104.msgpackis a bareInputLayout, with no tag and no Guid.- 8b moved the file and added
[MessagePackObject]toInputLayoutMultiRowKey; keys and unions are unchanged. - Deserialize it with CultLib's options and give it key
ansi104.
- 8b moved the file and added
- Headless zone generation: none in this cut. Cut 10 owns the
Name.GetHashCode()follow-up. - Verification:
- Build and tests:
dotnet build tools\AetherDb, thendotnet test tests\Aetheria.Shared.Tests. All six 8b tests stay green after theInputLayoutmove. dotnet run --project tools\AetherDb -- legacy-censusprints:- tag counts
0:13, 1:51, 2:25, 3:3, 13:12, 17:3, 29:4, 30:1, 31:18, 32:37; - 12 name files and 1 layout.
- tag counts
-- importprints:-
SimpleCommodityData 13, CompoundCommodityData 51, GearData 25, HullData 3, Faction 12, PersonalityAttribute 3, CargoBayData 4, DockingBayData 1, WeaponItemData 18, FactionProductData 37, NameFile 12, InputLayout 1, 180 records in all; -
unresolvable refs exactly as authored in the legacy file. The landed import found six and no
Faction.BossHull(factionsshows noDANGLINGrows):DemandProfileentries on Mouth Adapting Gummy Molars (2) and Neural Lace (1);Weapon.AmmoTypeon DeathCluster, FastBlast+- and pretty pretty bang bang.
Soul decoded the legacy file independently. Each target was a record deleted before
285b5771: the Conscientiousness and NeuroticismPersonalityAttributes, and the Auto and Charged Shotgun Ammo commodities.
-
- Negative: a second
-- importrefuses, and the.cchash is unchanged. - Snapshot:
Aetheria.ccopens read-only throughAetheriaStores.Open.DeserializeSnapshotshows every record's schema id in its catalog, and none ofaetheria.savedgame,aetheria.savedzone,aetheria.orbitdata, the body schemas oraetheria.playersettings. - Capture comparison:
- Run:
census,factionsandhardpoint-fitintoscratchpad\cut9-<name>.txt. - Baseline:
scratchpad\before-<name>.txt, 8a's pre-cut captures on the legacy cache. 8a'safter-pin2-*equalled them. factions: must be byte-identical, since it is ordered by name.censusandhardpoint-fit: these break ties inGetAll<T>()order (Program.cs:56-57, 62, 118, 129), and the.ccdoes not keep the legacy order. Normalize both files: split each line on,, sort the tokens, then sort the lines.- Pass rule: any difference after normalization fails the cut, and exit
codes must match (
hardpoint-fitreturns the unfillable count). - The normalizer is a scratch PowerShell one-liner, not repo code.
- Run:
station-fitandloadoutrun to completion. They have no capture.
- Build and tests:
- Same commit, after verification:
git rm GameData/AetherDB.msgpack GameData/NameFile/*.msgpack GameData/KeyboardLayouts/ansi104.msgpack GameData/KeyboardLayouts/ansi104.json.- Remove the empty per-type folders; they are untracked, so this is not part of the commit.
GameData\Narrative\**andSoundbanksInfo.jsonstay; they are authored content, not persistence.
- Soul:
- The counts above and the normalized comparisons.
git check-attr filterreportslfsforGameData/Aetheria.ccandunspecifiedfor.voidbot/state/aetheria.cc.git ls-files GameDatalistsAetheria.cc, 18Narrativefiles andSoundbanksInfo.json.rg "AetherDB\.msgpack|NameFile[\\/]" Assets tools testshits onlyImport.cs.rg KeyboardLayouts Assetsstill hitsInputDisplayLayout.cs:88, 497; Cut 10 deletes both.- The cut is one commit.
Cut 10. Runtime cutover, importer removal, docs
Refreshed 2026-09-14. file:line is at Aetheria 20db3a93, except the
AetherDb and test edits made by Cut 9 (landed 70fbaca1, recorded e3af23fa).
- Repo/branch: same, after Cut 9.
- Rulings (operator, 2026-09-14): the loadout ruling and Q10-2 A, Q10-3 all
A, and dangling-ref option B, as recorded in the status header.
- Q10-2 A: the local
GameData\PlayerSettings.msgpackis discarded. First launch writes defaults toplayer.cc, and nothing imports the old file.
- Q10-2 A: the local
- Step 1, the CultLib pin. This is Cut 10's first commit.
- Move
F:\Projects\CultLibto the commit taggedcultlib-unity-v1.0.59andcaching-unity-v1.3.1, and leave it clean. - Set
Directory.Build.props:5CultLibRevisionto that commit's SHA, which is set when the tag lands. The pin guard refuses anything else. Packages\manifest.json:53-54become…/src/GameCult.Unity/Assets/Caching#caching-unity-v1.3.1and…/unity/org.gamecult.cultlib#cultlib-unity-v1.0.59.- Why 1.0.59 and not 1.0.58: 1.0.58 writes an unset
CultRecordRefas a nil map key, which Python's msgpack rejects. 1.0.59 writes""and reads nil. - Verify: the headless build,
dotnet test tests\Aetheria.Shared.Tests, and the batchmode compile. Aetheria.ccdoes not have to be rewritten for the pin, because readers accept nil. Step 2's commit rewrites it anyway, in the canonical form.
- Move
- Step 2, dangling refs (option B). This is one catalog
Commit, landed before any runtime change.- Tool:
tools\AetherDb\Program.cs:200-226:ClearBossHullsbecomesClearDangling(string[] members, bool apply), andcase "clear-boss-hulls"(:26) becomescase "dangling". It stays one command; no second one-off tool.- It opens
AetherDb.Open(catalogWritable: apply). - It walks every catalog record's
CultRecordRef<T>members by reflection: plain refs, list elements, ref-keyed dictionary keys, and nested[MessagePackObject]and[Union]values such asEquippableItemData.Behaviors. - It prints each ref that resolves to nothing as
<record name> <DeclaringType.Member> -> <key>. - Each
clear <DeclaringType.Member>argument unsets that member's dangling refs, or removes that dictionary's dangling keys, on the record in hand. - With
apply, all changed records land in onedb.Cache.Commit. Without it, the command is a dry run. Faction.BossHullstays a clearable member, so the old command's use is kept.
- It opens
- Run:
dotnet run --project tools\AetherDb -- dangling clear CompoundCommodityData.DemandProfile apply.- It clears 3 keys: 2 on Mouth Adapting Gummy Molars and 1 on Neural Lace.
- Verify:
-- danglingthen lists exactly three refs:WeaponData.AmmoTypeon DeathCluster, FastBlast+- and pretty pretty bang bang.census,factionsandhardpoint-fitstill equal the Cut 9 results (same normalization).git diff --statshows onlyGameData/Aetheria.ccandProgram.cs.
- The three AmmoType refs stay for the operator's Studio click-through (below).
- Tool:
- Loadouts today (all of it is replaced):
- "Save Loadout" (
InventoryPanel.cs:170-174) callsSaveLoadout(ActionGameManager.cs:227-230). That writes a wholeEntityPackto a.loadoutfile through MessagePack's default options.- Those options lack the math resolver since 8b, and
ShipPack.Positionis afloat3(EntitySerializer.cs:162). _loadoutPath(:164) is never assigned (:267is commented out), so the entry has thrownNullReferenceExceptionsince before this migration.
- Those options lack the math resolver since 8b, and
Loadouts(:208) is never filled (:268-269are commented out), so "Restore Loadout" (InventoryPanel.cs:176-195) never appears.- Its restore path would have unpacked the saved
EntityPackwithinstantiate: true(EntitySerializer.cs:75, 103-105), chargedEntityPack.Price(:200-221), and docked the ship.
- Its restore path would have unpacked the saved
- An
EntityPackis the wrong unit for a portable loadout. It carries rolled units (Quality,Ingredients,Durability,ItemInstance.cs:36-43, 76), cargo, children, faction, position and persisted behaviour state.
- "Save Loadout" (
- What a loadout holds. A loadout slot is an
EquippableItemDatadesign.- A design names no manufacturer. Which manufacturer's product builds it is a fact of the current galaxy, not of the build.
- The unit's
FactionProductData(CraftedItemInstance.Product,ItemInstance.cs:43) is not captured. ItemManager.CreateInstance(FactionProductData)(ItemManager.cs:164-187) builds the unit at load.
- Materialization rules (Q10-3, all A):
- Availability:
LoadoutGenerator.IsAvailable(LoadoutGenerator.cs:152-154). The product's manufacturer must be in the galaxy and allied with the docked station's faction. The prelude and a null galaxy make everything available. - Picking a product: the first product, in
GetAll<FactionProductData>()order, whoseDesignis the slot's design and which passes availability. Slots carry no product, so this always applies. - Cost: the sum of the design
Prices, asEntityPack.Pricecharged. - Failure: all-or-nothing. Any failing slot means no ship, no charge, and every failing slot listed.
- Availability:
- Deletes first:
ActionGameManager.cs::58-73: thePlayerSettings.msgpackgetter,_playerSettingsFilePathand the body ofSavePlayerSettings(all replaced below).- The
.loadoutformat::164_loadoutPath,:208Loadouts,:227-230SaveLoadoutand its default-options serializer, and:267-269the commented loader. :232-243:OnApplicationQuitandSaveState.:1087-1088:SaveZone, which has no caller.
InventoryPanel.cs:170-195: the bodies of both loadout menu entries. They are rewritten overLoadouts(below).PlayerSettings.cs:11:[Key(1)] public SavedGame SavedRun. Slot 1 stays unclaimed; nothing is renumbered.SavedGame.cs:51-84: theSavedGame(CultCache, Galaxy, Zone, Entity)constructor, including the upsert at:69.MainMenu.cs::96-108(theSavedRunContinue branch), and:138and:167(SavedRun = null).InputDisplayLayout.cs::88-92: the file reader and its comments.:386-458ParseJson: no caller; its only mention is the comment at:89.:460-492AssociateInputKeys: no caller; its only mention is:151.:494-499SaveLayout.- Then whichever of
using MessagePack,Newtonsoft.Json,Newtonsoft.Json.SerializationandSystem.IObecome unused.
tools\AetherDb:Import.cs, plus thelegacy-censusandimportcases and their help entries inProgram.cs..gitignore: theGameData/PlayerSettings.msgpackline becomesGameData/run.ccandGameData/player.cc.docs\three-gates-scope.md:61-68: the "loading writes" paragraph. Cut 3 made loading non-writing.
- Keeps:
AetheriaStores.Openis unchanged.Zone.CreateOrbit(Zone.cs:249-267) andZone.AddOrbit(:121-124) have no callers at HEAD. They stay. When one is called it writes to the run store, which is attached for the whole session.- Two default-options calls stay:
NewEntitySettings(ActionGameManager.cs:222-225, called fromTradeMenu.cs:377) andEntitySerializer.cs:61-62.- Both deep-copy
EntitySettings, a singlefloat, through MessagePack's default options. - That is neither persistence nor a math type.
- They are the named leftovers the negative grep allows.
- Both deep-copy
- Adds:
SavedGame.cs, in place of the constructor:public static class RunSave { // The live run as plain documents. Writes nothing. public static (SavedGame Game, SavedZone[] Zones) Capture(CultCache cache, Galaxy galaxy, Zone currentZone, Entity currentEntity, bool isTutorial, SavedActionBarBinding[] actionBar); // The only writer of SavedGame and SavedZone: one Commit to the run store. public static void Commit(CultCache cache, SavedGame game, IReadOnlyList<SavedZone> zones); // Removes every run record (SavedGame, SavedZone, OrbitData, BodyData) in one Commit. public static void Clear(CultCache cache); }Captureis the body ofSavedGame.cs:56-83, except that zones become plainSavedZones withContents = zone.Contents?.PackZone() ?? zone.PackedContents.- Today
:75writesnullfor every zone that was generated earlier but not loaded this session: a resumed zone hasContents == nullandPackedContentsset (Galaxy.cs:68). - So one save after a resume erases that zone's contents and orphans its orbit and body records.
- Today
Commitdoes onecache.Commit(batch => …):- zone
iupserts atnew CultRecordKey($"savedzone-{i}"). The key is stable because a run's zone array is fixed at generation. game.Zonesis set to those refs, thenbatch.Upsert(game).batch.Remove(key)runs for every storedSavedZonewhose key is not in that set.- Every operation routes to the run store. The single-file
CommitBatchwrites the store's whole view plus the batch as one file replace (CultCache.cs:2140-2154), so orbits and bodies staged by zone generation since the last save land in the same write.
- zone
Clearis oneCommitthatRemoves every stored document whose type is assignable to anAetheriaStores.RunTypesentry.
ServerShared\Loadout.cs: new. It is the owner of loadouts: the document, capture, save and materialization.[CultDocument("aetheria.loadout", "1"), MessagePackObject] public class Loadout { [CultName, Key(0)] public string Name; [Key(1)] public CultRecordRef<HullData> Hull; [Key(2)] public List<LoadoutSlot> Slots = new List<LoadoutSlot>(); [Key(3)] public int[][] WeaponGroups; // indices into Slots } [MessagePackObject] public class LoadoutSlot { [Key(0)] public int2 Position; // hull cell passed to Entity.TryEquip(item, int2) [Key(1)] public ItemRotation Rotation; [Key(2)] public CultRecordRef<EquippableItemData> Design; } public static class Loadouts { public static Loadout Capture(ItemManager itemManager, Entity entity, string name); // One Commit to the player store; a loadout with the same name is replaced under its existing key. public static void Save(CultCache cache, Loadout loadout); // All-or-nothing: returns a ship only when every design resolved, had an available product and fitted. public static Ship Materialize(ItemManager itemManager, Galaxy galaxy, GalaxyZone zone, Faction stationFaction, Zone liveZone, Loadout loadout, List<string> failures); public static int Price(ItemManager itemManager, Loadout loadout); }- Slots are keyed by hull cell,
EquippedItem.Position(Entity.cs:1096), not by hardpoint index.- Interior gear (cargo bays, docking bays, capacitors) has no hardpoint:
LoadoutGenerator.cs:235-257places it at any free cell. - The cell and the rotation are properties of the hull design, so they stay valid in any galaxy.
- Interior gear (cargo bays, docking bays, capacitors) has no hardpoint:
Capture:Hulliscache.RefOf<HullData>(itemManager.GetData(entity.Hull)).- There is one slot per distinct
EquippedItemacrossentity.Equipment,CargoBaysandDockingBays, in that order, withDesign = cache.RefOf<EquippableItemData>(itemManager.GetData(item)). WeaponGroupsmaps each group's items to slot indices.- It records nothing else: no product or manufacturer, quality, ingredients, durability, cargo, children, faction, ship name, position, settings or behaviour state.
Save:- Looks up the existing record with
cache.GetByName<Loadout>(name), thencache.Commit(b => b.Upsert(typeof(Loadout), loadout, existingKey)). - The key is minted on the first save.
- Names are unique by construction, because
GetByNamethrows on duplicates.
- Looks up the existing record with
Materialize:- It builds a
LoadoutGenerator(ref itemManager.Random, itemManager, galaxy, zone, stationFaction, 0)only to askIsAvailable. That makesLoadoutGenerator.cs:152public; there is no second availability rule. - For the hull and then each slot, in slot order:
- Resolve the design ref. A missing record reports
slot <x,y>: design <key> is not in the catalog; the hull reportshullin place of the cell. - Take the first available product of that design. If there is none,
report
slot <x,y>: no available product of <design name>.
- Resolve the design ref. A missing record reports
- The pass does not stop at the first failure, so every failing slot is listed.
- It builds units with
itemManager.CreateInstance(product)(fresh rolls), setsRotation, and constructsnew Ship(itemManager, liveZone, hull, itemManager.GameplaySettings.DefaultEntitySettings). - It calls
TryEquip(unit, slot.Position). Afalsereportsslot <x,y>: <design name> does not fit. - It rebuilds
WeaponGroupsfrom the slot indices. - Any failure returns
null. The caller has changed nothing: no ship, no credits and no cache write. The function never substitutes a design or a slot. - Units are built only after every slot resolved; a fit failure discards them.
- It builds a
Priceis the hull design'sPriceplus each slot design'sPrice.
- Slots are keyed by hull cell,
AetheriaStores.cs:11(after Cut 9):PlayerTypes = { typeof(PlayerSettings), typeof(Loadout) }.- The player store is the right home. A loadout outlives runs, so the run
store is wrong:
RunSave.Clearwould delete it at death. - The catalog is wrong too: it is authored and read-only at runtime.
- The player store is the one per-player store that persists across runs.
- The player store is the right home. A loadout outlives runs, so the run
store is wrong:
InventoryPanel.cs:170-195:- "Save Loadout": opens
Dialogwith a name field defaulting to_displayedEntity.Name. On OK it runsLoadouts.Save(ActionGameManager.CultCache, Loadouts.Capture(GameManager.ItemManager, _displayedEntity, name)). - "Restore Loadout":
- Shown when
GameManager.DockedEntity != nullandActionGameManager.CultCache.GetAll<Loadout>()is non-empty. - Each option is
"{name} - {Loadouts.Price(...):n0}", enabled when the price is belowGameManager.Credits. - On click it calls
Loadouts.Materializewith the galaxy, the current zone, the docked entity'sFactionand the live zone. - On success: debit the credits, then run today's attach steps from
:184-192(SetParent,IsPlayerShip,DockingBay.DockedShip,CurrentEntity,Display). - On failure:
DialogtitledLoadout cannot be built here, with one line per failure.
- Shown when
- "Save Loadout": opens
- Schematic-shape drawer (operator, 2026-09-14), on the Step 1 pin (Studio 1.3.1):
InspectableSchematicShapeDrawer(Editor\CultCacheDrawers.cs:90-114) reads the owning record throughinspector.Record(read-only).- From that record it restores the Database Tools behaviour: the item's schematic texture under the grid, the height derived from the texture's aspect, and hull hardpoint tints.
- Port that from
git show d3db1730:Assets/Scripts/CultCache/Editor/Inspectors/AetheriaInspectors.cs(the drawer at:158) and delete the comment at:90-92. - Verify with the batchmode compile and the operator's Studio click-through.
The click-through checklist:
- a
HullDatashows its texture underlay, aspect-derived height and hardpoint tints; - set or clear
WeaponData.AmmoTypeon DeathCluster, FastBlast+- and pretty pretty bang bang (each points at the deleted Auto or Charged Shotgun Ammo); - afterwards
-- danglinglists zero refs.
- a
ServerShared\Extensions.cs: addpublic static uint StableHash(this string s).- The body folds UTF-8 bytes through CultMath's
pcg:uint h = 0x811C9DC5; foreach (var b in Encoding.UTF8.GetBytes(s)) h = pcg(h ^ b); return h;. It needsusing System.Text;and no new CultMath API. - It replaces the name hash at
ZoneGenerator.cs:48, which becomesgalaxyZone.Name.StableHash() ^ (uint) pcg3d(galaxyZone.Position).x. - It also replaces
Zone.cs:54, which becomesnew Random(galaxyZone?.Name.StableHash() ?? 1337u).- CultMath's
Randommaps seed 0 to its default (Random.cs:11). - That drops the
abs/Convert.ToUInt32pair, which throws onint.MinValue.
- CultMath's
- This closes the 8a follow-up, because this cut's tests construct a
Zoneheadless.
- The body folds UTF-8 bytes through CultMath's
- Authority map, run and player lifecycle:
- Owner:
ActionGameManagercomposes the process's one cache.- The
CultCachegetter (:46-56) becomesAetheriaStores.Open(catalog, runPath: GameData\run.cc, playerPath: GameData\player.cc). - All three stores attach on first access, in either scene, and stay attached until the process exits.
- The run lifecycle is record-level inside that cache, and the cache is never reopened.
- Reopening would replace the catalog
Factionand item instances thatGalaxy,ItemManagerand live entities hold, breaking Q8's reference identity.
- The
- Inputs: the three
.ccfiles, the liveGalaxy,Zoneand entity, and the action-bar slots. - Outputs:
SavedGameglobal andsavedzone-{i}records inrun.cc.PlayerSettingsglobal inplayer.cc.- Orbit and body records in
run.cc, written by zone generation and landed by the next save.
- Run begins: New Game calls
RunSave.Clear(CultCache)as its first statement (theMainMenu.cs:110handler), before theTask.Runat:127or:154.- Galaxy generation writes nothing.
- Zone generation (
PopulateLevel:615, thenZoneGenerator.cs:99, 108, 200-201, 239, 253) upserts orbits and bodies into the attached run store. They stay staged until the nextRunSave.Commit.
- Run saves:
ActionGameManager.SaveRun():- It is
if (CurrentGalaxy != null) { var (game, zones) = RunSave.Capture(CultCache, CurrentGalaxy, Zone, DockedEntity ?? CurrentEntity, IsTutorial, _actionBarSlots.Select(s => s.Save()).ToArray()); RunSave.Commit(CultCache, game, zones); }. - Callers: wormhole arrival (
:605) andOnApplicationQuit() { SaveRun(); SavePlayerSettings(); }.
- It is
- Run ends:
DiereplacesSavePlayerSettings()at:1059withRunSave.Clear(CultCache); SavePlayerSettings();.CurrentGalaxyis already null (:1058), so a quit afterwards does not save a run.
- Run exists: derived only as
CultCache.GetGlobal<SavedGame>() != null.MainMenu.ShowMainenables Continue from it. Continue setsIsTutorial = saved.IsTutorialandCurrentGalaxy = new Galaxy(CultCache, saved, Debug.Log).StartGame(:695-741) reads it once at the top:nulltakes the new-run branch; otherwise it resumes fromCurrentZone,CurrentZoneEntityandActionBarBindings(:722, 723, 737).- A run store that holds records but no
SavedGamelogsrun store has no SavedGame; Continue disabled. New Game clears it.
- Player settings:
- The
ActionGameManager.PlayerSettingsgetter returnsCultCache.GetGlobal<PlayerSettings>(). - When that is absent (first launch), the getter commits
GetDefaultPlayerSettings()(:75-85) to the player store and returns it. The getter is the only creator. SavePlayerSettings()isCultCache.Commit(batch => batch.Upsert(PlayerSettings)).- Callers: settings Back (
MainMenu.cs:236), quit andDie. - Rebinds and action-bar edits (
InputDisplayLayout.cs:526-528, 550, 556) change the instance and persist at those calls, the same cadence as today.
- The
- Loadouts: player store, owned by
LoadoutsinLoadout.cs.- Inputs: a live
Entityfor capture; the catalog, galaxy, zone and station faction for materialization. - Output:
aetheria.loadoutrecords holding only design refs, hull cells and rotations. - Only writer:
Loadouts.Save. - Only builder of a ship from a loadout:
Loadouts.Materialize. It judges availability only throughLoadoutGenerator.IsAvailable. - Forbidden:
EntityPack,ItemInstance,FactionProductData, run-type orFactionmembers onLoadoutorLoadoutSlot.- A
.loadoutfile. - A
LoadoutGeneratorfallback to "any manufacturer" at restore. That fallback exists for generation's required items (:136-141) and is not applied here.
- Inputs: a live
- Keyboard layout: catalog, read-only.
InputDisplayLayout.StartreadsActionGameManager.CultCache.Get<InputLayout>(new CultRecordKey(LayoutFile.name)).- When it is absent, it throws
catalog has no InputLayout '<name>'.
- Missing globals:
- An absent
SavedGamemeans no run. - An absent
PlayerSettingsmeans first launch. - Only
RunSave.CommitcreatesSavedGame, and only the settings getter createsPlayerSettings. - The cache never creates either.
AetheriaStores.Openkeeps its missing-global check catalog-only (AetheriaStores.cs:24-29).
- An absent
- Derived state:
- "Run exists" is derived from the
SavedGameglobal. IsTutorialis set from it on Continue and written back byCapture.PlayerSettings.SavedRunis deleted, not demoted.
- "Run exists" is derived from the
- Forbidden writers:
File.*I/O for game state anywhere inAssets\Scripts.FlushAsyncinAssets\Scripts. Every runtime write is aCommitrouted to one store; a flush would land half-generated run state outside a save.- A second
AetheriaStores.OpeninAssets\Scripts. - Any upsert of
SavedGameorSavedZoneoutsideRunSave.Commit.
- Shared paths:
- Normal and tutorial New Game both call
Clear. - Continue and a new run's
StartGameread the same global. - Wormhole and quit call
SaveRun. - Death calls
Clear.
- Normal and tutorial New Game both call
- Deletion line:
SavedRun,SaveState, the msgpack settings and layout I/O,SaveLoadout,SaveZoneand theSavedGameconstructor go beforeRunSavelands.
- Owner:
- Other per-file changes:
docs\cultcache-migration-target.md:5: Status becomes done, with the commit range.- The cut map's status header records that Cuts 9 and 10 landed.
- Tests: a new
tests\Aetheria.Shared.Tests\RunSaveTests.cs.- Fixture: the
AetheriaStoresTestsfixture, with run and player paths.ItemManagersettings as inProgram.cs:307-312. RepeatedSavesKeepRecordCountConstant:- Commits a synthetic three-zone save five times, with fresh
SavedGameandSavedZoneinstances each time. One zone packs two orbits and a body. - After each commit it reopens the store. The run store's record count and
SavedZonekeys must be identical every time.
- Commits a synthetic three-zone save five times, with fresh
SaveRemovesZonesNoLongerInTheRun: commits 3 zones, then 2. The reopened store holds exactly 2SavedZones.SaveWritesOnlyTheRunStore: catalog and player hashes are unchanged acrossRunSave.Commit.ResumeThenSaveKeepsUnloadedZoneContents:- Commits zones where zone 1 has
Contentswith an orbit, then reopens. - Builds
new Galaxy(cache, saved, _ => {})and aZonefor zone 0 only, from an emptyZonePackandnew PlanetSettings(). - Runs
Capturewith a null entity, thenCommit. - Zone 1's
Contentssurvives, and its orbit ref still resolves.
- Commits zones where zone 1 has
ClearRemovesEveryRunRecord: afterClear, the reopened run store holds zero records andGetGlobal<SavedGame>()is null. Catalog and player hashes are unchanged.StableHashIsNotProcessRandomized:"Adrasteia".StableHash()equals a literal computed once.tests\Aetheria.Shared.Tests\LoadoutTests.cs, new. Its fixture catalog adds:- a
HullData(Ship, 2×2 shape, one 1×1 hardpoint); - a 1×1
GearDatafor that hardpoint and a 1×1CargoBayData; - a product for each design, made by the fixture faction (materialization needs one; the loadout never names it).
- Settings are as in
Program.cs:307-312, andgalaxyisnull, so everything is available.
- a
LoadoutRoundTripsThroughAFreshCache:- Materializes a ship from a hand-built loadout (gear on the hardpoint
cell, cargo on an interior cell), then
Captures andSaves it. - Disposes, reopens a fresh cache over the same files, and reads
GetByName<Loadout>. - The hull design, slot designs, cells, rotations and weapon groups must be
equal, and
Materializemust succeed again with the same designs on the same cells. Saveunder the same name leaves oneaetheria.loadoutrecord.
- Materializes a ship from a hand-built loadout (gear on the hardpoint
cell, cargo on an interior cell), then
LoadoutHoldsNoRunOrGalaxyRefs: walks the member graph ofLoadoutby reflection.- Every
CultRecordRef<T>hasTassignable toEquippableItemData. - No member type is assignable to
ItemInstance,EntityPack,FactionProductData,Factionor anyAetheriaStores.RunTypesentry. - It also checks, after a save, that
player.ccholds the loadout andrun.ccholds nothing new.
- Every
MissingDesignReports:- A loadout whose second slot's design key is absent from the catalog makes
Materializereturnnull. failuresnames that slot's cell and the key.- A loadout whose third slot's design has no product lists both failing slots, in slot order.
- Neither call writes to any store (all three file hashes unchanged).
- A loadout whose second slot's design key is absent from the catalog makes
- Fixture: the
- Verification:
- Builds and tests:
dotnet build Aetheria.Shared\Aetheria.Shared.csproj,dotnet build tools\AetherDb, thendotnet test tests\Aetheria.Shared.Tests(6 + 6 + 3 tests). - Unity: the batchmode compile as in 8a reports no
error CS. - Pin:
git -C F:\Projects\CultLib describe --tagsnamescultlib-unity-v1.0.59, and the manifest namesv1.0.59andv1.3.1. The pin guard fails with CultLib atb85a828. - Dangling refs:
dotnet run --project tools\AetherDb -- danglinglists exactly the threeWeaponData.AmmoTyperefs (DeathCluster, FastBlast+-, pretty pretty bang bang) until the operator's click-through, then zero. - Negative greps, over
Assets\Scripts tools testsunless noted:rg -P "SavedRun|SaveState|SaveLoadout|SaveZone|_loadoutPath|(?<!aetheria)\.loadout\b|List<EntityPack> Loadouts|PlayerSettings\.msgpack|KeyboardLayouts|ParseJson|AssociateInputKeys|SaveLayout|legacy-census|class Import|clear-boss-hulls|ClearBossHulls"is empty. The lookbehind excludes theaetheria.loadoutschema name.rg "class Loadout\b|Upsert\(typeof\(Loadout\)" Assets\Scriptsshows onlyServerShared\Loadout.cs. The\bexcludesLoadoutGenerator,LoadoutSlotandLoadouts.rg "File\.(Read|Write)AllBytes" Assets\Scriptsshows onlyZone Display\GradientMapper.cs:116, an editor texture export.rg "MessagePackSerializer\." Assets\Scriptsshows onlyNewEntitySettingsandEntitySerializer.cs:61-62.rg "FlushAsync" Assets\Scriptsis empty.rg "AetheriaStores\.Open" Assets\Scriptshas one hit, inActionGameManager.rg "GetHashCode\(\)" Assets\Scripts\ServerShared -g "!NIH/**"shows onlyExtensions.cs:269, which is not a seed.rg "RunSave\.Clear" Assets\Scriptshas two hits:MainMenuandDie.rg "SaveRun\(" Assets\Scriptshas three hits: the definition plus two callers.git ls-files GameDatais unchanged from Cut 9.
- Operator play smoke, in the editor, with no
run.ccorplayer.ccat start:- Launch.
player.ccappears, and Continue is disabled. - Settings, Gameplay: change the name, then Back.
player.ccchanges and theAetheria.cchash does not. - New Game.
- Fly.
- Open the input screen: the layout renders from the catalog.
- Dock. Save Loadout as
smoke.player.ccchanges;run.ccdoes not.
- Take a wormhole.
dotnet run --project tools\AetherDb -- savelists every zone, with contents for the two visited ones. - Take a second wormhole.
-- saveshows the same zone count, and itsSavedZonerecords did not grow. - Quit, relaunch, Continue. You land in the same zone on the same entity, and the action bar is restored.
- Quit immediately, then
-- save. Every zone visited before still shows its contents, which pins thePackedContentsfix. - Continue, then die.
-- saveprintsrun store holds no SavedGame, Continue is disabled, and theAetheria.cchash never changed. - New Game, dock, then Restore Loadout
smoke.- The loadout survived death, because it lives in
player.cc. - Either the ship builds with the same gear on the same cells and the credits drop by the listed price, or the failure dialog lists the unavailable products and the credits are unchanged.
- The loadout survived death, because it lives in
- Launch.
- Builds and tests:
- Soul:
- The nine new tests pass.
- The negative greps hold.
- The smoke passes, including steps 7 and 9.
- Nothing in
Assets\Scriptswrites a game-state file. - Materialization changes nothing on failure.
- Loadouts name no product.
- Only the operator decides any drift from the Q10-3 rulings.
Steps needing Unity:
- 6: CultLib's Unity project.
- 8a, 8b and 10: a batchmode compile by the agent, and UPM acceptance and the play smoke by the operator.
- Cut 9 is headless.
5. Subtraction ledger
Lines are C# unless noted; sizes are measured where a file is named, bounded estimates otherwise.
| Cut | Removed | Added | Targets, dependencies, schemas |
|---|---|---|---|
| 1 | 0 | ~150 doc, ~160 test | 0 |
| 2 | CultManagedDocument.cs −355 (SoA parked at a tag, managed doc); CC −~670 (/// 461, wrappers/unused/soft/subjects ~210); CultCacheMessagePack.cs −~60; DMS −~380 (legacy formats, filter, probes, ///); CultDocumentMessagePackSerialization.cs −~100 (catalog helpers, ///); CND −~60; deleted tests ~−450 |
~40 (Loaded/Unloaded, NoWarn), ~30 (parked-features.md) |
public surface −20 members; 1 tag; 0 targets |
| 3 | ~95 (2.1/2.2 deletion lines) + ~230 (ambient transaction machinery) | ~150 impl (routing, globals, read-only, lookups) + ~70 (CultCacheBatch, Commit) + ~150 (conditions, request, outcome, TryCommit, single-file lock and conditional commit ~60, directory conditional commit ~40, StoredAt bump), ~720 test, ~30 interop peer, 1 small console project for the two-process race |
+AddBackingStore(store, Type[]), +IsReadOnly, +ReadOnly, +Commit, +TryCommit, +CultCacheBatch, +CultCommitRequest, +CultCommitOutcome; −ctor overload, −MaterializeMissingGlobals, −ContainsDurableRecord, −PullOnOpen, −ExecuteTransactionAsync ×2; −AsyncLocal, −SemaphoreSlim; +1 lock-file sidecar per single-file store |
| 4 | 1 | ~80 impl, ~110 test, 2 csproj lines | +1 assembly attribute; MessagePack's generator no longer flows to consumers |
| 5 | TS ~18, Rust ~30, Python ~20 | TS ~12 + ~40 test, Rust ~15 + ~40 test, Python ~10 + ~30 test | three version bumps |
| 6 | ~120 (reflection bridge, fallback) | ~300 editor, 1 attribute | Studio 1.0.0 -> 1.1.0, +1 package dependency |
| 7 | 2 doc lines | 2 doc lines, rebuilt DLLs | 4 tags |
| 8 (8a+8b; unsplit estimate, predates the refresh: 8a is a using swap and conversion fixes, near zero net, and 8b carries the deletes and the five Aetheria drawers) | 1,771 − ~305 kept + 30,088 + 1,963 + ~60 ≈ 33,600 | ~40 AetheriaStores, ~150 drawers, ~180 tests, ~40 props/targets, ~400 attribute/reference edits, ~120 AetherDb ≈ 930 |
−1 vendored MessagePack, −1 JsonKnownTypes, −1 asmdef; +2 UPM packages, +2 ProjectReferences, +1 test project; 20 schemas replace 1 union |
| 9 | 0 code (8b already removed OpenWithNameFiles); data: AetherDB.msgpack (46,150 bytes), 12 name files, ansi104.msgpack and .json; 30 empty untracked folders |
~250 importer (deleted in Cut 10), 2 routing lines, 1 fixture move, 1 .cc, 1 .gitattributes and 1 .gitignore line |
InputLayout routes to the catalog instead of the player store (Q9-1 A) |
| 10 | ActionGameManager ~35 (settings file I/O, SaveState, SaveLoadout/Loadouts/_loadoutPath, SaveZone), InventoryPanel 26 (rewritten), InputDisplayLayout ~120 (ParseJson 73, AssociateInputKeys 33, SaveLayout 6, reader 5), SavedGame constructor 34, MainMenu ~15, PlayerSettings 1, importer ~250, 8 doc lines |
RunSave ~55, Loadout.cs ~130, InventoryPanel ~30, StableHash ~6, ActionGameManager/MainMenu ~25, ~250 tests; schematic drawer port ~40; clear-boss-hulls generalized to dangling ~+30 |
-4 private file formats (PlayerSettings.msgpack, KeyboardLayouts\*.msgpack, .loadout, .zone); +1 schema (aetheria.loadout, player store); -1 PlayerSettings slot |
Expected net: CultLib −1,650 lines of source and −450 of tests in Cut 2,
then −325/+370 source and +720 tests in Cut 3 and +80/+110 in Cut 4: the two
Caching projects end near 3,150 lines with CultCache.cs near 1,000, against
5,259 and 2,704 today, and C# gains the conditional commit Rust already has;
the siblings shrink; Aetheria about −33,000 lines, two vendored
dependencies and four private formats gone.
Proposed follow-ups, outside this migration: remove soft from
CultMesh.FlushAsync/CultNetLocal.FlushAsync and its four external call
sites; collapse FlushOnDispose/StoreFlushOnDispose into one flag; package
the generator without the empty GameCult.Caching.MessagePack.Analyzers
project; strip /// from CultDocumentContracts.cs and
CultGeneratedDocumentMetadata.cs (180 lines untouched by these cuts); unify
the global key across runtimes (changes bytes); batch commit and conditional
commit in CultLib\packages\cultcache-ts and a cross-type all-or-nothing and
conditional batch in CultLib\packages\cultcache-py; a probe that a Rust
fs2 lock and a C# FileShare.None open on one .lock file exclude each
other, before any store is shared across runtimes.
6. Risks and rejected paths
Risks:
- Unity call sites are found by grep and proven by batchmode; expect one fixup round after each compile in Cuts 8 and 10.
- MessagePack 2.x (vendored) to 3.1.7: depth is not a risk (deepest payload 7
against a 500 limit
[P5]);[Union]on abstract bases, nullable formatters andkeyAsPropertyNametypes are the unknowns, surfaced by the round-trip tests in Cuts 8-10. - MessagePack 3's generator fails on ref-keyed maps
[P5]; after Cut 4 it no longer reaches any consumer ofGameCult.Caching.MessagePackorGameCult.Networking[P6]. A consumer that references theMessagePackpackage directly still gets it and must not use ref-keyed maps until the upstream bug is fixed. - Attach-is-hydration: a caller that attached, mutated, then pulled (none found) now throws at attach; a caller that attaches an untyped store before a routed one (none exists; every caller attaches one store) throws at the second attach; explicit pulls after attach are harmless re-pulls.
- Cut 3 replaces the ambient transaction with an explicit batch. Any consumer that relied on reading its own staged records mid-transaction would break; none exists (the only caller was a tests-only CultNet wrapper), and every sibling consumer passes explicit batches. Cut 2 parks SoA rather than retracting it.
- Conditional commit identity is
(schemaId, storedAt), not payload bytes; it is sound only with the strictly-increasingStoredAtrule, which a writer outside CultLib (another runtime writing the same file) need not obey. Rust compares whole envelopes. Until the cross-runtime lock and identity are probed together, a store is written by one runtime. - The single-file lock file is a sidecar next to every single-file store;
a store on a read-only directory cannot commit conditionally (nor could it
flush), and a stale lock file after a crash is harmless (
FileShare.Noneis released with the process). - The conditional-commit design is the one part of this map not
pre-established by a probe (
[P7]failed, section 7). Cut 3's tests carry that burden; if(schemaId, storedAt)proves insufficient there, the fallback is comparing payload bytes retained per record in the store's staging, which costs memory, not bytes on disk. - Any test or probe that spawns processes must launch an explicit host with
a child role set by an environment variable checked first, cap every loop,
and fail if a child would spawn: the
[P7]fork bomb came from launching the apphost with the dll path asargs[0]. - Deleting the v2/v3 directory formats refuses any store nobody found; if one exists it fails loudly with its format string and is rebuilt from source.
ReactivePropertyfields reachable from a document break without the vendored resolver; none found; Cut 8's Soul grep confirms.- Slot type changes are hard rejects (
CC:947-1027); Aetheria field edits need a new slot or a version bump. - The C# global key differs from TS/Python; cross-runtime
.ccbyte parity is a pre-existing gap.
Rejected paths:
- Mirrors or replication, anywhere.
- A
_pendingDefaultsset or deferred-admission queue (first pass); a_hydratedflag; materializing globals after hydration inOpenAsync. - A mutable
Optionsstatic with a set-onceConfigureResolvers(first pass). - Keeping managed documents or legacy directory formats because tests cover them. (SoA is parked, not rejected.)
- Deleting atomic commit as a capability (second pass, retracted by the
operator: multi-record commits recur in Ghostlight and Epiphany work); the
ambient
AsyncLocalimplementation is what goes, not the primitive. - Ambient in-flight visibility inside a batch: no consumer in any runtime reads its own staged records; Rust, Ghostlight and Odin all pass explicit batch values.
- Seven separate compare-exchange entry points mirroring Rust's: two conditions on the one batch cover all of them.
- Payload-byte identity for conditions: the cache does not retain bytes and
the in-memory instance may have been mutated since it was observed;
(schemaId, storedAt)with a strictly increasingstoredAtis the same fact at no memory cost. - Stripping MessagePack's generator in each consumer's build: the analyzer arrives through CultLib's reference, so CultLib owns the exclusion.
- Per-field
[MessagePackFormatter]attributes;Dictionary<string, float>instead of ref-keyed maps; a list of pairs. - A
storeIdin the file header; a save converter; aDatabaseEntryIDshim; union tags forRequireBehavior; a JSON intermediate orextern aliasfor the import; the GameCult generator inAetheria.Shared; persisting agent tasks.
7. Probes
All probes live under
C:\Users\Meta\AppData\Local\Temp\claude\F--Projects-Aetheria\2a6aec4d-7cba-481c-8586-be54662389a5\scratchpad\,
reference CultLib c2a9a6e by project, and were run with
dotnet run --project <dir>\Probe.csproj -c Debug on 2026-09-13.
| Id | Probe | Result |
|---|---|---|
| P1 | cc-global-probe: seeded file; new CultCache() (globals on) -> attach -> pull -> flush, versus OpenAsync |
new CultCache() order: after ctor entries=1 cacheDirty=True; after attach storeDirty=True; note loaded: NO; after flush note still on disk: False, file bytes changed: True. OpenAsync: note loaded: persisted; note still on disk: True, file bytes changed: False. |
| P2-A | cc-mechanics-probe (global-free registry): attach A, pull, attach B, flush, reopen B |
after pulling A: note loaded=True; after attaching B: B.IsDirty=True cache.IsDirty=True; after flush with no mutation: B file exists=True B records=1 keys=note; reopening B alone: note present=True. |
| P2-B | same: transaction with two stores | InvalidOperationException: A CultCache transaction requires zero or one durable backing store; ... |
| P2-C | same: a store whose Push throws |
upsert threw InvalidOperationException; cache.Get(key) != null = True, cache.IsDirty=False. |
| P2-D | same: base-typed lookups and watch | Watch<Base> events=0 Watch<Leaf> events=1; GetByName<Base>(alpha) null=True GetByName<Leaf>(alpha) null=False; GetGlobal<GlobalBase>() null=True GetGlobal<GlobalLeaf>() null=False; GetAll<Base>().Count=1. |
| P2-E | same: UpsertAsync<Gear>(new Weapon()), flush, inspect |
schema=probe.gear payloadArrayLength=2. |
| P3 | cc-cultnet-probe: CultNetDatabase.PutAsync<Gear>(key, new Weapon()), db.Watch<Gear>(), flush, reopen |
persisted schema=probe.gear; published change schema is Gear=True; in-memory type=Weapon; reopen: Get<Weapon> null=True; Get<Gear> type=Gear. |
| P4 | cc-generated-probe (GameCult generator, EmitCompilerGeneratedFiles) |
generated serializer present=True deserializer present=True; emitted ...g.cs:53, 65: var options = global::GameCult.Caching.MessagePack.CultDocumentMessagePackSerialization.Options;, members via options.Resolver at :57-58, 71, 75. |
| P5 | cc-import-probe: structural read of GameData\AetherDB.msgpack and one name file; depth; one Faction slot rewrite; .cc write and read-back; depth limit |
167 records; per tag: 0:13, 1:51, 2:25, 3:3, 13:12, 17:3, 29:4, 30:1, 31:18, 32:37; max nesting depth = 7 (tag 2); UntrustedData limit = 500; Australia.msgpack: outer array 2, tag 9, payload slots 3; Faction payload slots=16: 0:Binary(len16) 1-4:String 5:Map(n0) 6:Nil 7:Array(n3) 8:Array(n3) 9:Binary(len16) 10:Binary(len16) 11:Integer 12:Map(n12) 13-15:Integer; stock options: TypeAccessException: No hash-resistant equality comparer available for type: GameCult.Caching.CultRecordRef; with the security subclass: key=bbd619ed-… Name=Adrasteia Geoname=95c298ae-… Allegiance=12; reopened from .cc: … schema=aetheria.faction … Allegiance=12 payloadSlots=16; depth 100: ok; 499: ok; 600: MessagePackSerializationException. Build: with MessagePack's generator active, CS0426: The type name 'GameCult' does not exist in the type 'GeneratedMessagePackResolver' (emitted case 0: return new global::MessagePack.GeneratedMessagePackResolver.GameCult.Caching.CultRecordRefFormatter<…>()); ExcludeAssets="analyzers" on direct references to MessagePack, MessagePack.Annotations, MessagePackAnalyzer does not remove it; an Analyzer Remove target BeforeTargets="CoreCompile" does. |
| P6 | cc-analyzer-probe: scratch library Lib (netstandard2.1, MessagePack 3.1.7, a generic Ref<T> struct with a custom formatter and resolver, standing in for GameCult.Caching.MessagePack) and a consumer App declaring Dictionary<Ref<Doc>, float>; four library shapes built with dotnet build App\App.csproj -c Debug -p:<variant> | default: CS0426: The type name 'Lib' does not exist in the type 'GeneratedMessagePackResolver'; ExcludeAssets="analyzers" PrivateAssets="analyzers" on Lib's MessagePack reference: same error; [assembly: MessagePackKnownFormatter(typeof(RefFormatter<>))] in Lib: same error (emitted case 0: return new global::MessagePack.GeneratedMessagePackResolver.Lib.RefFormatter<global::App.Doc>();); <PackageReference Include="MessagePackAnalyzer" Version="3.1.7" PrivateAssets="all" /> in Lib: Build succeeded. |
| E1 | grep evidence (no code run) for the batch-commit shape | TS cultcache-ts\src\*.ts: no batch, transaction or atomic member; Python CultLib\packages\cultcache-py\src\cultcache_py\cache.py:227-251 put_envelopes only, called from CultLib\packages\cultnet-py\src\cultnet_py\replication.py:98; Rust cache-level put_prepared_batch (CultLib\packages\cultcache-rs\src\lib.rs:2162-2201): no caller in CultLib\packages or in Odin, Idunn, Epiphany, CodexConnector, Ghostlight, Muninn, Ratatoskr; Rust store-level compare_exchange*/compare_and_swap*/delete_batch_if_unchanged (CultLib\packages\cultcache-rs\src\lib.rs:397-800): Odin 12 sites, Idunn 31, CodexConnector 1, Ghostlight ghostlight-dungeon\src\app_session.rs:119, 371 (+3 tests) and Ghostlight\crates\ghostlight-dungeon\src\world\consumer.rs:788 ("a malformed or stale batch commits nothing"); Epiphany's crates: none. Every call passes an explicit expected/replacement batch; none reads staged state mid-commit. |
| P7 | cc-cas-probe: conditional commit over the existing single-file snapshot format, implemented in the probe (identity (schemaId, storedAt), <file>.lock with FileShare.None, temp then File.Replace), meant to race two child processes on one file | UNVERIFIED, no result recorded. The race step launched Environment.ProcessPath (the apphost) with the dll path as args[0], so no child took the race branch; each re-ran the parent and spawned two more, an exponential fork bomb that locked the workstation three times. Its output was never captured (buffered behind tail), so not even the single-process identity, per-entry and snapshot observations that ran before the spawn can be cited. The coordinator patched the source (environment-variable child role checked first, explicit dotnet <dll> host); it has not been re-run and must not be run in this pass. Every (schemaId, storedAt) and lock claim in 2.2 is therefore design, proven by Cut 3's ConditionalCommitTests.cs, not by a probe. |
Not established by running code, marked as design: the routed C# cache
itself (Cut 3's tests are its proof); the Studio's reflective struct path over
Unity.Mathematics (Cut 6's operator check); how AquaSynth reads its
[CultGlobal] types (Cut 3's Soul step reports it here).