Mimir/docs/sensor-fusion-architecture.md
2026-05-23 18:12:31 +01:00

31 lines
1 KiB
Markdown

# Sensor Fusion Architecture
Visual fusion belongs in Fensalir over current Mimir runtime buffers.
## Live Flow
```mermaid
flowchart TD
A["direct camera drivers"] --> B["Mimir.Runtime video buffers"]
C["Leap stereo IR driver"] --> B
B --> D["native reservoir handles"]
D --> E["Fensalir GPU feature extraction"]
E --> F["cross-view matching + flow"]
F --> G["surface/material claims"]
G --> H["brush/splat render budget"]
H --> I["Spout2/program video"]
```
## Invariants
- Device timestamps beat arrival timestamps when available.
- Leap is the first timing-camera candidate.
- Process capture is a bridge edge, not the local six-camera foundation.
- Fensalir owns GPU extraction, fusion, material fitting, and render budgeting.
- Runtime buffers own retention and stream health, not scene reconstruction.
## Next Cut
Implement one concrete direct capture driver, feed `MimirVideoFrameDescriptor`
samples into `MimirVideoCaptureDriverSource`, and measure sustained cadence over
the default five-second window.