3.2 KiB
OBS Spout Streaming
Objective
Publish the live visual fusion state as a named GPU texture that OBS can receive through the Spout2 plugin.
This is the deadline stream surface. It is not a preview window and it is not a desktop-capture workaround. LocalCastBridge emits a typed render-frame packet; the Spout sink turns that packet into a GPU texture named for OBS.
Current Mechanism
flowchart TD
A["TrackCache / demo source"] --> B["RenderFramePacket JSON"]
B --> C["scripts/stream_spout.py"]
C --> D["ScreenBrushPacket lowering"]
D --> E["OpenGL texture/FBO"]
E --> F["Spout sender texture"]
F --> G["OBS Spout2 Capture"]
Aquarium Engine remains the intended authority for dense brush/splat rendering. The useful boundary is RenderFramePacket: Aquarium can replace the OpenGL renderer behind the same packet contract without changing capture, fusion, timing, or OBS ingestion.
The deadline sink borrows the Zyphos brush rule rather than pretending points are enough: each render point lowers into a compact anisotropic screen brush with center, radii, rotation, and color. That shape mirrors Aquarium's bounded brush/splat direction while keeping the stream path simple enough to verify under pressure.
Run
Install calibration/runtime dependencies once:
.\.venv\Scripts\python.exe -m pip install -r .\requirements-calibration.txt
Start the Spout sender:
.\.venv\Scripts\python.exe .\scripts\stream_spout.py `
--frame-json .\calibration\runs\live-render-frame.json `
--demo-if-missing `
--sender-name "LocalCastBridge Point Cloud" `
--width 1920 `
--height 1080 `
--fps 60 `
--status .\calibration\runs\stream-spout-status.json
For OBS, add a Spout2 Capture source and select LocalCastBridge Point Cloud. On this workstation, OBS websocket was enabled locally and the Off World Live win-spout plugin was installed under C:\ProgramData\obs-studio\plugins\win-spout.
Status
The sender writes a heartbeat JSON file:
Get-Content .\calibration\runs\stream-spout-status.json
Fields:
sender_name: the Spout sender OBS should see.frames_sent: count of successfulsendTexturecalls.point_count: number of packet points in the last status update.frame_path: packet source path.last_error:nullduring healthy output.
Invariants
- OBS receives a named Spout texture.
- The Spout sink owns presentation only; it does not own camera calibration, fusion, or scene truth.
- JSON packet polling is a deadline ABI. The field contract survives; the transport can become shared memory or Aquarium runtime state later.
- Latency is explicit in the packet timestamps. The renderer may buffer, but it may not silently erase the visual/audio alignment fields.
Aquarium Cut
The next renderer cut is to move the RenderFramePacket consumer into Aquarium Engine:
RenderFramePacket
-> Aquarium typed runtime state
-> compact anisotropic brush/splat buffers
-> D3D render target
-> Spout2 sender texture
-> OBS Spout2 Capture
That is the coherent route to millions of splats. The current OpenGL sender exists so the stream has a live OBS texture today while preserving the boundary Aquarium needs tomorrow.