From 545f7a347d49a08de7fc3b73d872f4dcadfe9039 Mon Sep 17 00:00:00 2001 From: m3ultra Date: Fri, 17 Jul 2026 17:08:44 +1000 Subject: [PATCH] Plan: Phase 5 spec + directives round 4 (M10-M17, lanes E/F/G) plan/20-phase5.md is the phase-5 canonical spec: M10 beats/onsets, M11 auto-director, M12 cinematic export (lane E); M13 anchor manager + friend tags, M14 photo mode, M15 moment FX (lane F); M16 server-side camera paths, M17 static memory-capsule export (lane G). foundation2 freezes the new contracts (beats.json, camPath JSON, paths table, PATCH anchors, __F4D_API_BASE__ / manifest.capsule, transport/scene3d hooks) and pre-wires all UI so parallel lanes never touch shared files. DIRECTIVES Round 4 records the fresh-eyes upgrades (FFT caching, WebAudio master clock, spatial audio; suite floor now 121), ratifies the additive contract amendments, and sets run order: foundation2 -> E, G, F (own worktrees, mandatory) -> integration2 (real-footage field test, v0.2.0 proposal). Co-Authored-By: Claude Fable 5 --- docs/ideas.md | 6 ++ plan/20-phase5.md | 198 ++++++++++++++++++++++++++++++++++++++++ plan/DIRECTIVES.md | 41 +++++++++ plan/README.md | 4 + plan/lane-E-director.md | 18 ++++ plan/lane-F-social.md | 17 ++++ plan/lane-G-capsule.md | 17 ++++ 7 files changed, 301 insertions(+) create mode 100644 plan/20-phase5.md create mode 100644 plan/lane-E-director.md create mode 100644 plan/lane-F-social.md create mode 100644 plan/lane-G-capsule.md diff --git a/docs/ideas.md b/docs/ideas.md index c2b1c42..7588e5e 100644 --- a/docs/ideas.md +++ b/docs/ideas.md @@ -3,6 +3,12 @@ Parking lot for post-v0.1.0 extensions (spec Β§5 future-extensions). Not committed work β€” a place to capture direction so the prototype's scope stays honest. Roughly ordered by payoff-to-effort. +> **Status 2026-07-17:** splatting βœ… shipped (see `modelbeast-crossover.md`); spatial audio βœ… +> shipped (🎧, WebAudio master clock). Cinematic export β†’ **M12**, multi-modal audio analysis β†’ +> **M10/M11**, anchor manager β†’ **M13**, path persistence β†’ **M16** β€” all now specced in +> `plan/20-phase5.md`. Still parked here: realtime ingest, object/artist tracking, +> per-project workspaces, sync-graph visualization, per-moment splats (crossover doc Β§3). + ## Neural rendering β€” Gaussian Splatting Replace the sparse COLMAP point cloud with a **3D Gaussian Splatting** model for photorealistic free-roam instead of a dot cloud. COLMAP poses + images already feed splatting trainers diff --git a/plan/20-phase5.md b/plan/20-phase5.md new file mode 100644 index 0000000..938e6a8 --- /dev/null +++ b/plan/20-phase5.md @@ -0,0 +1,198 @@ +# Phase 5 β€” Friends, Director's Cut & Capsules (M10–M17) + +Canonical spec for the phase-5 milestones. **M0–M9 live in [`../OPUS_BUILD_INSTRUCTIONS.md`](../OPUS_BUILD_INSTRUCTIONS.md) +and every contract frozen there still applies** (timebase, DB schema, pose convention, +classifier contract, synthetic fixture). Standing protocol (status files, directives loop, +evidence discipline, worktrees) is unchanged from [`README.md`](README.md); the newest round of +[`DIRECTIVES.md`](DIRECTIVES.md) always wins. + +## Context β€” what shipped since v0.1.0 (read before planning anything) + +- **Splat rendering:** `GET /api/splat` + viewer `DropInViewer` with point-cloud fallback + (`docs/modelbeast-crossover.md`). +- **Live capture:** `FESTIVAL4D_CAPTURE=1` mounts `/capture` (README). +- **WebAudio master clock:** `t_global` derives from `AudioContext.currentTime`; + `GET /api/audio/{id}` serves a lazily-extracted stereo AAC per video; all `