Lane A: grammar.js (shot/angle/focal/light/mark data), presets.js (bbox shot solver, light/mark appliers, DIRECT bar UI, NL box), stage video plates (VideoTexture plane/corner/dome, screen kind, syncVideos), dock video cards. Lane B: scenegod:direct → grouped-undo keys/cuts, 🗣 lip-sync from audio via /rhubarb, Cmd+wheel zoom / wheel scroll, audio trim, video clock-follow via nullable entityVideo seam. Lane C: POST /director (LLM proxy, server-side op validation vs vocab+scene, mock-tested), render.js awaits stage.syncVideos. Sync6 (orchestrator): VIDEO_EXTS in server tree/media types (video primary, img poster as thumb), stage.entityVideo accessor, syncVideos forces videoTex.needsUpdate (rVFC never fires in hidden tabs → black plates). Verified: 9 server groups + timeline + presets suites green; browser SYNC: one-click MCU framing lands camera+fov keys+cut (single undo), golden_hour relight keys, plate scrub-follow frame-exact, finalRender mp4 shows the Flow golden-hour street plate behind an animated character. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> |
||
|---|---|---|
| .claude | ||
| lanes | ||
| logs | ||
| scenegod | ||
| scripts | ||
| .gitignore | ||
| CLAUDE.md | ||
| PLAN.md | ||
| README.md | ||
| requirements.txt | ||
SCENEGOD — machinima director's sandbox
Drop characters, Mixamo clips, and photo backdrops onto a 3D stage; keyframe transforms, cameras (with cuts), and lights on a timeline; render an mp4 with muxed audio. The Movies / Source Filmmaker energy on the GODVERSE stack.
Run
.venv/bin/uvicorn scenegod.server:app --port 8020
# → http://127.0.0.1:8020
Assets live in assets/{characters,animations,props,backdrops,audio}/
(plain folders, scanned live — files sharing dir+stem are one entry; a
same-stem image becomes the thumbnail). Scenes save to scenes/*.json,
renders to renders/ (reaped after 48h).
What works (v1)
- GLB/FBX/OBJ characters & props; spec-gloss (Character Creator) GLBs are converted on load. Image backdrops: flat plane, corner, or 360 dome.
- Mixamo-style clip retarget onto any mixamorig-named skeleton, client-side (world-space rotation-delta bake, ported from MESHGOD rigroom).
- Timeline: transform + param keyframes with easing, clip blocks with
trim/loop/crossfade, multiple cameras + cut list, keyframable sun/ambient,
audio tracks (Web Audio preview; server-side ffmpeg mux in the final mp4),
viseme/morph track with Rhubarb JSON import (
GET /rhubarb?path=if the rhubarb binary is installed). - Render: draft webm (MediaRecorder) or deterministic PNG-sequence → ffmpeg h264 (+aac) mp4 at any resolution.
scripts/graft_limb.py: headless-Blender armature graft (add a rigged hand/limb to a rigged body; refuses when the bones already exist).scripts/test_server.py(9 groups) +node scenegod/web/timeline_test.mjs.
Repo docs
PLAN.md — architecture, scene-JSON schema, module contracts, milestones.
CLAUDE.md — lane-agent protocol (3 parallel Opus lanes + orchestrator),
stack rules, inherited gotchas. lanes/ + logs/ — per-lane instructions
and session logs; the build history of this repo is readable there.