PROCITY/pipeline

PROCITY pipeline (Lane E) — how to re-run everything

The asset pipeline: audit ultra's library → normalize the good bits to house GLB law → publish to the 3GOD depot → ship web/assets/manifest.json (the contract Lanes B/C/D read) → fill facade

• prop gaps. Everything is optional at runtime — the game runs asset-free; this lane makes it gorgeous, it doesn't make it work.

Where things live

what	where
ultra (library + Blender)	ssh johnking@100.91.239.7 — key auth, no coreutils/timeout, py3.9, Blender at /Applications/Blender.app/Contents/MacOS/Blender (not on PATH)
model library	ultra ~/Documents/3D=models/{shop-fittings,street-furniture,furniture,props-scenes}
3GOD depot	https://digalot.fyi/3god — GET /a/<f>, GET /api/list, POST /api/upload?name=<f>
OpenRouter key (skins)	env OPENROUTER_KEY or ~/Documents/dealgod/lore/keys.env (never committed)
depot password (publish)	env GOD3_PW (never committed; ask John) — cookie = hmac(GOD3_PW,"3god-ok")
Ollama (free LLM)	http://100.89.131.57:11434 (qwen3) — for names/lore/cataloguing, unused so far
MODELBEAST (free local gen)	this box, ~/Documents/MODELBEAST. flux_local = FLUX.2-klein-4B text→image on MPS (used for the facade skins — ungated, weights cached). sf3d/trellis_mac = image→GLB, local but HF-gated (setup needed)

The steps (each is idempotent / resumable)

1. Audit — AUDIT.md (free)

scp pipeline/glb_stat.py johnking@100.91.239.7:/tmp/
ssh johnking@100.91.239.7 'cd ~/Documents/3D=models && python3 /tmp/glb_stat.py --json shop-fittings street-furniture furniture props-scenes' > pipeline/_audit_stats.json

glb_stat.py is a dependency-free GLB parser (tris, bbox, texture sizes, Draco flag). Findings + licensing triage are written up in AUDIT.md.

2. Normalize — normalize.py → 16 GLBs + thumbs (free, runs on ultra)

scp pipeline/normalize.py pipeline/batch.json johnking@100.91.239.7:/tmp/
BL=/Applications/Blender.app/Contents/MacOS/Blender
ssh johnking@100.91.239.7 "\$BL --background --python /tmp/normalize.py -- /tmp/batch.json /tmp/procity_norm"
scp johnking@100.91.239.7:/tmp/procity_norm/_results.json pipeline/_normalize_results.json
scp 'johnking@100.91.239.7:/tmp/procity_norm/thumbs/*.png' web/assets/thumbs/
scp 'johnking@100.91.239.7:/tmp/procity_norm/*.glb' pipeline/_normalized/

Enforces the house GLB law (metres, +Y up, base origin, ≤5k tris, WebP ≤1024, no Draco), renders a 256px thumbnail each. Extends MESHGOD/scripts/finish_glb.py (solidify/decimate/bright/base-origin)

• adds texture-webp, height-normalize, outlier cleanup, per-asset up/yaw. Edit batch.json to add assets; always eyeball the thumbnails — node-transform-distorted sources (see AUDIT rejects) look fine in-frame but have wrong footprints.

3. Manifest — build_manifest.py + validate_manifest.py (free)

python3 pipeline/build_manifest.py          # → web/assets/manifest.json
python3 pipeline/validate_manifest.py       # Lane F gate: 0 errors = green
python3 pipeline/validate_manifest.py --depot   # stricter: require GLBs live on the depot

build_manifest.py derives skins from web/assets/gen/ + fittings from _normalize_results.json; the curated facade→shop-type maps live at the top of that file (edit there when adding skins).

4. Publish — publish.py → 3GOD depot (the one outward-facing step)

python3 pipeline/publish.py --dry-run        # free: list what would upload
export GOD3_PW=...                           # ask John
python3 pipeline/publish.py                  # POST each GLB + thumb to the depot (idempotent)

5. Facade skin gaps — gen_skins.py --local (DONE, free, on-device)

The 23-skin gap pack is already generated + harvested + mapped. To re-run or extend:

python3 pipeline/gen_skins.py --local --dry-run   # free: list the pack, no GPU
python3 pipeline/gen_skins.py --local             # MODELBEAST flux2-klein-4b on MPS → .genraw/ (~5.7s/img)
python3 pipeline/gen_skins.py --harvest           # → web/assets/gen/facade-*.jpg, then re-run build_manifest.py

--local drives ~/Documents/MODELBEAST/server/operators/flux_local/run.py directly (no server, no key, weights cached). It runs one GPU job at a time. Add skins by editing PROMPTS in gen_skins.py and their shop-type map in build_manifest.py (FACADE_TYPES). Always eyeball .genraw/ and delete rejects before --harvest. Cloud fallback (drop --local): OpenRouter google/gemini-3.1-flash-image, ~$0.004/img, needs OPENROUTER_KEY. Manual flow: SKIN_PROMPTS.md.

6. Bespoke hero props — gen_props.py (MODELBEAST) (round-3: DONE, free, on-device)

The meshgod_batch.json gap list now goes through MODELBEAST instead of fal.ai — free, local:

python3 pipeline/gen_props.py --dry-run                 # list props + what's done
python3 pipeline/gen_props.py --concepts                # flux_local concept images → .genprops/*.png (eyeball!)
python3 pipeline/gen_props.py --mesh --only glass-case  # trellis_mac 1024_cascade image→GLB (~5-8 min)
python3 pipeline/gen_props.py --mesh                    # all props with a concept, no glb
# then normalize (uses local Blender), stage, catalogue:
BL=/Applications/Blender.app/Contents/MacOS/Blender
"$BL" --background --python pipeline/normalize.py -- pipeline/batch_props.json pipeline/_normalized web/assets/thumbs
cp pipeline/_normalized/_results.json pipeline/_props_results.json && python3 pipeline/build_manifest.py

5 shipped (arcade_cabinet, listening_booth, drinks_fridge, milkshake_mixer, novelty_record) + cash-register reused from depot. magazine-rack → primitive (thin-wire gotcha); glass-case/bus-shelter → fal.ai fallback (TRELLIS can't do transparent glass; sf3d --draft gives a featureless blob). TRELLIS meshes run heavy (25–77k tris) — see AUDIT provenance. Eyeball every thumbnail; ≤2 local attempts then fal (John's go).

7. Local-depot mode — loaders.js ?localdepot=1 + stage_local_depot.py (round-3: DONE)

Lets Lanes B/C/F validate GLB loading with no network / before publish:

python3 pipeline/stage_local_depot.py     # mirror _normalized/*.glb → web/assets/models/ (git-ignored)
# then load the game with ?localdepot=1 — depot:<file> resolves to assets/models/<file> instead of the CDN

Cost summary

step	cost
audit, normalize, manifest, validate, publish	free (compute + bandwidth)
facade skin gap-fill (23 imgs)	free — done on-device (MODELBEAST flux_local); cloud fallback ~9¢
MeshGod hero props (9 solids)	~$2.70 — gated on John (local sf3d/trellis_mac is free but HF-gated)

Artifacts (not committed — regenerated from the steps)

pipeline/_normalized/ (staging GLBs, live on depot), pipeline/.genraw/ (raw skin gen). Committed: the scripts, *.md, batch.json, meshgod_batch.json, _audit_stats.json, _normalize_results.json, web/assets/manifest.json, web/assets/thumbs/, docs/shots/laneE/.