benchmarks: first trellis_mac vs fal trellis-2 head-to-head — local faster, quality gap = hole-fill + pre-simplify

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
m3ultra 2026-07-19 00:22:41 +10:00
parent 2734ef9107
commit daa6124dcf

View File

@ -82,3 +82,25 @@ pieces matter, and the community has replaced all four. The open work is
- Local: HANDOFF_HY3D_MLX.md, CORRIDORKEY.md, BENCHMARKS.md, - Local: HANDOFF_HY3D_MLX.md, CORRIDORKEY.md, BENCHMARKS.md,
vendor/trellis-mac/README, vendor/corridorkey-mlx/prompts/ (the 6-phase vendor/trellis-mac/README, vendor/corridorkey-mlx/prompts/ (the 6-phase
parity-first port template — the blueprint if we ever do ladder step 3) parity-first port template — the blueprint if we ever do ladder step 3)
## First benchmark (2026-07-19, m3ultra, anatomy écorché test image)
| run | tris | time | peak mem | cost |
|---|---|---|---|---|
| trellis_mac 1024-cascade, tex 2048 | 191,336 | **124.8 s** compute (248.8 s wall, 103 s load) | 20.8 GB | $0 |
| fal trellis-2, same image | 468,049 | 298.6 s wall (queue incl.) | — | $0.30 |
**Local already beats fal on wall-clock.** Quality is the gap, not speed:
the local master shows shattered dark patches — CuMesh hole-fill skipped +
forced 858k→191k pre-simplify before baking (the un-simplified master IS
saved as .obj alongside the GLB). Fix quality first, then fuse kernels.
Tri-budget ladder (Blender decimate on the fal master): 2k = confetti
(ratio floors at 0.01 → 4,674 min), 8k = torn, 30k = good, 50k ≈ master.
**Écorché-class meshes (many disconnected thin shells) cannot pure-decimate
below ~30k** — game budgets need the MESHGOD solidify/remesh route.
Discovered in passing: MESHGOD finish_glb.py's tri budget is silently
ignored on Blender 5 (modifier_apply cancels — fix task spawned 2026-07-19).
Bench artifacts: m3ultra ~/Documents/trellis2-bench/ (masters, sweeps,
renders, logs, sweep2.csv / sweep_fal.csv).