From 4b73b9062587bcfa10f73fc5135b17c0a98f925d Mon Sep 17 00:00:00 2001 From: MODELBEAST Date: Mon, 13 Jul 2026 10:23:37 +1000 Subject: [PATCH] =?UTF-8?q?BENCHMARKS:=20TRELLIS.2=20local=20working=20?= =?UTF-8?q?=E2=80=94=20289s/~4.8min=20gen,=20SOTA=20quality?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit trellis_mac verified end-to-end: 18.4MB PBR GLB, clean coherent geometry on a thin-ringed astrolabe (far beyond SF3D draft quality). ~15GB one-time download then ~5min cached generation. All three local image->3D paths now live: sf3d (fast draft), trellis_mac (SOTA local), plus fal cloud tier. Co-Authored-By: Claude Opus 4.8 --- BENCHMARKS.md | 11 ++++++++++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/BENCHMARKS.md b/BENCHMARKS.md index 4f08cd6..e6a6dfe 100644 --- a/BENCHMARKS.md +++ b/BENCHMARKS.md @@ -31,7 +31,16 @@ First-run downloads (one-time): schnell/dev ~31GB & ~16–19 min each, Klein 9B **First A/B (same prompt, 2026-07-12):** FLUX.2 Klein 4B local (8s, $0) vs nano-banana via OpenRouter (`google/gemini-2.5-flash-image`, 7.7s, $0.0387 exact-billed). Klein: cleaner product-photo subject. nano-banana: richer scene dressing (books/inkwell/quill, dust motes) + finer engraving detail. Verdict: Klein is the volume workhorse; nano-banana wins on scene storytelling per prompt-adherence expectations (Elo 1154 vs ~1083). -## Mesh-gen (installed; first real run blocked on owner HuggingFace auth) +## Mesh-gen (local, validated 2026-07-13) +| Operator | Config | Result | +|---|---|---| +| `sf3d` | image → GLB, MPS, tex 1024 | **~5s**, ~9GB peak, 1.5MB GLB. Fast draft tier — good on solid objects, struggles on thin/open geometry. Needs `OMP_NUM_THREADS=1`+`KMP_DUPLICATE_LIB_OK` (segfaults otherwise). | +| `trellis_mac` | TRELLIS.2-4B, pipeline 1024, tex 2048, MPS | **289s (~4.8 min) generation** + 16s bake, 18.4MB GLB with PBR. SOTA-tier local quality — clean coherent geometry even on a thin-ringed astrolabe (dramatically better than SF3D). First run adds a one-time ~15GB download (~30 min); cached after. Needs `HF_HUB_DISABLE_XET=1` + the OMP guards. | +| `bg_remove_local` | RMBG-2.0, MPS, 1024 | seconds; clean transparent cutout. Run before SF3D for a big geometry improvement. Note: keeps original RGB under alpha (upscale before cutout). | + +**Local image→3D verdict:** `trellis_mac` for hero assets (~5 min, SOTA), `sf3d` for fast drafts (~5s). Both free/offline; fal cloud (`fal_trellis2` etc.) for on-demand SOTA without the local wait. + +## Mesh-gen — earlier install notes (superseded by the table above) | Operator | Install | Runtime status | |---|---|---| | `sf3d` | venv + Metal texture_baker/uv_unwrapper kernels compiled OK; torch 2.13 MPS available | Runs end-to-end; **weights gated** — `stabilityai/stable-fast-3d` returns `GatedRepoError` until the owner accepts the license + sets an HF token. Then expect seconds-to-a-minute on MPS. |