monster/modelbeast
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

BENCHMARKS: first local-vs-cloud image A/B (Klein 4B vs nano-banana)

Browse Source 
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
MODELBEAST 2026-07-12 23:27:37 +10:00
parent 7c0914f714
commit 6c54091130
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
BENCHMARKS.md
View File

@ -20,6 +20,8 @@ and a much crisper splat than the 1500-step preview above.
Warm-model runs are the ~8s figure; each new model variant pays its download once.
**First A/B (same prompt, 2026-07-12):** FLUX.2 Klein 4B local (8s, $0) vs nano-banana via OpenRouter (`google/gemini-2.5-flash-image`, 7.7s, $0.0387 exact-billed). Klein: cleaner product-photo subject. nano-banana: richer scene dressing (books/inkwell/quill, dust motes) + finer engraving detail. Verdict: Klein is the volume workhorse; nano-banana wins on scene storytelling per prompt-adherence expectations (Elo 1154 vs ~1083).
## Mesh-gen (installed; first real run blocked on owner HuggingFace auth)
| Operator | Install | Runtime status |
|---|---|---|