Results / Gemma 4 12B QAT (LM Studio, Mac mini)
Gemma 4 12B QAT (LM Studio, Mac mini)
mswea-mac-gemma12blmstudioMac mini M4unsteered
The game opens in a new tab. It runs sandboxed, so a game that saves to browser storage may not keep its save.
Metrics
- Checklist score
- 28.9 / 100
- Design (rubric, 0–5)
- –
- Stop reason
- done
- Model time
- 37mins
- Tool time (wall minus model)
- 52mins
- Wall time
- 1hr 29mins
- Tool calls
- 8
- Tool errors
- 1
- Errors by type
- {"format": 1}
- Loop-guard events
- –
- Tokens in / out
- – / –
- Thinking tokens
- –
- Decode / prefill tok/s
- – / –
- Prefix reuse
- –
- Peak VRAM (GPU / engine)
- 11,646 / 0 MiB
- Peak engine RAM
- 0 MiB
- Engine
- lmstudio
- Model
- Gemma 4 12B QAT (LM Studio, Mac mini) (google/gemma-4-12b-qat)
- Settings
- {"thinking": "medium", "reasoning_budget_tokens": 3072, "max_tokens": 7168, "sampling": "Gemma 4 card preset (t 1.0, top_p 0.95, top_k 64)", "sampling_keys": {"temperature": 1.0, "top_p": 0.95, "top_k": 64}, "loaded": "LM Studio, context 65536 (fallback)"}
- Node
- Mac mini M4
- Prompt
- v1
- Started
- 2026-10-08T08:18:45Z
Feature scores
- O
- 1
- F1
- 0.58
- G
- 0
- F2
- 0
- F3
- 0
- F4
- 0
- F5
- 0
- F8
- 0
- F6
- 0
- F9
- 0
- R
- 0
Screenshots
Landing page at desktop and phone widths, and the game at noon, at night, after breaking a block, and on a phone.
Checklist (5 pass, 1 partial, 13 fail)
| Feature | Test | Score | Evidence |
|---|---|---|---|
| O | files_present | 1 | {"required": ["index.html", "game.html"], "notes_md": true} |
| F1 | landing_loads | 0 | {"status": 200, "errors": ["Cannot read properties of undefined (reading 'toDataURL')\nhttp://127.0.0.1:36109/index.html:132:46"], "network_failed": []} |
| F1 | hero_preview | 1 | {"std": 17.3, "frame_diff": 1.7, "size": [600, 300]} |
| F1 | gallery | 0 | {"images": 0, "generated_nonblank": 0, "distinct": 0, "detail": []} |
| F1 | landing_content | 1 | {"h1": "Voxelia", "features": 4, "controls": 215, "play": true} |
| F1 | play_now | 0.5 | {"url": "/game.html", "game_ready": false} |
| F1 | responsive_mobile | 1 | {"no_horizontal_scroll": true, "play_now_fits": true, "title_fits": true, "inner": 390, "scroll": 390, "play": [104, 286, 181], "h1": [113, 277, 165]} |
| G | game_loads | 0 | {"exception": "Waiting failed: 25000ms exceeded"} |
| G | canvas_renders | 0 | {"skipped": "game did not load"} |
| G | fps | 0 | {"skipped": "game did not load"} |
| F2 | terrain | 0 | {"skipped": "game did not load"} |
| F3 | movement | 0 | {"skipped": "game did not load"} |
| F4 | break_place | 0 | {"skipped": "game did not load"} |
| F5 | hotbar | 0 | {"skipped": "game did not load"} |
| F8 | save_reload | 0 | {"skipped": "game did not load"} |
| F6 | day_night | 0 | {"exception": "Waiting failed: 25000ms exceeded"} |
| F9 | touch | 0 | {"exception": "Waiting failed: 25000ms exceeded"} |
| R | render_integrity | 0 | {"exception": "Waiting failed: 25000ms exceeded"} |
| O | self_contained | 1 | {"no_external_requests": true, "pinned_three": true, "no_third_party_branding": true, "external": [], "branded_files": []} |
Suite 1.2.0 · Chrome/152.0.7977.82 · WebGL: ANGLE (Intel, Vulkan 1.4.354 (Intel(R) UHD Graphics 630 (CML GT2) (0x00009BC8)), Intel open-source Mesa driver)
Steers
None: an unsteered run gets the prompt and nothing else.