Results / Gemma 4 12B QAT (LM Studio, Mac mini)
Gemma 4 12B QAT (LM Studio, Mac mini)
mswea-mac-gemma12blmstudioMac mini M4unsteered
The game opens in a new tab. It runs sandboxed, so a game that saves to browser storage may not keep its save.
Metrics
- Checklist score
- 36.8 / 100
- Design (rubric, 0–5)
- –
- Stop reason
- done
- Model time
- 1hr 7mins
- Tool time (wall minus model)
- 10mins
- Wall time
- 1hr 16mins
- Tool calls
- 16
- Tool errors
- 2
- Errors by type
- {"format": 2}
- Loop-guard events
- –
- Tokens in / out
- – / –
- Thinking tokens
- –
- Decode / prefill tok/s
- – / –
- Prefix reuse
- –
- Peak VRAM (GPU / engine)
- 11,646 / 0 MiB
- Peak engine RAM
- 0 MiB
- Engine
- lmstudio
- Model
- Gemma 4 12B QAT (LM Studio, Mac mini) (google/gemma-4-12b-qat)
- Settings
- {"thinking": "medium", "reasoning_budget_tokens": 3072, "max_tokens": 7168, "sampling": "Gemma 4 card preset (t 1.0, top_p 0.95, top_k 64)", "sampling_keys": {"temperature": 1.0, "top_p": 0.95, "top_k": 64}, "loaded": "LM Studio, context 65536 (fallback)"}
- Node
- Mac mini M4
- Prompt
- v1
- Started
- 2026-10-08T04:51:25Z
Feature scores
- O
- 1
- F1
- 0.83
- G
- 0
- F2
- 0
- F3
- 0
- F4
- 0
- F5
- 0
- F8
- 0
- F6
- 0
- F9
- 0
- R
- 0
Screenshots
Landing page at desktop and phone widths, and the game at noon, at night, after breaking a block, and on a phone.
Checklist (6 pass, 2 partial, 11 fail)
| Feature | Test | Score | Evidence |
|---|---|---|---|
| O | files_present | 1 | {"required": ["index.html", "game.html"], "notes_md": true} |
| F1 | landing_loads | 1 | {"status": 200, "errors": [], "network_failed": []} |
| F1 | hero_preview | 0.5 | {"std": 22.8, "frame_diff": 0, "size": [1226, 484]} |
| F1 | gallery | 1 | {"images": 3, "generated_nonblank": 3, "distinct": 3, "detail": ["1280x474 std 9.8", "1280x474 std 55.9", "1280x474 std 22"]} |
| F1 | landing_content | 1 | {"h1": "Aetheria Voxel", "features": 4, "controls": 202, "play": true} |
| F1 | play_now | 0.5 | {"url": "/game.html", "game_ready": false} |
| F1 | responsive_mobile | 1 | {"no_horizontal_scroll": true, "play_now_fits": true, "title_fits": true, "inner": 390, "scroll": 390, "play": [94, 296, 203], "h1": [16, 374, 358]} |
| G | game_loads | 0 | {"exception": "Waiting failed: 25000ms exceeded"} |
| G | canvas_renders | 0 | {"skipped": "game did not load"} |
| G | fps | 0 | {"skipped": "game did not load"} |
| F2 | terrain | 0 | {"skipped": "game did not load"} |
| F3 | movement | 0 | {"skipped": "game did not load"} |
| F4 | break_place | 0 | {"skipped": "game did not load"} |
| F5 | hotbar | 0 | {"skipped": "game did not load"} |
| F8 | save_reload | 0 | {"skipped": "game did not load"} |
| F6 | day_night | 0 | {"exception": "Waiting failed: 25000ms exceeded"} |
| F9 | touch | 0 | {"exception": "Waiting failed: 25000ms exceeded"} |
| R | render_integrity | 0 | {"exception": "Waiting failed: 25000ms exceeded"} |
| O | self_contained | 1 | {"no_external_requests": true, "pinned_three": true, "no_third_party_branding": true, "external": [], "branded_files": []} |
Suite 1.2.0 · Chrome/152.0.7977.82 · WebGL: ANGLE (Intel, Vulkan 1.4.354 (Intel(R) UHD Graphics 630 (CML GT2) (0x00009BC8)), Intel open-source Mesa driver)
Steers
None: an unsteered run gets the prompt and nothing else.