Results / Gemma 4 12B QAT (LM Studio, Mac mini)
Gemma 4 12B QAT (LM Studio, Mac mini)
omplmstudioMac mini M4unsteered
The game opens in a new tab. It runs sandboxed, so a game that saves to browser storage may not keep its save.
Metrics
- Checklist score
- 13.2 / 100
- Design (rubric, 0–5)
- –
- Stop reason
- loop
- Model time
- 1hr 7mins
- Tool time (wall minus model)
- 5mins
- Wall time
- 1hr 12mins
- Tool calls
- 20
- Tool errors
- 18
- Errors by type
- {"other": 17, "edit_mismatch": 1}
- Loop-guard events
- 0
- Tokens in / out
- 567,247 / 35,692
- Thinking tokens
- –
- Decode / prefill tok/s
- – / –
- Prefix reuse
- –
- Peak VRAM (GPU / engine)
- 11,646 / 0 MiB
- Peak engine RAM
- 0 MiB
- Engine
- lmstudio
- Model
- Gemma 4 12B QAT (LM Studio, Mac mini) (google/gemma-4-12b-qat)
- Settings
- {"thinking": "medium", "reasoning_budget_tokens": 3072, "max_tokens": 7168, "sampling": "Gemma 4 card preset (t 1.0, top_p 0.95, top_k 64)", "sampling_keys": {"temperature": 1.0, "top_p": 0.95, "top_k": 64}, "loaded": "LM Studio, context 65536 (fallback)"}
- Node
- Mac mini M4
- Prompt
- v1
- Started
- 2026-10-07T21:36:51Z
Feature scores
- O
- 0
- F1
- 0.42
- G
- 0
- F2
- 0
- F3
- 0
- F4
- 0
- F5
- 0
- F8
- 0
- F6
- 0
- F9
- 0
- R
- 0
Screenshots
Landing page at desktop and phone widths, and the game at noon, at night, after breaking a block, and on a phone.
Checklist (2 pass, 1 partial, 16 fail)
| Feature | Test | Score | Evidence |
|---|---|---|---|
| O | files_present | 0 | {"required": ["index.html"], "notes_md": false} |
| F1 | landing_loads | 0 | {"status": 200, "errors": ["Failed to resolve module specifier \"three\". Relative references must start with either \"/\", \"./\", or \"../\".", "Failed to load resource: the server responded with a status of 404 (Not Found) @ /style.css"], "network_failed": ["http://127.0.0.1:40051/style.css net::ERR_ABORTED"]} |
| F1 | hero_preview | 0 | {"std": 0, "frame_diff": 0, "size": [300, 150]} |
| F1 | gallery | 0 | {"images": 0, "generated_nonblank": 0, "distinct": 0, "detail": []} |
| F1 | landing_content | 1 | {"h1": "Aetheria Voxel", "features": 4, "controls": 192, "play": true} |
| F1 | play_now | 0.5 | {"url": "/game.html", "game_ready": false} |
| F1 | responsive_mobile | 1 | {"no_horizontal_scroll": true, "play_now_fits": true, "title_fits": true, "inner": 390, "scroll": 390, "play": [8, 72, 64], "h1": [8, 382, 374]} |
| G | game_loads | 0 | {"exception": "Waiting failed: 25000ms exceeded"} |
| G | canvas_renders | 0 | {"skipped": "game did not load"} |
| G | fps | 0 | {"skipped": "game did not load"} |
| F2 | terrain | 0 | {"skipped": "game did not load"} |
| F3 | movement | 0 | {"skipped": "game did not load"} |
| F4 | break_place | 0 | {"skipped": "game did not load"} |
| F5 | hotbar | 0 | {"skipped": "game did not load"} |
| F8 | save_reload | 0 | {"skipped": "game did not load"} |
| F6 | day_night | 0 | {"exception": "Waiting failed: 25000ms exceeded"} |
| F9 | touch | 0 | {"exception": "Waiting failed: 25000ms exceeded"} |
| R | render_integrity | 0 | {"exception": "Waiting failed: 25000ms exceeded"} |
| O | self_contained | 0 | {"no_external_requests": true, "pinned_three": false, "no_third_party_branding": true, "external": [], "branded_files": []} |
Suite 1.1.0 · Chrome/152.0.7977.82 · WebGL: ANGLE (Intel, Vulkan 1.4.354 (Intel(R) UHD Graphics 630 (CML GT2) (0x00009BC8)), Intel open-source Mesa driver)
Steers
None: an unsteered run gets the prompt and nothing else.