{ "model": "s6-micro", "title": "s6-micro", "tagline": "A 2.4 MB ternary decision model that plays four games at the oracle's level and answers typed questions in free text: 0.553 on the typed-decisions bench. Its second version passed the gate that the first one failed, on the same test records.", "kind": "game", "proofs": false, "model_repo": "https://huggingface.co/maxgfr/s6-micro", "notes": [ "A second look: the first version (s6-micro-v1) failed the ECE guard at 0.0821 against 0.08. This version was designed after that reading (twice the decision-training minutes) and judged on the same test records: 0.553 on the bench (gate 0.45), ECE 0.0588, every game at s3-pico's score (docs/s6-gen-prereg.md, amendment 17).", "Published at full depth: its conformal early-exit thresholds were rejected by the pre-registered arena check (one extra Dodge veto).", "Expect mistakes on questions in free text: 0.401 on When2Call, where it rarely chooses to call a tool, and 0.092 on NOTAM subjects. On 11 of the 20 bench tasks it gives one answer to at least 95% of the items." ], "game": null, "gate": "passed", "gate_kind": null, "gate_note": "Second version: 0.553 on the typed-decisions bench (gate 0.45) and ECE 0.0588 (guard 0.08). The first version failed the ECE guard at 0.0821, and this one was designed after that reading and judged on the same test records, so its pass is a second look", "gate_url": "https://github.com/maxgfr/skycmd/blob/main/BENCH.md#skycmd-s6-s6-nano-s6-micro-general-purpose-decisions-and-games-pre-registered" }