HopitAI/hopper-g

Hopper (G)

A general-purpose version of Hopper: a LoRA adapter for Qwen3.5-4B that answers typed decision questions in one forward pass by reading the probability of each option letter, with a per-kind calibration map. Served with the Hopper code at https://github.com/hopit-ai/hopper (tag g-1.2.0).

Research and demo use only. This adapter continues training from Hopper 1.0's adapter, whose training data included passages from RACE (non-commercial research only), and its training data also includes material made with LLM-based generation. Do not use it commercially.

What it is

• Base: Qwen/Qwen3.5-4B (revision 851bf6e), LoRA rank 16, alpha 32, the same 12 modules as Hopper.
• Training: continued from Hopper 1.0's adapter on Hopper's decision tasks (at maintenance doses), general-purpose sources (tabular record joins, CLINC150 intents, GSM8K arithmetic) and replay of public training data, with a fixed retention constraint against Hopper 1.0 on a held-out replay bank.
• Serving: identical to Hopper 1.1.1, including the calibration map and the long-menu shortlist (more than 26 options answered in two disclosed stages).

Leaderboards (official)

• Jev Decision Index (edition 0.2.1, 27 Sep 2026): 40.77, #16 of 68, the highest of the 4B models (Decider 4B: 40.70). The row comes from a complete run of the suite that we scored ourselves with the Index kit, at the maintainer's request. The model outputs and scores are public at HopitAI/hopper-g-decision-index-results. It replaced the Hopper 1.1.1 row (39.67).
• JevBench: requested as a separate row (issue #112), not yet measured. Our own development check on held-out JevBench-style items (not an official score) put it level with Hopper 1.0 (+0.7 points, within noise), so we make no JevBench improvement claim. Hopper 1.0's official JevBench result is 59.43, #6 of 90 ranked (v1.4.2.1, 27 Sep 2026).

Evaluation (our runs)

On our local run of the Decision Index 0.2 suite (40 benchmarks, A10G, same serving code, only the adapter differing):

	Hopper 1.1.1	Hopper (G) 1.2
balanced raw	52.74	53.50
balanced skill	37.10	38.07
GSM8K	0.318	0.480

Paired bootstrap of the balanced-raw difference: +0.76 (95 % interval +0.55 to +0.98). Seed 1 (trained independently) confirms: balanced raw 53.44 vs 52.74 (+0.70), with every Index area at or above Hopper 1.1.1. Not official scores. Hopper (G) is not tuned for JevBench; we make no claim there.

Revisions

• d60a1d6: the evaluated release (the revision given to the Decision Index and JevBench).
• Later commit: adapter_config.json sets "task_type": "CAUSAL_LM" (it was null), for the Hub's metadata parser only. The weights, calibration map and outputs are unchanged.

Limitations

• English, 4B parameters; it reads options, it does not generate reasoning.
• Calibration uses Hopper 1.1.1's map, fitted for Hopper 1.0's adapter; it has not been refitted for these weights.
• Research and demo use only (see above).