zimplex/olmo7-think-sft-hyp

Thinking-SFT of allenai/Olmo-3-1025-7B on allenai/Dolci-Think-SFT-7B with a hyperbolic (Lorentzian) output head (output-only, curvature c = 0.05), trained with the <think> ChatML template.

IMPORTANT — the hyperbolic head is not the standard lm_head

A plain AutoModelForCausalLM.from_pretrained(...) loads the euclidean head and gives the WRONG model. To use the hyperbolic head you must load hyp_head_state.pt and swap the output head using the training repo's code (scripts/eval_think.py → load_hyp_head / HyperbolicLMHead; the vLLM path mirrors it). hyp_head_state.pt is authoritative for curvature / scale / projection / adapter.

Prompting & grading

Use the repo's <think> template (openrlhf/utils/think_chat.py); greedy decoding. Take the answer after </think> (last \boxed{} / #### / number) and grade math with math_verify.

Files

Standard HF Olmo3 weights + tokenizer + chat_template.jinja, plus hyp_head_state.pt (vocab_emb, down_proj, log_input_scale, log_temp, curvature).