flint-opus-step40

Step-40 checkpoint of AlexWortega/flint-opus-curriculum-20261026: a fresh attention-only LoRA (r16/alpha32, q/k/v/o) on RecursiveSI/flint @ 2a247be, trained with group-relative RL on antislop tweet continuations graded by an Opus 5.5 judge (astra4 calibrated-v1 reward). Step 40 was the best held-out antislop point of a 200-step run; later steps regressed.

held-out (Opus 5.5 judge, 24 prompts each) base flint step 40
antislop q (0-10) 4.92 5.90
antislop calibrated reward 0.12 0.31
roleplay q (0-10) 6.38 6.13
roleplay calibrated reward 0.63 0.51

Small eval sets (n=24) and a single judge: treat these as noisy. Roleplay was not trained before step 101 and is slightly lower at step 40. The LoRA is folded into the attention weights as W + (B @ A) * alpha / r (fp32, cast back to bf16), identical to the weights the policy server used during training. Experts are untouched.

GGUF: AlexWortega/flint-opus-step40-GGUF.

Downloads last month
-
Safetensors
Model size
40B params
Tensor type
BF16
·
Video Preview
loading

Model tree for AlexWortega/flint-opus-step40

Finetuned
(14)
this model
Quantizations
1 model