rjz123/colar-cot-r1q

colar-r1-cot

R1 CoT 基座阶段(纯 CoT 预热, 10ep)

• Base model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
• Files: colar_r1_cot.ckpt, hparams.yaml

Loading (PyTorch-Lightning checkpoint — NOT AutoModel-loadable)

Weights live under the top-level key ['state_dict'] and only fit the custom CoLaR scaffold (base LLM + [PAD] resize + r128 q/v LoRA + a LatentPolicy MLP), loaded strict=False. Load the base separately and splice this state_dict in. Runtime env:

COLAR_BASE=<base>  COLAR_CKPT=colar-gsm/colar_best.ckpt  COLAR_EMB_STD=0.018  COLAR_COMPRESS=5  COLAR_MAXLAT=64  TORCH_FORCE_NO_WEIGHTS_ONLY_LOAD=1

TORCH_FORCE_NO_WEIGHTS_ONLY_LOAD=1 is required for these older Lightning ckpts.