AutoScientist Competition — Mathcode Model
Qwen2.5-0.5B-Instruct adapted for mathcode via Adaption Labs AutoScientist v5: 4-bit QLoRA SFT (r=32, alpha=64) then DPO (beta=0.1) on chosen/rejected pairs.
- DPO reward accuracy: 0.8181818181818182
- DPO reward margin: 8.761996030807495
Dataset: Rishidar/autoscientist-mathcode-dataset. Also mirrored on Kaggle: rishidard/autoscientist-mathcode-qlora.
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support