deepanshupillm commited on
Commit
6abc206
·
verified ·
1 Parent(s): 314d06c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -132,7 +132,7 @@ The architecture is retained from Qwen3.5-9B; Alpie Seed's adaptation is carried
132
 
133
  Alpie Seed uses a two-stage post-training pipeline.
134
 
135
- 1. **Supervised fine-tuning (SFT):** a LoRA adapter is trained to improve instruction following, response quality, and task performance.
136
  2. **Group Relative Policy Optimization (GRPO):** a trainable DoRA adapter is optimized while the SFT adapter is kept as a frozen reference policy. The GRPO stage uses a 4-bit NF4 base with double quantization and BF16 computation, and the trained adapter is merged into the base model at its original precision for release.
137
 
138
  Training used 8X NVIDIA H100 GPUs, with 3,034 GRPO steps across five phases. The reward combines seven signals: answer correctness, hallucination penalty, self-consistency, educational quality, structure preservation, repetition penalty, and length penalty.
 
132
 
133
  Alpie Seed uses a two-stage post-training pipeline.
134
 
135
+ 1. **Supervised fine-tuning (SFT):** a DORA adapter is trained to improve instruction following, response quality, and task performance.
136
  2. **Group Relative Policy Optimization (GRPO):** a trainable DoRA adapter is optimized while the SFT adapter is kept as a frozen reference policy. The GRPO stage uses a 4-bit NF4 base with double quantization and BF16 computation, and the trained adapter is merged into the base model at its original precision for release.
137
 
138
  Training used 8X NVIDIA H100 GPUs, with 3,034 GRPO steps across five phases. The reward combines seven signals: answer correctness, hallucination penalty, self-consistency, educational quality, structure preservation, repetition penalty, and length penalty.