Update README.md
Browse files
README.md
CHANGED
|
@@ -23,7 +23,7 @@ noise into an explicit control lever for exploration.
|
|
| 23 |
|
| 24 |
## The 3PO family
|
| 25 |
|
| 26 |
-
| Variant |
|
| 27 |
|---------|------|
|
| 28 |
| **B3PO** | One weight perturbation from the IVON posterior per gradient step, synced to the rollout engine. |
|
| 29 |
| **M3PO** | `M` Monte-Carlo perturbations per step; rollouts and advantages computed per sample, gradients averaged. |
|
|
@@ -40,7 +40,7 @@ noise into an explicit control lever for exploration.
|
|
| 40 |
|
| 41 |
## Models & data
|
| 42 |
|
| 43 |
-
- **Foundation models:** `allenai/Olmo-3-1025-7B`
|
| 44 |
- **RL data:** [DAPO-Math-17k](https://huggingface.co/datasets/BytedTsinghua-SIA/DAPO-Math-17k).
|
| 45 |
- **SFT data:** [Llama-Nemotron Post-Training Dataset](https://huggingface.co/datasets/nvidia/Llama-Nemotron-Post-Training-Dataset).
|
| 46 |
- **Benchmarks:** AIME 2024–2026, MATH-500, AMC 2023, Minerva.
|
|
|
|
| 23 |
|
| 24 |
## The 3PO family
|
| 25 |
|
| 26 |
+
| Variant | Brief Method Description |
|
| 27 |
|---------|------|
|
| 28 |
| **B3PO** | One weight perturbation from the IVON posterior per gradient step, synced to the rollout engine. |
|
| 29 |
| **M3PO** | `M` Monte-Carlo perturbations per step; rollouts and advantages computed per sample, gradients averaged. |
|
|
|
|
| 40 |
|
| 41 |
## Models & data
|
| 42 |
|
| 43 |
+
- **Foundation models:** `allenai/Olmo-3-1025-7B` and `Qwen/Qwen2.5-Math-7B`
|
| 44 |
- **RL data:** [DAPO-Math-17k](https://huggingface.co/datasets/BytedTsinghua-SIA/DAPO-Math-17k).
|
| 45 |
- **SFT data:** [Llama-Nemotron Post-Training Dataset](https://huggingface.co/datasets/nvidia/Llama-Nemotron-Post-Training-Dataset).
|
| 46 |
- **Benchmarks:** AIME 2024–2026, MATH-500, AMC 2023, Minerva.
|