wetsoledrysoul commited on
Commit
bcc3ead
·
verified ·
1 Parent(s): 18fbfbd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -23,7 +23,7 @@ noise into an explicit control lever for exploration.
23
 
24
  ## The 3PO family
25
 
26
- | Variant | Idea |
27
  |---------|------|
28
  | **B3PO** | One weight perturbation from the IVON posterior per gradient step, synced to the rollout engine. |
29
  | **M3PO** | `M` Monte-Carlo perturbations per step; rollouts and advantages computed per sample, gradients averaged. |
@@ -40,7 +40,7 @@ noise into an explicit control lever for exploration.
40
 
41
  ## Models & data
42
 
43
- - **Foundation models:** `allenai/Olmo-3-1025-7B`, `Qwen/Qwen2.5-Math-7B`, `meta-llama/Llama-3.1-8B`.
44
  - **RL data:** [DAPO-Math-17k](https://huggingface.co/datasets/BytedTsinghua-SIA/DAPO-Math-17k).
45
  - **SFT data:** [Llama-Nemotron Post-Training Dataset](https://huggingface.co/datasets/nvidia/Llama-Nemotron-Post-Training-Dataset).
46
  - **Benchmarks:** AIME 2024–2026, MATH-500, AMC 2023, Minerva.
 
23
 
24
  ## The 3PO family
25
 
26
+ | Variant | Brief Method Description |
27
  |---------|------|
28
  | **B3PO** | One weight perturbation from the IVON posterior per gradient step, synced to the rollout engine. |
29
  | **M3PO** | `M` Monte-Carlo perturbations per step; rollouts and advantages computed per sample, gradients averaged. |
 
40
 
41
  ## Models & data
42
 
43
+ - **Foundation models:** `allenai/Olmo-3-1025-7B` and `Qwen/Qwen2.5-Math-7B`
44
  - **RL data:** [DAPO-Math-17k](https://huggingface.co/datasets/BytedTsinghua-SIA/DAPO-Math-17k).
45
  - **SFT data:** [Llama-Nemotron Post-Training Dataset](https://huggingface.co/datasets/nvidia/Llama-Nemotron-Post-Training-Dataset).
46
  - **Benchmarks:** AIME 2024–2026, MATH-500, AMC 2023, Minerva.