Evangelinejy commited on
Commit
c04c09b
·
verified ·
1 Parent(s): 274b3cf

model card

Browse files
Files changed (1) hide show
  1. README.md +5 -4
README.md CHANGED
@@ -22,20 +22,21 @@ point in any eval CSV maps to a folder here without a lookup table:
22
 
23
  ```
24
  <model>_mbpp_<arm>_<lr>/
25
- global_step_<N>/ a complete HF model directory (stride 30 + endpoint)
26
  logs/ trainer logs
27
  rollouts/ sampled rollouts
28
  ```
29
 
30
  | folder | base model | arm | lr | checkpoints |
31
  | --- | --- | --- | --- | --- |
32
- | `qwen3b_mbpp_hardcd_lam0p1_lr6e7` | `Qwen/Qwen2.5-3B` | replay buffer (lambda=0.1) | 6e-7 | 30-800 step 30 |
33
- | `qwen3b_mbpp_nobuf_lr6e7` | `Qwen/Qwen2.5-3B` | no buffer | 6e-7 | 330-800 step 30 |
 
34
 
35
  ```python
36
  from transformers import AutoModelForCausalLM
37
  m = AutoModelForCausalLM.from_pretrained(
38
- "RL-Forgettting-Exp4/code-rl-lr-ablation", subfolder="qwen3b_mbpp_hardcd_lam0p1_lr6e7/global_step_800")
39
  ```
40
 
41
  ## Training
 
22
 
23
  ```
24
  <model>_mbpp_<arm>_<lr>/
25
+ global_step_<N>/ a complete HF model directory
26
  logs/ trainer logs
27
  rollouts/ sampled rollouts
28
  ```
29
 
30
  | folder | base model | arm | lr | checkpoints |
31
  | --- | --- | --- | --- | --- |
32
+ | `qwen3_1p7b_base_mbpp_nobuf_lr6e7` | `Qwen/Qwen3-1.7B-Base` | no buffer | 6e-7 | 30-980 46 ckpts, irregular |
33
+ | `qwen3b_mbpp_hardcd_lam0p1_lr6e7` | `Qwen/Qwen2.5-3B` | replay buffer (lambda=0.1) | 6e-7 | 30-800 27 ckpts, irregular |
34
+ | `qwen3b_mbpp_nobuf_lr6e7` | `Qwen/Qwen2.5-3B` | no buffer | 6e-7 | 30-800 27 ckpts, irregular |
35
 
36
  ```python
37
  from transformers import AutoModelForCausalLM
38
  m = AutoModelForCausalLM.from_pretrained(
39
+ "RL-Forgettting-Exp4/code-rl-lr-ablation", subfolder="qwen3_1p7b_base_mbpp_nobuf_lr6e7/global_step_980")
40
  ```
41
 
42
  ## Training