model card
Browse files
README.md
CHANGED
|
@@ -22,20 +22,21 @@ point in any eval CSV maps to a folder here without a lookup table:
|
|
| 22 |
|
| 23 |
```
|
| 24 |
<model>_mbpp_<arm>_<lr>/
|
| 25 |
-
global_step_<N>/ a complete HF model directory
|
| 26 |
logs/ trainer logs
|
| 27 |
rollouts/ sampled rollouts
|
| 28 |
```
|
| 29 |
|
| 30 |
| folder | base model | arm | lr | checkpoints |
|
| 31 |
| --- | --- | --- | --- | --- |
|
| 32 |
-
| `
|
| 33 |
-
| `
|
|
|
|
| 34 |
|
| 35 |
```python
|
| 36 |
from transformers import AutoModelForCausalLM
|
| 37 |
m = AutoModelForCausalLM.from_pretrained(
|
| 38 |
-
"RL-Forgettting-Exp4/code-rl-lr-ablation", subfolder="
|
| 39 |
```
|
| 40 |
|
| 41 |
## Training
|
|
|
|
| 22 |
|
| 23 |
```
|
| 24 |
<model>_mbpp_<arm>_<lr>/
|
| 25 |
+
global_step_<N>/ a complete HF model directory
|
| 26 |
logs/ trainer logs
|
| 27 |
rollouts/ sampled rollouts
|
| 28 |
```
|
| 29 |
|
| 30 |
| folder | base model | arm | lr | checkpoints |
|
| 31 |
| --- | --- | --- | --- | --- |
|
| 32 |
+
| `qwen3_1p7b_base_mbpp_nobuf_lr6e7` | `Qwen/Qwen3-1.7B-Base` | no buffer | 6e-7 | 30-980 46 ckpts, irregular |
|
| 33 |
+
| `qwen3b_mbpp_hardcd_lam0p1_lr6e7` | `Qwen/Qwen2.5-3B` | replay buffer (lambda=0.1) | 6e-7 | 30-800 27 ckpts, irregular |
|
| 34 |
+
| `qwen3b_mbpp_nobuf_lr6e7` | `Qwen/Qwen2.5-3B` | no buffer | 6e-7 | 30-800 27 ckpts, irregular |
|
| 35 |
|
| 36 |
```python
|
| 37 |
from transformers import AutoModelForCausalLM
|
| 38 |
m = AutoModelForCausalLM.from_pretrained(
|
| 39 |
+
"RL-Forgettting-Exp4/code-rl-lr-ablation", subfolder="qwen3_1p7b_base_mbpp_nobuf_lr6e7/global_step_980")
|
| 40 |
```
|
| 41 |
|
| 42 |
## Training
|