PEFT
Safetensors
qwen2
alignment-handbook
trl
sft
Generated from Trainer
aadityap commited on
Commit
81e7f2a
·
verified ·
1 Parent(s): 9282164

End of training

Browse files
Files changed (1) hide show
  1. README.md +5 -2
README.md CHANGED
@@ -1,11 +1,14 @@
1
  ---
2
  base_model: deepseek-ai/Deepseek-R1-Distill-Qwen-7B
 
 
 
3
  library_name: peft
4
  license: mit
5
  tags:
 
6
  - trl
7
  - sft
8
- - alignment-handbook
9
  - generated_from_trainer
10
  model-index:
11
  - name: sft_r1_7b
@@ -17,7 +20,7 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  # sft_r1_7b
19
 
20
- This model is a fine-tuned version of [deepseek-ai/Deepseek-R1-Distill-Qwen-7B](https://huggingface.co/deepseek-ai/Deepseek-R1-Distill-Qwen-7B) on the None dataset.
21
 
22
  ## Model description
23
 
 
1
  ---
2
  base_model: deepseek-ai/Deepseek-R1-Distill-Qwen-7B
3
+ datasets:
4
+ - tttx/r1-trajectories-collection-round-2
5
+ - tttx/r1-trajectories-arcagi-barc
6
  library_name: peft
7
  license: mit
8
  tags:
9
+ - alignment-handbook
10
  - trl
11
  - sft
 
12
  - generated_from_trainer
13
  model-index:
14
  - name: sft_r1_7b
 
20
 
21
  # sft_r1_7b
22
 
23
+ This model is a fine-tuned version of [deepseek-ai/Deepseek-R1-Distill-Qwen-7B](https://huggingface.co/deepseek-ai/Deepseek-R1-Distill-Qwen-7B) on the tttx/r1-trajectories-collection-round-2 and the tttx/r1-trajectories-arcagi-barc datasets.
24
 
25
  ## Model description
26