guo1006 commited on
Commit
5845a1f
·
verified ·
1 Parent(s): 4508907

End of training

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -1,9 +1,9 @@
1
  ---
 
2
  license: apache-2.0
3
- base_model: Qwen/Qwen2.5-7B-Instruct
4
  tags:
5
  - generated_from_trainer
6
- library_name: peft
7
  model-index:
8
  - name: qwem_lora_clm_with_added_tokens
9
  results: []
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  # qwem_lora_clm_with_added_tokens
16
 
17
- This model is a fine-tuned version of [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) on an unknown dataset.
18
 
19
  ## Model description
20
 
@@ -37,7 +37,7 @@ The following hyperparameters were used during training:
37
  - train_batch_size: 8
38
  - eval_batch_size: 8
39
  - seed: 42
40
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
  - lr_scheduler_warmup_steps: 12
43
  - num_epochs: 2
@@ -50,7 +50,7 @@ The following hyperparameters were used during training:
50
  ### Framework versions
51
 
52
  - PEFT 0.15.2
53
- - Transformers 4.43.1
54
  - Pytorch 2.6.0+cu124
55
  - Datasets 3.6.0
56
- - Tokenizers 0.19.1
 
1
  ---
2
+ library_name: peft
3
  license: apache-2.0
4
+ base_model: Qwen/Qwen2.5-7B
5
  tags:
6
  - generated_from_trainer
 
7
  model-index:
8
  - name: qwem_lora_clm_with_added_tokens
9
  results: []
 
14
 
15
  # qwem_lora_clm_with_added_tokens
16
 
17
+ This model is a fine-tuned version of [Qwen/Qwen2.5-7B](https://huggingface.co/Qwen/Qwen2.5-7B) on an unknown dataset.
18
 
19
  ## Model description
20
 
 
37
  - train_batch_size: 8
38
  - eval_batch_size: 8
39
  - seed: 42
40
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
41
  - lr_scheduler_type: linear
42
  - lr_scheduler_warmup_steps: 12
43
  - num_epochs: 2
 
50
  ### Framework versions
51
 
52
  - PEFT 0.15.2
53
+ - Transformers 4.56.2
54
  - Pytorch 2.6.0+cu124
55
  - Datasets 3.6.0
56
+ - Tokenizers 0.22.1