End of training
Browse files
README.md
CHANGED
|
@@ -5,6 +5,8 @@ base_model: AiForgeMaster/Qwen3-4B-P3-TC-RSSFT-1
|
|
| 5 |
tags:
|
| 6 |
- axolotl
|
| 7 |
- generated_from_trainer
|
|
|
|
|
|
|
| 8 |
model-index:
|
| 9 |
- name: Qwen3-4B-P3-RSSFT-KE-1
|
| 10 |
results: []
|
|
@@ -131,7 +133,7 @@ gc_steps: 100 # Run garbage collection every 100 steps
|
|
| 131 |
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/uskfoundation/ngpt-cpt/runs/oy7n1t61)
|
| 132 |
# Qwen3-4B-P3-RSSFT-KE-1
|
| 133 |
|
| 134 |
-
This model is a fine-tuned version of [AiForgeMaster/Qwen3-4B-P3-TC-RSSFT-1](https://huggingface.co/AiForgeMaster/Qwen3-4B-P3-TC-RSSFT-1) on
|
| 135 |
|
| 136 |
## Model description
|
| 137 |
|
|
@@ -161,6 +163,10 @@ The following hyperparameters were used during training:
|
|
| 161 |
- lr_scheduler_warmup_steps: 50
|
| 162 |
- training_steps: 416
|
| 163 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 164 |
### Framework versions
|
| 165 |
|
| 166 |
- Transformers 4.56.1
|
|
|
|
| 5 |
tags:
|
| 6 |
- axolotl
|
| 7 |
- generated_from_trainer
|
| 8 |
+
datasets:
|
| 9 |
+
- AiForgeMaster/KE-2017-2025
|
| 10 |
model-index:
|
| 11 |
- name: Qwen3-4B-P3-RSSFT-KE-1
|
| 12 |
results: []
|
|
|
|
| 133 |
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/uskfoundation/ngpt-cpt/runs/oy7n1t61)
|
| 134 |
# Qwen3-4B-P3-RSSFT-KE-1
|
| 135 |
|
| 136 |
+
This model is a fine-tuned version of [AiForgeMaster/Qwen3-4B-P3-TC-RSSFT-1](https://huggingface.co/AiForgeMaster/Qwen3-4B-P3-TC-RSSFT-1) on the AiForgeMaster/KE-2017-2025 dataset.
|
| 137 |
|
| 138 |
## Model description
|
| 139 |
|
|
|
|
| 163 |
- lr_scheduler_warmup_steps: 50
|
| 164 |
- training_steps: 416
|
| 165 |
|
| 166 |
+
### Training results
|
| 167 |
+
|
| 168 |
+
|
| 169 |
+
|
| 170 |
### Framework versions
|
| 171 |
|
| 172 |
- Transformers 4.56.1
|