End of training
Browse files- README.md +6 -8
- adapter_model.bin +1 -1
README.md
CHANGED
|
@@ -43,13 +43,13 @@ deepspeed: null
|
|
| 43 |
device_map: auto
|
| 44 |
do_eval: true
|
| 45 |
num_epochs: 3
|
| 46 |
-
load_best_model_at_end: true
|
| 47 |
# early_stopping_patience: 1
|
| 48 |
eval_batch_size: 4
|
| 49 |
eval_max_new_tokens: 128
|
| 50 |
-
|
| 51 |
eval_table_size: null
|
| 52 |
-
evals_per_epoch:
|
| 53 |
flash_attention: true
|
| 54 |
fp16: false
|
| 55 |
fsdp: null
|
|
@@ -121,7 +121,7 @@ xformers_attention: null
|
|
| 121 |
|
| 122 |
This model is a fine-tuned version of [unsloth/SmolLM-360M](https://huggingface.co/unsloth/SmolLM-360M) on the None dataset.
|
| 123 |
It achieves the following results on the evaluation set:
|
| 124 |
-
- Loss: 0.
|
| 125 |
|
| 126 |
## Model description
|
| 127 |
|
|
@@ -155,10 +155,8 @@ The following hyperparameters were used during training:
|
|
| 155 |
|
| 156 |
| Training Loss | Epoch | Step | Validation Loss |
|
| 157 |
|:-------------:|:------:|:----:|:---------------:|
|
| 158 |
-
|
|
| 159 |
-
| 0.
|
| 160 |
-
| 0.2789 | 1.0899 | 400 | 0.2482 |
|
| 161 |
-
| 0.1355 | 1.6349 | 600 | 0.1570 |
|
| 162 |
|
| 163 |
|
| 164 |
### Framework versions
|
|
|
|
| 43 |
device_map: auto
|
| 44 |
do_eval: true
|
| 45 |
num_epochs: 3
|
| 46 |
+
# load_best_model_at_end: true
|
| 47 |
# early_stopping_patience: 1
|
| 48 |
eval_batch_size: 4
|
| 49 |
eval_max_new_tokens: 128
|
| 50 |
+
|
| 51 |
eval_table_size: null
|
| 52 |
+
evals_per_epoch: null
|
| 53 |
flash_attention: true
|
| 54 |
fp16: false
|
| 55 |
fsdp: null
|
|
|
|
| 121 |
|
| 122 |
This model is a fine-tuned version of [unsloth/SmolLM-360M](https://huggingface.co/unsloth/SmolLM-360M) on the None dataset.
|
| 123 |
It achieves the following results on the evaluation set:
|
| 124 |
+
- Loss: 0.1265
|
| 125 |
|
| 126 |
## Model description
|
| 127 |
|
|
|
|
| 155 |
|
| 156 |
| Training Loss | Epoch | Step | Validation Loss |
|
| 157 |
|:-------------:|:------:|:----:|:---------------:|
|
| 158 |
+
| 0.3036 | 1.0 | 367 | 0.2539 |
|
| 159 |
+
| 0.1304 | 1.6349 | 600 | 0.1265 |
|
|
|
|
|
|
|
| 160 |
|
| 161 |
|
| 162 |
### Framework versions
|
adapter_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 69629450
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4ae09074903f80cf3f473a3ee6c121cbab981d41ed76db72fd3bc46c9784764d
|
| 3 |
size 69629450
|