Model save
Browse files- README.md +20 -20
- adapter_model.safetensors +1 -1
README.md
CHANGED
|
@@ -17,10 +17,10 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 17 |
|
| 18 |
# test
|
| 19 |
|
| 20 |
-
This model is a fine-tuned version of [meta-llama/Llama-3.2-1B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) on
|
| 21 |
It achieves the following results on the evaluation set:
|
| 22 |
-
- Loss: 0.
|
| 23 |
-
- Num Input Tokens Seen:
|
| 24 |
|
| 25 |
## Model description
|
| 26 |
|
|
@@ -52,23 +52,23 @@ The following hyperparameters were used during training:
|
|
| 52 |
|
| 53 |
| Training Loss | Epoch | Step | Validation Loss | Input Tokens Seen |
|
| 54 |
|:-------------:|:-----:|:----:|:---------------:|:-----------------:|
|
| 55 |
-
|
|
| 56 |
-
|
|
| 57 |
-
| 0.
|
| 58 |
-
| 0.
|
| 59 |
-
| 0.
|
| 60 |
-
| 0.
|
| 61 |
-
| 0.
|
| 62 |
-
|
|
| 63 |
-
| 0.
|
| 64 |
-
| 0.
|
| 65 |
-
| 0.
|
| 66 |
-
| 0.
|
| 67 |
-
| 0.
|
| 68 |
-
| 0.
|
| 69 |
-
| 0.
|
| 70 |
-
| 0.
|
| 71 |
-
| 0.
|
| 72 |
|
| 73 |
|
| 74 |
### Framework versions
|
|
|
|
| 17 |
|
| 18 |
# test
|
| 19 |
|
| 20 |
+
This model is a fine-tuned version of [meta-llama/Llama-3.2-1B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) on an unknown dataset.
|
| 21 |
It achieves the following results on the evaluation set:
|
| 22 |
+
- Loss: 0.3492
|
| 23 |
+
- Num Input Tokens Seen: 46944
|
| 24 |
|
| 25 |
## Model description
|
| 26 |
|
|
|
|
| 52 |
|
| 53 |
| Training Loss | Epoch | Step | Validation Loss | Input Tokens Seen |
|
| 54 |
|:-------------:|:-----:|:----:|:---------------:|:-----------------:|
|
| 55 |
+
| 10.9709 | 0.056 | 7 | 6.5227 | 2880 |
|
| 56 |
+
| 6.4075 | 0.112 | 14 | 1.3825 | 5920 |
|
| 57 |
+
| 0.5326 | 0.168 | 21 | 0.4987 | 8416 |
|
| 58 |
+
| 0.4144 | 0.224 | 28 | 0.4531 | 11264 |
|
| 59 |
+
| 0.4802 | 0.28 | 35 | 0.3693 | 13824 |
|
| 60 |
+
| 0.3809 | 0.336 | 42 | 0.3873 | 16672 |
|
| 61 |
+
| 0.3844 | 0.392 | 49 | 0.3778 | 19296 |
|
| 62 |
+
| 0.3831 | 0.448 | 56 | 0.4437 | 22432 |
|
| 63 |
+
| 0.5576 | 0.504 | 63 | 0.3503 | 25504 |
|
| 64 |
+
| 0.3242 | 0.56 | 70 | 0.3716 | 28064 |
|
| 65 |
+
| 0.3963 | 0.616 | 77 | 0.3749 | 30720 |
|
| 66 |
+
| 0.3946 | 0.672 | 84 | 0.3604 | 33504 |
|
| 67 |
+
| 0.337 | 0.728 | 91 | 0.3571 | 36128 |
|
| 68 |
+
| 0.4315 | 0.784 | 98 | 0.3520 | 38592 |
|
| 69 |
+
| 0.371 | 0.84 | 105 | 0.3476 | 41280 |
|
| 70 |
+
| 0.364 | 0.896 | 112 | 0.3459 | 44160 |
|
| 71 |
+
| 0.3554 | 0.952 | 119 | 0.3492 | 46944 |
|
| 72 |
|
| 73 |
|
| 74 |
### Framework versions
|
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2819582528
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bfbad3b3bbe0780e94ac83258a352ada4e15b8231133708e191bf48a16ed199f
|
| 3 |
size 2819582528
|