archit11/nous-fn-finetuned-model

README.md

@@ -15,6 +15,8 @@ should probably proofread and complete it, then remove this comment. -->
 # capybara_finetuned_results
 
 This model is a fine-tuned version of [nisten/Biggie-SmoLlm-0.15B-Base](https://huggingface.co/nisten/Biggie-SmoLlm-0.15B-Base) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.0289
 
 ## Model description
 
@@ -41,11 +43,14 @@ The following hyperparameters were used during training:
 - total_train_batch_size: 16
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: cosine
-- lr_scheduler_warmup_steps: 30
-- training_steps: 5
+- lr_scheduler_warmup_steps: 15
+- training_steps: 300
 
 ### Training results
 
+| Training Loss | Epoch  | Step | Validation Loss |
+|:-------------:|:------:|:----:|:---------------:|
+| 0.0284        | 8.4507 | 300  | 0.0289          |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f79a74f930e801892fad66bcf37e034d6f7dad773965f4529985ef344a0100dc
+oid sha256:3384e819ef3a746d97a7c60c1a69dd49a7b71f26c12b0ee3a144d2345f75d2f6
 size 304466592

runs/Sep26_12-45-35_61fdfd8f0b8b/events.out.tfevents.1727354737.61fdfd8f0b8b.24.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1e0a31e0d1396de16e3bd84e945b9248c11b67febb9e8fbfd428965a69743719
+size 11942

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fdf3c36fa09c8ce945afb4611b691116f3143f40021ff6e2c49da4025f2a19b0
+oid sha256:87d2b7a7aacde65a9c439e832d6d580bab1a161d6dae041ad694bf7ad0f4badd
 size 5176