ai-maker-space/mistral-7binstruct-summary-100s

README.md

@@ -20,7 +20,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the generator dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.5250
+- Loss: 1.4706
 
 ## Model description
 
@@ -52,13 +52,13 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 1.5518        | 0.22  | 25   | 1.5250          |
-| 1.5824        | 0.43  | 50   | 1.5250          |
+| 1.7083        | 0.22  | 25   | 1.5544          |
+| 1.5577        | 0.43  | 50   | 1.4706          |
 
 
 ### Framework versions
 
-- PEFT 0.8.2
+- PEFT 0.9.0
 - Transformers 4.38.1
 - Pytorch 2.1.0+cu121
 - Datasets 2.17.1

adapter_config.json

@@ -23,5 +23,6 @@
     "v_proj"
   ],
   "task_type": "CAUSAL_LM",
+  "use_dora": false,
   "use_rslora": false
 }

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e44ce263e6fd885f50d82ca515b9325375b43ee36ededb75acf161ce88bc2e41
-size 48
+oid sha256:8944e38de54cf72be4d1d4675a165d2a4d2188fbd08bf6c509326c9d6dc34fa3
+size 27280152

runs/Feb28_15-06-06_fe77555a4fd3/events.out.tfevents.1709132795.fe77555a4fd3.255.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:338b5761a12f1f0027c28bae2d05f0012853443a4b4c62fcb8fdddfdb10ab6f6
+size 6966

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b16424456c9c50ac28850a62e2b37641f793bf7838acf11247de1d2194855503
+oid sha256:db22c83bec086b6323b1d079c3b185f0be538c353721a8297f902b607ba1fd94
 size 4920