ymath/mistral-7binstruct-summary-100s

README.md

@@ -19,7 +19,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the generator dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.4648
+- Loss: 1.5630
 
 ## Model description
 
@@ -44,15 +44,15 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: constant
-- lr_scheduler_warmup_steps: 0.03
+- lr_scheduler_warmup_ratio: 0.1
 - training_steps: 50
 
 ### Training results
 
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
-| 1.6929        | 0.2174 | 25   | 1.5559          |
-| 1.5408        | 0.4348 | 50   | 1.4648          |
+| 1.7534        | 0.0146 | 25   | 1.6425          |
+| 1.5934        | 0.0292 | 50   | 1.5630          |
 
 
 ### Framework versions

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7a53f706ef14c6f3486c3fe3a2f7d90fec5219688ccb4a5c2f86c4af1dfc9b7d
+oid sha256:307cbfb57f0e9094daef5267d3820b6358dbc9da4d7e7dd4ef2a8593d1fbdc7d
 size 27280152

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3a919705c69c7fdcd31c7a6da908c283ebd38afe403fa2602f045af2d626c5e5
+oid sha256:0e74ecdcb2ac946470fc3c457994018fb47a37d0417de6ab8073ec010bb4a126
 size 4984