Model save

README.md

@@ -18,16 +18,16 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [microsoft/Phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 4.3254
-- Rewards/chosen: -0.3983
-- Rewards/rejected: -0.3983
+- Loss: 4.4137
+- Rewards/chosen: -0.4068
+- Rewards/rejected: -0.4068
 - Rewards/accuracies: 0.0
 - Rewards/margins: 0.0
-- Logps/rejected: -3.9828
-- Logps/chosen: -3.9828
-- Logits/rejected: 23.9152
-- Logits/chosen: 23.9152
-- Nll Loss: 4.2561
+- Logps/rejected: -4.0684
+- Logps/chosen: -4.0684
+- Logits/rejected: 22.3128
+- Logits/chosen: 22.3128
+- Nll Loss: 4.3444
 - Log Odds Ratio: -0.6931
 - Log Odds Chosen: 0.0
 
@@ -63,7 +63,7 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen | Nll Loss | Log Odds Ratio | Log Odds Chosen |
 |:-------------:|:-----:|:----:|:---------------:|:--------------:|:----------------:|:------------------:|:---------------:|:--------------:|:------------:|:---------------:|:-------------:|:--------:|:--------------:|:---------------:|
-| 4.0465        | 0.8   | 1    | 4.3254          | -0.3983        | -0.3983          | 0.0                | 0.0             | -3.9828        | -3.9828      | 23.9152         | 23.9152       | 4.2561   | -0.6931        | 0.0             |
+| 4.1766        | 0.8   | 1    | 4.4137          | -0.4068        | -0.4068          | 0.0                | 0.0             | -4.0684        | -4.0684      | 22.3128         | 22.3128       | 4.3444   | -0.6931        | 0.0             |
 
 
 ### Framework versions

adapter_config.json

@@ -20,10 +20,10 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "qkv_proj",
     "gate_up_proj",
-    "down_proj",
-    "o_proj"
+    "o_proj",
+    "qkv_proj",
+    "down_proj"
   ],
   "task_type": "CASUAL_LM",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6e2a43079b211a9cad74c3fbfe1e596fbb82ad6e508af164639369bc8abf058a
+oid sha256:30a595c549d8d93ddaccc29e80a93b2a02720016cf695a50c46ea2f82f673459
 size 887450008

runs/Jul15_05-59-41_6bac785cba6b/events.out.tfevents.1721023184.6bac785cba6b.4718.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c4575d684f679cad6a9f6d47b04ddca948654497fb655673be81dcc8735b5fe
+size 8056

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7a072db5e59202e8cd4f9f7bdb9163865cddc024cea4091e214eb6abcb4c9323
+oid sha256:996082b3e31474d0f885e97d42c2162e4ad600cfee32e088aa509e8dfebdd7ac
 size 5432