YagoubChatBot/Model_Chatbot_1

README.md

@@ -18,7 +18,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.3089
+- Loss: 1.3137
 
 ## Model description
 
@@ -53,8 +53,8 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 2.1951        | 0.1   | 50   | 1.5417          |
-| 1.514         | 0.21  | 100  | 1.3089          |
+| 2.1757        | 0.1   | 50   | 1.5336          |
+| 1.5129        | 0.21  | 100  | 1.3137          |
 
 
 ### Framework versions

adapter_config.json

@@ -20,10 +20,10 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "v_proj",
-    "q_proj",
+    "k_proj",
     "o_proj",
-    "k_proj"
+    "q_proj",
+    "v_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b87cb5e78207597d49548a0973fefd1fa46e43b3c24a35c16a7540f38226198d
+oid sha256:df223b4aac651c6ae1a969d121b9ff4ac86f1c479b5d1ed039a20572c61f0515
 size 109086416

runs/Apr14_10-24-32_b5b756458e98/events.out.tfevents.1713090480.b5b756458e98.1033.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:463736177afdeeb3e3c3816966e3aeffd2033cf2f401c7314f514c8f0b62e9b9
+size 6355

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4eadce61f49ba65830cff849b6459451fcc9d4af4a8c189678817fde5795fc17
+oid sha256:cb1e13daa972938c6056e360a2baa6f4387d0e5be67708a5de4ded7ec7dbe26f
 size 4856