End of training

README.md

@@ -1,7 +1,6 @@
 ---
 library_name: transformers
-license: apache-2.0
-base_model: Qwen/Qwen3-0.6B-Base
+base_model: cam-1000/MNLP_M3_mcqa_model
 tags:
 - generated_from_trainer
 model-index:
@@ -14,9 +13,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 # MNLP_M3_rag_model
 
-This model is a fine-tuned version of [Qwen/Qwen3-0.6B-Base](https://huggingface.co/Qwen/Qwen3-0.6B-Base) on an unknown dataset.
+This model is a fine-tuned version of [cam-1000/MNLP_M3_mcqa_model](https://huggingface.co/cam-1000/MNLP_M3_mcqa_model) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0000
+- Loss: 0.8564
 
 ## Model description
 
@@ -50,9 +49,9 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
-| 0.0           | 0.0228 | 100  | 0.0000          |
-| 0.0           | 0.0456 | 200  | 0.0000          |
-| 0.0           | 0.0683 | 300  | 0.0000          |
+| 0.8275        | 0.0228 | 100  | 0.8105          |
+| 0.7663        | 0.0456 | 200  | 0.8251          |
+| 0.5896        | 0.0683 | 300  | 0.8564          |
 
 
 ### Framework versions

config.json

@@ -3,7 +3,7 @@
     "Qwen3ForCausalLM"
   ],
   "attention_bias": false,
-  "attention_dropout": 0.0,
+  "attention_dropout": 0.1,
   "bos_token_id": 151643,
   "eos_token_id": 151643,
   "head_dim": 128,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:95a855ef063a62a7db7a084ba0731f83f8ba671fcad58e393c6fba2264e021d6
+oid sha256:9c3fef9685203b9f660eacccb274de06644cda9c54f59e6a08b88dce69e363af
 size 1192135096

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:eb53288efc2ba5bed71f1270d0cc845cac5b26653e6a53f2850b42035e6acecd
+oid sha256:62eb3b5582a5d668757dda6894f7cdaaa74fa00eb64371185180a22602e99425
 size 5713