End of training

README.md

@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 # phi_finetuned2.0
 
-This model is a fine-tuned version of [microsoft/phi-1_5](https://huggingface.co/microsoft/phi-1_5) on the None dataset.
+This model is a fine-tuned version of [microsoft/phi-1_5](https://huggingface.co/microsoft/phi-1_5) on an unknown dataset.
 
 ## Model description
 
@@ -33,13 +33,17 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0002
-- train_batch_size: 8
-- eval_batch_size: 8
+- learning_rate: 0.0001
+- train_batch_size: 1
+- eval_batch_size: 1
 - seed: 42
+- gradient_accumulation_steps: 12
+- total_train_batch_size: 12
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: cosine
-- training_steps: 100
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 100
+- num_epochs: 3
+- mixed_precision_training: Native AMP
 
 ### Framework versions
 

adapter_config.json

@@ -19,9 +19,9 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
+    "fc2",
     "v_proj",
     "dense",
-    "fc2",
     "q_proj",
     "k_proj"
   ],

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:693edd7812d12438e34a01607ffbbc05faf4a46955cb1af7a3a487191ffcc1f1
+oid sha256:2ec672ab2bfb9c856076c38c71904e113a40fe4851b883ab809c6dea7badad10
 size 40926200

runs/Jan16_12-53-08_8e7ae8888d51/events.out.tfevents.1705409589.8e7ae8888d51.777.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:47de466a9150330d3cbe2d6168684d82ceaa20d9dd1f83d3524dfad0724588f8
+size 4184

runs/Jan16_12-53-18_8e7ae8888d51/events.out.tfevents.1705409599.8e7ae8888d51.777.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:772e5599d886dad39f9a1cc12faadc83aabdd93fe5205bad9074323c233fd7fd
+size 4184

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:78e2f2f16ac6c702fb95b14ab9352659c886eada648b78e753ef4caabf7ec03a
-size 4728
+oid sha256:ca6a0476dd66d6500fdb9d72e4d6606ab5055c2284df2abacdd878df00da21cc
+size 4664