End of training

README.md

@@ -13,14 +13,13 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/khackho01125-CMC-University/huggingface/runs/v98t7due)
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/khackho01125-CMC-University/huggingface/runs/v98t7due)
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/khackho01125-CMC-University/huggingface/runs/l1s9fd18)
 # test-model
 
 This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.3880
-- Accuracy: 0.8994
+- Loss: 0.2593
+- Accuracy: 0.9276
 
 ## Model description
 
@@ -39,14 +38,14 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 2e-05
+- learning_rate: 5e-05
 - train_batch_size: 16
 - eval_batch_size: 8
 - seed: 42
 - gradient_accumulation_steps: 4
 - total_train_batch_size: 64
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: linear
+- lr_scheduler_type: cosine
 - lr_scheduler_warmup_ratio: 0.3
 - training_steps: 600
 - mixed_precision_training: Native AMP
@@ -55,16 +54,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch  | Step | Validation Loss | Accuracy |
 |:-------------:|:------:|:----:|:---------------:|:--------:|
-| 1.0477        | 0.9639 | 60   | 0.9638          | 0.5412   |
-| 0.9116        | 1.9277 | 120  | 0.7981          | 0.7123   |
-| 0.76          | 2.8916 | 180  | 0.6920          | 0.7425   |
-| 0.6584        | 3.8554 | 240  | 0.5988          | 0.7666   |
-| 0.5391        | 4.8193 | 300  | 0.5216          | 0.8471   |
-| 0.463         | 5.7831 | 360  | 0.4832          | 0.8551   |
-| 0.3977        | 6.7470 | 420  | 0.4274          | 0.8833   |
-| 0.3647        | 7.7108 | 480  | 0.4347          | 0.8753   |
-| 0.33          | 8.6747 | 540  | 0.3900          | 0.8833   |
-| 0.318         | 9.6386 | 600  | 0.3880          | 0.8994   |
+| 1.0164        | 0.9639 | 60   | 0.8742          | 0.6519   |
+| 0.8359        | 1.9277 | 120  | 0.6836          | 0.7304   |
+| 0.642         | 2.8916 | 180  | 0.5834          | 0.7988   |
+| 0.4896        | 3.8554 | 240  | 0.5158          | 0.8169   |
+| 0.3864        | 4.8193 | 300  | 0.3212          | 0.8974   |
+| 0.346         | 5.7831 | 360  | 0.2889          | 0.9135   |
+| 0.2796        | 6.7470 | 420  | 0.2591          | 0.9256   |
+| 0.244         | 7.7108 | 480  | 0.2889          | 0.9155   |
+| 0.2058        | 8.6747 | 540  | 0.2615          | 0.9215   |
+| 0.1616        | 9.6386 | 600  | 0.2593          | 0.9276   |
 
 
 ### Framework versions