End of training

README.md

@@ -1,8 +1,10 @@
 ---
 license: mit
-base_model: facebook/w2v-bert-2.0
+base_model: cportoca/CS224S_Quechua_Project
 tags:
 - generated_from_trainer
+metrics:
+- wer
 model-index:
 - name: CS224S_Quechua_Project
   results: []
@@ -13,7 +15,10 @@ should probably proofread and complete it, then remove this comment. -->
 
 # CS224S_Quechua_Project
 
-This model is a fine-tuned version of [facebook/w2v-bert-2.0](https://huggingface.co/facebook/w2v-bert-2.0) on an unknown dataset.
+This model is a fine-tuned version of [cportoca/CS224S_Quechua_Project](https://huggingface.co/cportoca/CS224S_Quechua_Project) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.0264
+- Wer: 0.6160
 
 ## Model description
 
@@ -33,19 +38,37 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 5e-05
-- train_batch_size: 8
+- train_batch_size: 4
 - eval_batch_size: 8
 - seed: 42
 - gradient_accumulation_steps: 2
-- total_train_batch_size: 16
+- total_train_batch_size: 8
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 500
-- num_epochs: 5
+- lr_scheduler_warmup_steps: 70
+- num_epochs: 10
 - mixed_precision_training: Native AMP
 
 ### Training results
 
+| Training Loss | Epoch | Step | Validation Loss | Wer    |
+|:-------------:|:-----:|:----:|:---------------:|:------:|
+| 0.4218        | 0.625 | 45   | 1.2929          | 0.8437 |
+| 0.4233        | 1.25  | 90   | 1.3785          | 0.8580 |
+| 0.4098        | 1.875 | 135  | 1.2656          | 0.8277 |
+| 0.4212        | 2.5   | 180  | 1.1368          | 0.7781 |
+| 0.3174        | 3.125 | 225  | 1.1210          | 0.8134 |
+| 0.2819        | 3.75  | 270  | 1.0151          | 0.7221 |
+| 0.2226        | 4.375 | 315  | 1.0450          | 0.7723 |
+| 0.2152        | 5.0   | 360  | 1.0446          | 0.7100 |
+| 0.2023        | 5.625 | 405  | 1.0544          | 0.7339 |
+| 0.1547        | 6.25  | 450  | 1.0352          | 0.6932 |
+| 0.1358        | 6.875 | 495  | 1.0490          | 0.6562 |
+| 0.1229        | 7.5   | 540  | 1.0429          | 0.6500 |
+| 0.079         | 8.125 | 585  | 0.9882          | 0.6532 |
+| 0.0896        | 8.75  | 630  | 1.0109          | 0.6322 |
+| 0.052         | 9.375 | 675  | 1.0006          | 0.6275 |
+| 0.0515        | 10.0  | 720  | 1.0264          | 0.6160 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:653ea061c2537aab45fda124356462db0b91439a0c08484ab8810fda9468ffbb
+oid sha256:22bd1dce0c04b0ec1f9b3f00f95cd1b791fef4a5049ae91f4437db2e5a4c0fd0
 size 2422941660

runs/May20_14-30-11_834eef93689f/events.out.tfevents.1716215447.834eef93689f.2429.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a86f5e4bfbeaaaa2877c8a371c739848035fee8e13c551b663da54d4f00b0aad
-size 13871
+oid sha256:8df0f7db8d307ff6e54c07d325abf6a0514b803b6ddce37a60edc392d09b3d28
+size 14754