File size: 4,385 Bytes
014fca0 1d2c5a3 014fca0 1d2c5a3 014fca0 1d2c5a3 014fca0 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 | ---
library_name: transformers
license: apache-2.0
base_model: Helsinki-NLP/opus-mt-es-es
tags:
- generated_from_trainer
model-index:
- name: 11_6kmslsamples
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# 11_6kmslsamples
This model is a fine-tuned version of [Helsinki-NLP/opus-mt-es-es](https://huggingface.co/Helsinki-NLP/opus-mt-es-es) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0714
- Bleu Msl: 82.3301
- Bleu Asl: 97.1735
- Ter Msl: 11.2456
- Ter Asl: 1.4638
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 32
- eval_batch_size: 64
- seed: 42
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 30
- mixed_precision_training: Native AMP
### Training results
| Training Loss | Epoch | Step | Validation Loss | Bleu Msl | Bleu Asl | Ter Msl | Ter Asl |
|:-------------:|:-----:|:-----:|:---------------:|:--------:|:--------:|:-------:|:-------:|
| 0.3888 | 1.0 | 567 | 0.1194 | 52.4711 | 92.5612 | 26.0716 | 3.7483 |
| 0.1178 | 2.0 | 1134 | 0.0928 | 12.3994 | 94.4382 | 95.6631 | 2.8878 |
| 0.0785 | 3.0 | 1701 | 0.0791 | 27.7561 | 95.2400 | 14.7756 | 2.4407 |
| 0.0607 | 4.0 | 2268 | 0.0784 | 76.2031 | 95.4984 | 12.9602 | 2.2967 |
| 0.048 | 5.0 | 2835 | 0.0745 | 69.5670 | 95.6702 | 18.6586 | 2.2539 |
| 0.0392 | 6.0 | 3402 | 0.0718 | 78.5639 | 96.0612 | 12.9097 | 1.9966 |
| 0.0324 | 7.0 | 3969 | 0.0697 | 80.1654 | 96.0441 | 11.2960 | 2.0548 |
| 0.0217 | 8.0 | 4536 | 0.0714 | 78.6078 | 96.3918 | 13.1114 | 1.9568 |
| 0.0177 | 9.0 | 5103 | 0.0732 | 80.7119 | 96.0813 | 11.8507 | 2.0916 |
| 0.0178 | 10.0 | 5670 | 0.0717 | 79.8444 | 96.2730 | 11.9516 | 1.9783 |
| 0.0142 | 11.0 | 6237 | 0.0692 | 68.7637 | 96.4883 | 20.9279 | 1.8251 |
| 0.0144 | 12.0 | 6804 | 0.0700 | 80.5359 | 94.8578 | 12.2542 | 3.4420 |
| 0.0119 | 13.0 | 7371 | 0.0718 | 80.6068 | 96.3883 | 11.7499 | 1.8650 |
| 0.0099 | 14.0 | 7938 | 0.0710 | 79.7237 | 96.5317 | 12.3046 | 1.7915 |
| 0.0089 | 15.0 | 8505 | 0.0725 | 79.6613 | 96.4755 | 11.9012 | 1.8986 |
| 0.008 | 16.0 | 9072 | 0.0720 | 82.1357 | 96.8505 | 10.9430 | 1.6169 |
| 0.0062 | 17.0 | 9639 | 0.0702 | 83.0745 | 96.7340 | 10.6909 | 1.6904 |
| 0.0059 | 18.0 | 10206 | 0.0698 | 79.5220 | 96.8042 | 11.8507 | 1.6628 |
| 0.0072 | 19.0 | 10773 | 0.0713 | 80.4408 | 96.8836 | 11.4473 | 1.6322 |
| 0.0049 | 20.0 | 11340 | 0.0716 | 81.6404 | 96.8682 | 11.2456 | 1.6292 |
| 0.0044 | 21.0 | 11907 | 0.0713 | 81.7670 | 96.9006 | 11.1952 | 1.6873 |
| 0.0035 | 22.0 | 12474 | 0.0718 | 80.5118 | 96.9222 | 11.4977 | 1.6230 |
| 0.0031 | 23.0 | 13041 | 0.0720 | 81.2657 | 97.0022 | 11.0439 | 1.5924 |
| 0.0031 | 24.0 | 13608 | 0.0723 | 82.0082 | 96.9102 | 11.0439 | 1.5955 |
| 0.0022 | 25.0 | 14175 | 0.0721 | 82.1310 | 97.0355 | 10.7917 | 1.5403 |
| 0.0022 | 26.0 | 14742 | 0.0726 | 83.0873 | 97.0320 | 10.8926 | 1.5373 |
| 0.002 | 27.0 | 15309 | 0.0711 | 82.5284 | 97.0864 | 10.9430 | 1.4944 |
| 0.002 | 28.0 | 15876 | 0.0710 | 83.1909 | 97.1182 | 10.6909 | 1.4852 |
| 0.0015 | 29.0 | 16443 | 0.0713 | 82.5500 | 97.0790 | 11.0943 | 1.5005 |
| 0.0013 | 30.0 | 17010 | 0.0714 | 82.3301 | 97.1735 | 11.2456 | 1.4638 |
### Framework versions
- Transformers 4.48.3
- Pytorch 2.5.1+cu124
- Datasets 3.3.2
- Tokenizers 0.21.0
|