--- license: apache-2.0 tags: - generated_from_trainer datasets: - wmt16 - autoevaluate/wmt16-sample metrics: - bleu duplicated_from: autoevaluate/translation model-index: - name: autoevaluate/translation-not-evaluated results: - task: type: translation name: Translation dataset: name: autoevaluate/wmt16-ro-en-sample type: autoevaluate/wmt16-ro-en-sample config: autoevaluate--wmt16-ro-en-sample split: test metrics: - type: bleu value: 2.7663 name: BLEU verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjliZDkxYzhhNDNkYTZkN2Q1MjA5ZmNjYWE2ZjViZDc3ODhmYTZhZDY4N2ViNWZmZTMzZjUwZTQ3YWIwOWNkMSIsInZlcnNpb24iOjF9.D9Y87BbOzY4GpXSTN0OuSiE92DlZR7Go_aJXoPJPgZ5erlPBtRM4dM64VpOET2fOoOWBP2mqyXryovjIQca8Bg - type: loss value: 4.943170070648193 name: loss verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMWFkNGIxMjJiMTUyMjM5NWFkYjMyODM4N2IwNTZhMjBiMTQ3YmU0ZWY5YjY5ZWU5NmRhOTYyZTIxZjE2ODBjNiIsInZlcnNpb24iOjF9.mQGJnrn2U5tJ5B2LcoCTZQFdJtbsTvu3q0U-Vlcx1unwhKF2q9aNtusz3xJanANreHs19uNcXvto3gRYKUswDw - type: gen_len value: 40.35 name: gen_len verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMGJjODc5YTI2NzYxZTE2YzFlZTAzMTYzMTI5OWE4ZjU2MzdhNTZiOTUzOGRlZmMwNzI4ZjVhZTcwNGE0ODQyZCIsInZlcnNpb24iOjF9.gDcAyE1NYrHlz1zw4zNMGkL0vobpNhZpx2DYvMIJQmkydcv5mdKMzujuDy4xFmHtP4bQTkvH96m7tLxCv3SgCw --- # translation This model is a fine-tuned version of [Helsinki-NLP/opus-mt-en-ro](https://huggingface.co/Helsinki-NLP/opus-mt-en-ro) on the wmt16 dataset. It achieves the following results on the evaluation set: - Loss: 1.3170 - Bleu: 28.5866 - Gen Len: 33.9575 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 2e-05 - train_batch_size: 16 - eval_batch_size: 16 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - training_steps: 1000 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len | |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:| | 0.8302 | 0.03 | 1000 | 1.3170 | 28.5866 | 33.9575 | ### Framework versions - Transformers 4.19.2 - Pytorch 1.11.0+cu113 - Datasets 2.2.2 - Tokenizers 0.12.1