---
library_name: transformers
tags:
- generated_from_trainer
metrics:
- bleu
model-index:
- name: train_4
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# train_4

This model was trained from scratch on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.2634
- Bleu: 41.2138
- Chrf: 62.1018
- Meteor: 0.6063
- Gen Len: 12.0513

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 128
- eval_batch_size: 128
- seed: 42
- optimizer: Use adamw_torch_fused with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 5000
- num_epochs: 200

### Training results

| Training Loss | Epoch | Step   | Validation Loss | Bleu    | Chrf    | Meteor | Gen Len |
|:-------------:|:-----:|:------:|:---------------:|:-------:|:-------:|:------:|:-------:|
| 0.0315        | 1.0   | 7999   | 0.2397          | 41.3664 | 62.1386 | 0.6072 | 12.0471 |
| 0.031         | 2.0   | 15998  | 0.2417          | 41.2882 | 61.9925 | 0.6082 | 12.0537 |
| 0.0308        | 3.0   | 23997  | 0.2431          | 41.3403 | 62.1009 | 0.607  | 12.0402 |
| 0.0307        | 4.0   | 31996  | 0.2440          | 41.3147 | 62.0719 | 0.6058 | 12.0619 |
| 0.03          | 5.0   | 39995  | 0.2460          | 41.5271 | 62.2126 | 0.6075 | 12.0566 |
| 0.0294        | 6.0   | 47994  | 0.2482          | 41.4353 | 62.1959 | 0.6087 | 12.0842 |
| 0.0294        | 7.0   | 55993  | 0.2486          | 41.2568 | 62.2425 | 0.608  | 12.0799 |
| 0.029         | 8.0   | 63992  | 0.2501          | 41.1446 | 62.0782 | 0.6069 | 12.0694 |
| 0.0285        | 9.0   | 71991  | 0.2489          | 41.1554 | 61.9691 | 0.606  | 12.0449 |
| 0.0283        | 10.0  | 79990  | 0.2518          | 40.9903 | 62.0095 | 0.607  | 12.0369 |
| 0.0278        | 11.0  | 87989  | 0.2523          | 41.0357 | 62.2308 | 0.6075 | 12.0701 |
| 0.028         | 12.0  | 95988  | 0.2534          | 40.7796 | 61.9287 | 0.6058 | 12.0524 |
| 0.0275        | 13.0  | 103987 | 0.2546          | 41.2298 | 62.1716 | 0.6072 | 12.0691 |
| 0.027         | 14.0  | 111986 | 0.2565          | 41.0546 | 62.0676 | 0.6068 | 12.0681 |
| 0.0269        | 15.0  | 119985 | 0.2577          | 41.2507 | 62.1826 | 0.6075 | 12.0539 |
| 0.0265        | 16.0  | 127984 | 0.2578          | 41.0927 | 62.1228 | 0.607  | 12.0877 |
| 0.0265        | 17.0  | 135983 | 0.2609          | 41.0459 | 62.1203 | 0.607  | 12.067  |
| 0.0258        | 18.0  | 143982 | 0.2632          | 41.0598 | 62.0328 | 0.6064 | 12.077  |
| 0.0259        | 19.0  | 151981 | 0.2606          | 41.1115 | 62.1225 | 0.6077 | 12.0667 |
| 0.0256        | 20.0  | 159980 | 0.2634          | 41.2138 | 62.1018 | 0.6063 | 12.0513 |


### Framework versions

- Transformers 4.51.3
- Pytorch 2.8.0.dev20250429
- Datasets 2.14.0
- Tokenizers 0.21.1