End of training

README.md

@@ -0,0 +1,81 @@
+---
+license: apache-2.0
+base_model: Helsinki-NLP/opus-mt-en-zh
+tags:
+- generated_from_trainer
+metrics:
+- bleu
+model-index:
+- name: opus-mt-cantonese-v2
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# opus-mt-cantonese-v2
+
+This model is a fine-tuned version of [Helsinki-NLP/opus-mt-en-zh](https://huggingface.co/Helsinki-NLP/opus-mt-en-zh) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.8948
+- Bleu: 4.1931
+- Gen Len: 12.2403
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 20
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Bleu   | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|
+| No log        | 1.0   | 376  | 2.2222          | 1.4485 | 11.5939 |
+| 2.5401        | 2.0   | 752  | 1.9855          | 1.9434 | 11.6465 |
+| 1.7798        | 3.0   | 1128 | 1.8805          | 1.1681 | 11.9527 |
+| 1.4633        | 4.0   | 1504 | 1.8257          | 4.4967 | 12.6944 |
+| 1.4633        | 5.0   | 1880 | 1.7930          | 4.3143 | 12.4161 |
+| 1.1973        | 6.0   | 2256 | 1.8002          | 4.3407 | 12.0053 |
+| 1.0388        | 7.0   | 2632 | 1.7965          | 5.4944 | 12.4075 |
+| 0.9027        | 8.0   | 3008 | 1.7912          | 4.1324 | 12.486  |
+| 0.9027        | 9.0   | 3384 | 1.8020          | 4.5473 | 12.2044 |
+| 0.7774        | 10.0  | 3760 | 1.8120          | 4.3802 | 12.2237 |
+| 0.6928        | 11.0  | 4136 | 1.8218          | 5.683  | 12.484  |
+| 0.6229        | 12.0  | 4512 | 1.8346          | 4.8839 | 12.229  |
+| 0.6229        | 13.0  | 4888 | 1.8521          | 5.6593 | 12.2157 |
+| 0.5645        | 14.0  | 5264 | 1.8634          | 4.2758 | 12.1684 |
+| 0.5114        | 15.0  | 5640 | 1.8679          | 4.3432 | 12.2463 |
+| 0.4809        | 16.0  | 6016 | 1.8734          | 4.7905 | 12.2224 |
+| 0.4809        | 17.0  | 6392 | 1.8869          | 5.4113 | 12.2184 |
+| 0.447         | 18.0  | 6768 | 1.8902          | 5.4278 | 12.2543 |
+| 0.4278        | 19.0  | 7144 | 1.8943          | 4.2225 | 12.4095 |
+| 0.4179        | 20.0  | 7520 | 1.8948          | 4.1931 | 12.2403 |
+
+
+### Framework versions
+
+- Transformers 4.39.2
+- Pytorch 2.2.1+cu121
+- Datasets 2.18.0
+- Tokenizers 0.15.2

generation_config.json

@@ -0,0 +1,16 @@
+{
+  "bad_words_ids": [
+    [
+      65000
+    ]
+  ],
+  "bos_token_id": 0,
+  "decoder_start_token_id": 65000,
+  "eos_token_id": 0,
+  "forced_eos_token_id": 0,
+  "max_length": 512,
+  "num_beams": 4,
+  "pad_token_id": 65000,
+  "renormalize_logits": true,
+  "transformers_version": "4.39.2"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5ed811073c37d3188044f6f7ad22be1bf02a0099417733ce26f8d118ea3632d9
+oid sha256:130be9c02acc458e1ac86fff1b78d04251c02a9312b81fd90849f4fdaa48b69a
 size 309965092

runs/Apr02_02-11-01_ccdbbf4c8090/events.out.tfevents.1712023910.ccdbbf4c8090.423.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6610c1fc4fafecd94bd9cf21509e6ebad47800f4332f5827fcf84b589e2a32ee
-size 15808
+oid sha256:8e9a3220b404649419958d7c92b6c26adef7bfef7679c3ea1f48fc3b3cfe3c9a
+size 16532