julianubc commited on
Commit
a8d73db
·
verified ·
1 Parent(s): abb7f46

lab1_finetuning

Browse files
Files changed (2) hide show
  1. README.md +75 -75
  2. generation_config.json +16 -16
README.md CHANGED
@@ -1,75 +1,75 @@
1
- ---
2
- library_name: transformers
3
- license: apache-2.0
4
- base_model: Helsinki-NLP/opus-mt-en-fr
5
- tags:
6
- - generated_from_trainer
7
- datasets:
8
- - kde4
9
- metrics:
10
- - bleu
11
- model-index:
12
- - name: lab1_finetuning
13
- results:
14
- - task:
15
- name: Sequence-to-sequence Language Modeling
16
- type: text2text-generation
17
- dataset:
18
- name: kde4
19
- type: kde4
20
- config: en-fr
21
- split: train
22
- args: en-fr
23
- metrics:
24
- - name: Bleu
25
- type: bleu
26
- value: 46.69934571054472
27
- ---
28
-
29
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
30
- should probably proofread and complete it, then remove this comment. -->
31
-
32
- # lab1_finetuning
33
-
34
- This model is a fine-tuned version of [Helsinki-NLP/opus-mt-en-fr](https://huggingface.co/Helsinki-NLP/opus-mt-en-fr) on the kde4 dataset.
35
- It achieves the following results on the evaluation set:
36
- - Loss: 1.2297
37
- - Model Preparation Time: 0.015
38
- - Bleu: 46.6993
39
-
40
- ## Model description
41
-
42
- More information needed
43
-
44
- ## Intended uses & limitations
45
-
46
- More information needed
47
-
48
- ## Training and evaluation data
49
-
50
- More information needed
51
-
52
- ## Training procedure
53
-
54
- ### Training hyperparameters
55
-
56
- The following hyperparameters were used during training:
57
- - learning_rate: 2e-05
58
- - train_batch_size: 16
59
- - eval_batch_size: 32
60
- - seed: 42
61
- - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
62
- - lr_scheduler_type: linear
63
- - training_steps: 1000
64
- - mixed_precision_training: Native AMP
65
-
66
- ### Training results
67
-
68
-
69
-
70
- ### Framework versions
71
-
72
- - Transformers 4.48.2
73
- - Pytorch 2.5.1+cu124
74
- - Datasets 3.3.0
75
- - Tokenizers 0.21.0
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: Helsinki-NLP/opus-mt-en-fr
5
+ tags:
6
+ - generated_from_trainer
7
+ datasets:
8
+ - kde4
9
+ metrics:
10
+ - bleu
11
+ model-index:
12
+ - name: lab1_finetuning
13
+ results:
14
+ - task:
15
+ name: Sequence-to-sequence Language Modeling
16
+ type: text2text-generation
17
+ dataset:
18
+ name: kde4
19
+ type: kde4
20
+ config: en-fr
21
+ split: train
22
+ args: en-fr
23
+ metrics:
24
+ - name: Bleu
25
+ type: bleu
26
+ value: 46.71957567393355
27
+ ---
28
+
29
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
30
+ should probably proofread and complete it, then remove this comment. -->
31
+
32
+ # lab1_finetuning
33
+
34
+ This model is a fine-tuned version of [Helsinki-NLP/opus-mt-en-fr](https://huggingface.co/Helsinki-NLP/opus-mt-en-fr) on the kde4 dataset.
35
+ It achieves the following results on the evaluation set:
36
+ - Loss: 1.2294
37
+ - Model Preparation Time: 0.0032
38
+ - Bleu: 46.7196
39
+
40
+ ## Model description
41
+
42
+ More information needed
43
+
44
+ ## Intended uses & limitations
45
+
46
+ More information needed
47
+
48
+ ## Training and evaluation data
49
+
50
+ More information needed
51
+
52
+ ## Training procedure
53
+
54
+ ### Training hyperparameters
55
+
56
+ The following hyperparameters were used during training:
57
+ - learning_rate: 2e-05
58
+ - train_batch_size: 16
59
+ - eval_batch_size: 32
60
+ - seed: 42
61
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
62
+ - lr_scheduler_type: linear
63
+ - training_steps: 1000
64
+ - mixed_precision_training: Native AMP
65
+
66
+ ### Training results
67
+
68
+
69
+
70
+ ### Framework versions
71
+
72
+ - Transformers 4.48.1
73
+ - Pytorch 2.5.1+cu118
74
+ - Datasets 3.2.0
75
+ - Tokenizers 0.21.0
generation_config.json CHANGED
@@ -1,16 +1,16 @@
1
- {
2
- "bad_words_ids": [
3
- [
4
- 59513
5
- ]
6
- ],
7
- "bos_token_id": 0,
8
- "decoder_start_token_id": 59513,
9
- "eos_token_id": 0,
10
- "forced_eos_token_id": 0,
11
- "max_length": 512,
12
- "num_beams": 4,
13
- "pad_token_id": 59513,
14
- "renormalize_logits": true,
15
- "transformers_version": "4.48.2"
16
- }
 
1
+ {
2
+ "bad_words_ids": [
3
+ [
4
+ 59513
5
+ ]
6
+ ],
7
+ "bos_token_id": 0,
8
+ "decoder_start_token_id": 59513,
9
+ "eos_token_id": 0,
10
+ "forced_eos_token_id": 0,
11
+ "max_length": 512,
12
+ "num_beams": 4,
13
+ "pad_token_id": 59513,
14
+ "renormalize_logits": true,
15
+ "transformers_version": "4.48.1"
16
+ }