stephanedonna commited on
Commit
d07c4d9
·
verified ·
1 Parent(s): 49e22cb

Fine-tuned tupurri translation model

Browse files
README.md CHANGED
@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 1.6478
22
- - Bleu: 0.0002
23
  - Gen Len: 20.0
24
 
25
  ## Model description
@@ -43,7 +43,7 @@ The following hyperparameters were used during training:
43
  - train_batch_size: 8
44
  - eval_batch_size: 8
45
  - seed: 42
46
- - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
47
  - lr_scheduler_type: linear
48
  - num_epochs: 3
49
 
@@ -51,14 +51,14 @@ The following hyperparameters were used during training:
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
53
  |:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|
54
- | 1.9134 | 1.0 | 3122 | 1.7663 | 0.0022 | 20.0 |
55
- | 1.8039 | 2.0 | 6244 | 1.6726 | 0.0002 | 20.0 |
56
- | 1.7938 | 3.0 | 9366 | 1.6478 | 0.0002 | 20.0 |
57
 
58
 
59
  ### Framework versions
60
 
61
- - Transformers 4.47.1
62
- - Pytorch 2.5.1+cu121
63
- - Datasets 3.2.0
64
  - Tokenizers 0.21.0
 
18
 
19
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 1.6584
22
+ - Bleu: 0.0003
23
  - Gen Len: 20.0
24
 
25
  ## Model description
 
43
  - train_batch_size: 8
44
  - eval_batch_size: 8
45
  - seed: 42
46
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
47
  - lr_scheduler_type: linear
48
  - num_epochs: 3
49
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Bleu | Gen Len |
53
  |:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|
54
+ | 1.9396 | 1.0 | 3122 | 1.7739 | 0.0034 | 20.0 |
55
+ | 1.8273 | 2.0 | 6244 | 1.6790 | 0.0007 | 20.0 |
56
+ | 1.7973 | 3.0 | 9366 | 1.6584 | 0.0003 | 20.0 |
57
 
58
 
59
  ### Framework versions
60
 
61
+ - Transformers 4.48.3
62
+ - Pytorch 2.5.1+cu124
63
+ - Datasets 3.3.2
64
  - Tokenizers 0.21.0
config.json CHANGED
@@ -55,7 +55,7 @@
55
  }
56
  },
57
  "torch_dtype": "float32",
58
- "transformers_version": "4.47.1",
59
  "use_cache": true,
60
  "vocab_size": 32160
61
  }
 
55
  }
56
  },
57
  "torch_dtype": "float32",
58
+ "transformers_version": "4.48.3",
59
  "use_cache": true,
60
  "vocab_size": 32160
61
  }
generation_config.json CHANGED
@@ -2,5 +2,5 @@
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
  "pad_token_id": 0,
5
- "transformers_version": "4.47.1"
6
  }
 
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
  "pad_token_id": 0,
5
+ "transformers_version": "4.48.3"
6
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:44041284519bd7694a8397465524ea7a57fb1d363afb02f95707e170266740df
3
  size 242107432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43fd139d69262ca26e3db4409d1ba3d3ae0a71571f15a4693a4f37ad00c7f5c3
3
  size 242107432
tokenizer_config.json CHANGED
@@ -1,4 +1,5 @@
1
  {
 
2
  "added_tokens_decoder": {
3
  "0": {
4
  "content": "<pad>",
 
1
  {
2
+ "add_prefix_space": null,
3
  "added_tokens_decoder": {
4
  "0": {
5
  "content": "<pad>",