Update checkpoint for transformers >= 4.29
Browse filesFollowing the merge of [a PR](https://github.com/huggingface/transformers/pull/24310) in `transformers` it appeared that this model was not properly converted. This PR will fix the inference and was tested using the following script:
```python
>>> from transformers import MarianModel, MarianMTModel
>>> tokenizer = AutoTokenizer.from_pretrained(Helsinki-NLP/opus-mt-tc-big-gmw-gmw)
>>> inputs = tokenizer(Hey how are you?, return_tensors=pt, padding=True)
>>> model = MarianMTModel.from_pretrained(Helsinki-NLP/opus-mt-tc-big-gmw-gmw)
>>> print(tokenizer.batch_decode(model.generate(**inputs)))
['<pad> Hey he he he he he he he he he he he he? he he he he he? he he he? he he? he he he?? he he?? he he?? he he?? he he?? he he?? he he?? he he?? he he?? Hey??? he he??? he he?? he he?? Hey??? he he??? he????? Hey Hey Hey Hey he??? Hey Hey he he? Hey Hey Hey Hey Hey Hey?????? Hey Hey Hey Hey Hey Hey Hey Hey?? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey?? Hey Hey Hey Hey? Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey? Hey? Hey Hey Hey Hey Hey? Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey? Hey? Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey? Hey? Hey? Hey? Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey? Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey? Hey Hey? Hey Hey Hey? Hey Hey Hey? Hey? Hey? Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey? Hey? Hey? Hey? Hey? Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey? Hey Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey</s>']
```
- config.json +1 -1
- generation_config.json +1 -1
- model.safetensors +3 -0
|
@@ -40,7 +40,7 @@
|
|
| 40 |
"share_encoder_decoder_embeddings": true,
|
| 41 |
"static_position_embeddings": true,
|
| 42 |
"torch_dtype": "float32",
|
| 43 |
-
"transformers_version": "4.
|
| 44 |
"use_cache": true,
|
| 45 |
"vocab_size": 35698
|
| 46 |
}
|
|
|
|
| 40 |
"share_encoder_decoder_embeddings": true,
|
| 41 |
"static_position_embeddings": true,
|
| 42 |
"torch_dtype": "float32",
|
| 43 |
+
"transformers_version": "4.35.0.dev0",
|
| 44 |
"use_cache": true,
|
| 45 |
"vocab_size": 35698
|
| 46 |
}
|
|
@@ -12,5 +12,5 @@
|
|
| 12 |
"num_beams": 4,
|
| 13 |
"pad_token_id": 35697,
|
| 14 |
"renormalize_logits": true,
|
| 15 |
-
"transformers_version": "4.
|
| 16 |
}
|
|
|
|
| 12 |
"num_beams": 4,
|
| 13 |
"pad_token_id": 35697,
|
| 14 |
"renormalize_logits": true,
|
| 15 |
+
"transformers_version": "4.35.0.dev0"
|
| 16 |
}
|
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ffac3c3ea6f341cd5c00536dd785656f347213536d12b7f1b3f6dfaee712b766
|
| 3 |
+
size 851820920
|