ArthurZ HF Staff commited on
Commit
0c90125
·
1 Parent(s): 04f66ee

Update checkpoint for transformers >= 4.29

Browse files

Following the merge of [a PR](https://github.com/huggingface/transformers/pull/24310) in `transformers` it appeared that this model was not properly converted. This PR will fix the inference and was tested using the following script:

```python

>>> from transformers import MarianModel, MarianMTModel

>>> tokenizer = AutoTokenizer.from_pretrained(Helsinki-NLP/opus-mt-tc-big-gmw-gmw)

>>> inputs = tokenizer(Hey how are you?, return_tensors=pt, padding=True)

>>> model = MarianMTModel.from_pretrained(Helsinki-NLP/opus-mt-tc-big-gmw-gmw)

>>> print(tokenizer.batch_decode(model.generate(**inputs)))

['<pad> Hey he he he he he he he he he he he he? he he he he he? he he he? he he? he he he?? he he?? he he?? he he?? he he?? he he?? he he?? he he?? he he?? Hey??? he he??? he he?? he he?? Hey??? he he??? he????? Hey Hey Hey Hey he??? Hey Hey he he? Hey Hey Hey Hey Hey Hey?????? Hey Hey Hey Hey Hey Hey Hey Hey?? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey?? Hey Hey Hey Hey? Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey? Hey? Hey Hey Hey Hey Hey? Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey? Hey? Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey? Hey? Hey? Hey? Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey? Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey? Hey Hey? Hey Hey Hey? Hey Hey Hey? Hey? Hey? Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey? Hey Hey Hey Hey Hey? Hey? Hey? Hey? Hey? Hey Hey Hey Hey? Hey Hey Hey Hey Hey Hey? Hey Hey? Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey Hey</s>']

```

Files changed (3) hide show
  1. config.json +1 -1
  2. generation_config.json +1 -1
  3. model.safetensors +3 -0
config.json CHANGED
@@ -40,7 +40,7 @@
40
  "share_encoder_decoder_embeddings": true,
41
  "static_position_embeddings": true,
42
  "torch_dtype": "float32",
43
- "transformers_version": "4.34.0",
44
  "use_cache": true,
45
  "vocab_size": 35698
46
  }
 
40
  "share_encoder_decoder_embeddings": true,
41
  "static_position_embeddings": true,
42
  "torch_dtype": "float32",
43
+ "transformers_version": "4.35.0.dev0",
44
  "use_cache": true,
45
  "vocab_size": 35698
46
  }
generation_config.json CHANGED
@@ -12,5 +12,5 @@
12
  "num_beams": 4,
13
  "pad_token_id": 35697,
14
  "renormalize_logits": true,
15
- "transformers_version": "4.34.0"
16
  }
 
12
  "num_beams": 4,
13
  "pad_token_id": 35697,
14
  "renormalize_logits": true,
15
+ "transformers_version": "4.35.0.dev0"
16
  }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffac3c3ea6f341cd5c00536dd785656f347213536d12b7f1b3f6dfaee712b766
3
+ size 851820920