Instructions to use allenai/PRIMERA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use allenai/PRIMERA with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("allenai/PRIMERA") model = AutoModelForSeq2SeqLM.from_pretrained("allenai/PRIMERA") - Notebooks
- Google Colab
- Kaggle
update config.json
Browse filesupdate max_position_embeddings as 4096, which is used in `run_summarization.py` in the huggingface library.
- config.json +1 -1
config.json
CHANGED
|
@@ -69,7 +69,7 @@
|
|
| 69 |
},
|
| 70 |
"max_decoder_position_embeddings": 1024,
|
| 71 |
"max_encoder_position_embeddings": 4096,
|
| 72 |
-
"max_position_embeddings":
|
| 73 |
"model_type": "led",
|
| 74 |
"normalize_before": false,
|
| 75 |
"normalize_embedding": true,
|
|
|
|
| 69 |
},
|
| 70 |
"max_decoder_position_embeddings": 1024,
|
| 71 |
"max_encoder_position_embeddings": 4096,
|
| 72 |
+
"max_position_embeddings": 4096,
|
| 73 |
"model_type": "led",
|
| 74 |
"normalize_before": false,
|
| 75 |
"normalize_embedding": true,
|