Instructions to use google/roberta2roberta_L-24_bbc with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/roberta2roberta_L-24_bbc with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "summarization" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("summarization", model="google/roberta2roberta_L-24_bbc")# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("google/roberta2roberta_L-24_bbc") model = AutoModelForSeq2SeqLM.from_pretrained("google/roberta2roberta_L-24_bbc") - Notebooks
- Google Colab
- Kaggle
Update config.json
Browse files- config.json +8 -8
config.json
CHANGED
|
@@ -2,6 +2,7 @@
|
|
| 2 |
"architectures": [
|
| 3 |
"EncoderDecoderModel"
|
| 4 |
],
|
|
|
|
| 5 |
"decoder": {
|
| 6 |
"add_cross_attention": true,
|
| 7 |
"architectures": [
|
|
@@ -63,6 +64,7 @@
|
|
| 63 |
"vocab_size": 50358,
|
| 64 |
"xla_device": null
|
| 65 |
},
|
|
|
|
| 66 |
"encoder": {
|
| 67 |
"add_cross_attention": false,
|
| 68 |
"architectures": [
|
|
@@ -124,13 +126,11 @@
|
|
| 124 |
"vocab_size": 50358,
|
| 125 |
"xla_device": null
|
| 126 |
},
|
|
|
|
| 127 |
"is_encoder_decoder": true,
|
|
|
|
| 128 |
"model_type": "encoder_decoder",
|
| 129 |
-
"
|
| 130 |
-
|
| 131 |
-
|
| 132 |
-
|
| 133 |
-
"decoder_start_token_id": 2,
|
| 134 |
-
"num_beams": 4,
|
| 135 |
-
"max_length": 128
|
| 136 |
-
}
|
|
|
|
| 2 |
"architectures": [
|
| 3 |
"EncoderDecoderModel"
|
| 4 |
],
|
| 5 |
+
"bos_token_id": 2,
|
| 6 |
"decoder": {
|
| 7 |
"add_cross_attention": true,
|
| 8 |
"architectures": [
|
|
|
|
| 64 |
"vocab_size": 50358,
|
| 65 |
"xla_device": null
|
| 66 |
},
|
| 67 |
+
"decoder_start_token_id": 2,
|
| 68 |
"encoder": {
|
| 69 |
"add_cross_attention": false,
|
| 70 |
"architectures": [
|
|
|
|
| 126 |
"vocab_size": 50358,
|
| 127 |
"xla_device": null
|
| 128 |
},
|
| 129 |
+
"eos_token_id": 1,
|
| 130 |
"is_encoder_decoder": true,
|
| 131 |
+
"max_length": 64,
|
| 132 |
"model_type": "encoder_decoder",
|
| 133 |
+
"num_beams": 4,
|
| 134 |
+
"pad_token_id": 0,
|
| 135 |
+
"tie_encoder_decoder": true
|
| 136 |
+
}
|
|
|
|
|
|
|
|
|
|
|
|