Instructions to use google/roberta2roberta_L-24_bbc with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/roberta2roberta_L-24_bbc with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "summarization" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("summarization", model="google/roberta2roberta_L-24_bbc")# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("google/roberta2roberta_L-24_bbc") model = AutoModelForSeq2SeqLM.from_pretrained("google/roberta2roberta_L-24_bbc") - Notebooks
- Google Colab
- Kaggle
Update config.json
Browse files- config.json +2 -2
config.json
CHANGED
|
@@ -6,7 +6,7 @@
|
|
| 6 |
"decoder": {
|
| 7 |
"add_cross_attention": true,
|
| 8 |
"architectures": [
|
| 9 |
-
"
|
| 10 |
],
|
| 11 |
"attention_probs_dropout_prob": 0.1,
|
| 12 |
"bad_words_ids": null,
|
|
@@ -68,7 +68,7 @@
|
|
| 68 |
"encoder": {
|
| 69 |
"add_cross_attention": false,
|
| 70 |
"architectures": [
|
| 71 |
-
"
|
| 72 |
],
|
| 73 |
"attention_probs_dropout_prob": 0.1,
|
| 74 |
"bad_words_ids": null,
|
|
|
|
| 6 |
"decoder": {
|
| 7 |
"add_cross_attention": true,
|
| 8 |
"architectures": [
|
| 9 |
+
"BertGenerationEncoder"
|
| 10 |
],
|
| 11 |
"attention_probs_dropout_prob": 0.1,
|
| 12 |
"bad_words_ids": null,
|
|
|
|
| 68 |
"encoder": {
|
| 69 |
"add_cross_attention": false,
|
| 70 |
"architectures": [
|
| 71 |
+
"BertGenerationDecoder"
|
| 72 |
],
|
| 73 |
"attention_probs_dropout_prob": 0.1,
|
| 74 |
"bad_words_ids": null,
|