abisee/cnn_dailymail
Viewer • Updated • 936k • 161k • 343
How to use manojpreveen/distilbart-cnn-v2 with Transformers:
# Use a pipeline as a high-level helper
# Warning: Pipeline type "summarization" is no longer supported in transformers v5.
# You must load the model directly (see below) or downgrade to v4.x with:
# 'pip install "transformers<5.0.0'
from transformers import pipeline
pipe = pipeline("summarization", model="manojpreveen/distilbart-cnn-v2") # Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("manojpreveen/distilbart-cnn-v2")
model = AutoModelForSeq2SeqLM.from_pretrained("manojpreveen/distilbart-cnn-v2")https://github.com/manojpreveen/Summarization-Service
This checkpoint should be loaded into BartForConditionalGeneration.from_pretrained. See the BART docs for more information.
| Model Name | MM Params | Inference Time (MS) | Speedup | Rouge 2 | Rouge-L |
|---|---|---|---|---|---|
| facebook/bart-large-cnn (baseline) | 406 | 381 | 1 | 21.06 | 30.63 |
| manojpreveen/distilbart-cnn-v3 | 306 | 307 | 1.24 | 21.26 | 30.59 |
| manojpreveen/distilbart-cnn-v2 | 255 | 214 | 1.78 | 20.57 | 30.00 |
| manojpreveen/distilbart-cnn-v1 | 230 | 182 | 2.09 | 20.17 | 29.70 |