Instructions to use DaviadiAF/T5-Small_AbsSumm_XSumCNN with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use DaviadiAF/T5-Small_AbsSumm_XSumCNN with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "summarization" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("summarization", model="DaviadiAF/T5-Small_AbsSumm_XSumCNN")# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("DaviadiAF/T5-Small_AbsSumm_XSumCNN") model = AutoModelForSeq2SeqLM.from_pretrained("DaviadiAF/T5-Small_AbsSumm_XSumCNN") - Notebooks
- Google Colab
- Kaggle
Create README.md
Browse filesThis is a T5-small model finetuned with XSUM and CNN/DailyMail dataset for abstractive summarization. The way both of the datasets are used is by concatenating both of them and took 20% of overall datasets due to limited resources on finetuning the model. The model achieved 0.25 on ROUGE-1, 0.08 on ROUGE-2, and 0,20 on ROUGE-L and ROUGE-LSum. The low scores on the ROUGE metrics might possibly achieved due to the limit put on the hyperparameters, the amount of data used for training and testing, and other circumstances such as the preprocessing of the data and such. A better and resourceful environment might be improve the performance of the model.