Instructions to use DaviadiAF/T5-Small_AbsSumm_XSumCNN with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use DaviadiAF/T5-Small_AbsSumm_XSumCNN with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "summarization" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("summarization", model="DaviadiAF/T5-Small_AbsSumm_XSumCNN")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("DaviadiAF/T5-Small_AbsSumm_XSumCNN") model = AutoModelForSeq2SeqLM.from_pretrained("DaviadiAF/T5-Small_AbsSumm_XSumCNN", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update README.md
6a2098a -
Update README.md
e959517 -
Create README.md
This is a T5-small model finetuned with XSUM and CNN/DailyMail dataset for abstractive summarization. The way both of the datasets are used is by concatenating both of them and took 20% of overall datasets due to limited resources on finetuning the model. The model achieved 0.25 on ROUGE-1, 0.08 on ROUGE-2, and 0,20 on ROUGE-L and ROUGE-LSum. The low scores on the ROUGE metrics might possibly achieved due to the limit put on the hyperparameters, the amount of data used for training and testing, and other circumstances such as the preprocessing of the data and such. A better and resourceful environment might be improve the performance of the model.227ace2
-
Training in progress, step 24500
ce28ade -
Training in progress, step 24000
3c5e9be -
Training in progress, step 23500
22bfe96 -
Training in progress, step 23000
1aebbf6 -
Training in progress, step 22500
d5a734c -
Training in progress, step 22000
2415e02 -
Training in progress, step 21500
10f83eb -
Training in progress, step 21000
ffd64b0 -
Training in progress, step 20500
3d5b3d4 -
Training in progress, step 20000
875323a -
Training in progress, step 19500
07c8adb -
Training in progress, step 19000
99a70a5 -
Training in progress, step 18500
e361111 -
Training in progress, step 18000
3a4e8ff -
Training in progress, step 17500
e72261f -
Training in progress, step 17000
81bb512 -
Training in progress, step 16500
0b20ac2 -
Training in progress, step 16000
d5cbf1d -
Training in progress, step 15500
ed4334b -
Training in progress, step 15000
064cd90 -
Training in progress, step 14500
9106b77 -
Training in progress, step 14000
47b59de -
Training in progress, step 13500
dd1b8b7 -
Training in progress, step 13000
c08fbc7 -
Training in progress, step 12500
5e0cd63 -
Training in progress, step 12000
a3f5d2f -
Training in progress, step 11500
211d7ec -
Training in progress, step 11000
49ee155 -
Training in progress, step 10500
3e5daa2 -
Training in progress, step 10000
31c56e1 -
Training in progress, step 9500
d3607ca -
Training in progress, step 9000
ce34f6c -
Training in progress, step 8500
6ff7543 -
Training in progress, step 8000
b8b171f -
Training in progress, step 7500
6e14e99 -
Training in progress, step 7000
7779e64 -
Training in progress, step 6500
d97c14a -
Training in progress, step 6000
aa760cb -
Training in progress, step 5500
c5259b1 -
Training in progress, step 5000
0403f20 -
Training in progress, step 4500
53ca521 -
Training in progress, step 4000
55ab1b6 -
Training in progress, step 3500
ec1eb11 -
Training in progress, step 3000
79204fd -
Training in progress, step 2500
e6495fa -
Training in progress, step 2000
54770c9 -
Training in progress, step 1500
e548727