abisee/cnn_dailymail
Viewer • Updated • 936k • 169k • 344
How to use JayasakthiBalaji/Text_Summarization_2e-5 with Transformers:
# Use a pipeline as a high-level helper
# Warning: Pipeline type "summarization" is no longer supported in transformers v5.
# You must load the model directly (see below) or downgrade to v4.x with:
# 'pip install "transformers<5.0.0'
from transformers import pipeline
pipe = pipeline("summarization", model="JayasakthiBalaji/Text_Summarization_2e-5") # Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("JayasakthiBalaji/Text_Summarization_2e-5")
model = AutoModelForSeq2SeqLM.from_pretrained("JayasakthiBalaji/Text_Summarization_2e-5")This is a text summarization fine-tuned model based on t5-small architecture with cnn_dailymail dataset.
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("JayasakthiBalaji/Text_Summarization_2e-5")
model = AutoModelForSeq2SeqLM.from_pretrained("JayasakthiBalaji/Text_Summarization_2e-5")
text = "Type your long story for summarization...."
inputs = tokenizer("summarize: " + text, return_tensors="pt", max_length=512, truncation=True)
outputs = model.generate(inputs.input_ids, max_length=150, min_length=40, length_penalty=2.0, num_beams=4, early_stopping=True)
summary = tokenizer.decode(outputs, skip_special_tokens=True)
print(summary)
Base model
google-t5/t5-small