openai/summarize_from_feedback
Viewer • Updated • 194k • 2.04k • 220
How to use saishshinde15/Summmary_Model_Llama-3.2-1B-Instruct with Transformers:
# Use a pipeline as a high-level helper
# Warning: Pipeline type "summarization" is no longer supported in transformers v5.
# You must load the model directly (see below) or downgrade to v4.x with:
# 'pip install "transformers<5.0.0'
from transformers import pipeline
pipe = pipeline("summarization", model="saishshinde15/Summmary_Model_Llama-3.2-1B-Instruct") # Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("saishshinde15/Summmary_Model_Llama-3.2-1B-Instruct")
model = AutoModelForCausalLM.from_pretrained("saishshinde15/Summmary_Model_Llama-3.2-1B-Instruct")This model has been fine-tuned to excel in generating concise and informative summaries from lengthy texts. It captures key ideas while presenting them in an easy-to-read bullet-point format.
openai/summarize_from_feedback for improved summarization capabilities.For the best results, please utilize the following tried-and-true prompt structure:
You are given the following text. Please provide a summary in 5-10 key points, depending on the length of the document. Each point should be clearly formatted in bullet format, starting with an asterisk (*).
**Note:** The examples provided below are for your reference only and should not be included in your response.
### Examples (for reference only):
* The sky is blue on a clear day.
* Water boils at 100 degrees Celsius.
* Trees produce oxygen through photosynthesis.
### Original Text:
{}
### Key Points Summary (in bullet points):
# Model Loading Instructions
To load this model, use the following code snippet:
```python
from peft import AutoPeftModelForCausalLM
from transformers import AutoTokenizer
# Replace "lora_model" with your actual model name
model = AutoPeftModelForCausalLM.from_pretrained(
"saishshinde15/Summmary_Model_Llama-3.2-1B-Instruct", # YOUR MODEL YOU USED FOR TRAINING
load_in_4bit=True, # Adjust as needed
)
tokenizer = AutoTokenizer.from_pretrained("saishshinde15/Summmary_Model_Llama-3.2-1B-Instruct")
Base model
meta-llama/Llama-3.2-1B-Instruct