How to use shirwu/rm_final_Llama-3.1-8B-Instruct with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="shirwu/rm_final_Llama-3.1-8B-Instruct")
# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("shirwu/rm_final_Llama-3.1-8B-Instruct") model = AutoModelForSequenceClassification.from_pretrained("shirwu/rm_final_Llama-3.1-8B-Instruct", device_map="auto")
How to fix it?
