Duplicated from banghua/n_rm
How to use berkeley-nest/Starling-RM-7B-alpha with Transformers:
# Load model directly from transformers import AutoTokenizer, LLMForSequenceRegression tokenizer = AutoTokenizer.from_pretrained("berkeley-nest/Starling-RM-7B-alpha") model = LLMForSequenceRegression.from_pretrained("berkeley-nest/Starling-RM-7B-alpha", device_map="auto")
What is a pickle import?
How to fix it?
