Instructions to use berkeley-nest/Starling-RM-7B-alpha with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use berkeley-nest/Starling-RM-7B-alpha with Transformers:
# Load model directly from transformers import AutoTokenizer, LLMForSequenceRegression tokenizer = AutoTokenizer.from_pretrained("berkeley-nest/Starling-RM-7B-alpha") model = LLMForSequenceRegression.from_pretrained("berkeley-nest/Starling-RM-7B-alpha") - Notebooks
- Google Colab
- Kaggle
Can't download the model due to missing config.json
#6
by jeffrey-hpcnt - opened
Hi, first off, thanks for sharing the model.
I tried downloading the model via transformers library, but I'm running into this error: OSError: berkeley-nest/Starling-RM-7B-alpha does not appear to have a file named config.json. Checkout 'https://huggingface.co/berkeley-nest/Starling-RM-7B-alpha/main' for available files.
I think you also need to upload the model config file along with the weights. Thanks
nvm! the example inference code contains the method for loading the model.