Instructions to use BrainGPT/BrainGPT-7B-v0.2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use BrainGPT/BrainGPT-7B-v0.2 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/datadrive1/ken/.cache/huggingface/hub/models--mistralai--Mistral-7B-v0.1/snapshots/26bca36bde8333b5d7f72e9ed20ccda6a618af24") model = PeftModel.from_pretrained(base_model, "BrainGPT/BrainGPT-7B-v0.2") - Notebooks
- Google Colab
- Kaggle