Instructions to use Whitzz/Mistral-Small-22b-LoRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Whitzz/Mistral-Small-22b-LoRA with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/mistral-7b-instruct-v0.2-bnb-4bit") model = PeftModel.from_pretrained(base_model, "Whitzz/Mistral-Small-22b-LoRA") - Notebooks
- Google Colab
- Kaggle
Update README.md
#1
by Saxhel - opened
README.md
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
---
|
| 2 |
-
base_model: mistral-7b-instruct-v0.2-bnb-4bit
|
| 3 |
library_name: peft
|
| 4 |
license: apache-2.0
|
| 5 |
language:
|
|
|
|
| 1 |
---
|
| 2 |
+
base_model: unsloth/mistral-7b-instruct-v0.2-bnb-4bit
|
| 3 |
library_name: peft
|
| 4 |
license: apache-2.0
|
| 5 |
language:
|