Instructions to use sahanes/Enlighten_Instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use sahanes/Enlighten_Instruct with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-Instruct-v0.2") model = PeftModel.from_pretrained(base_model, "sahanes/Enlighten_Instruct") - Notebooks
- Google Colab
- Kaggle
Update config.json
Browse files- config.json +2 -2
config.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
{
|
| 2 |
-
"model_type": "
|
| 3 |
-
"task_type": "
|
| 4 |
"peft_config": {
|
| 5 |
"lora_alpha": 16,
|
| 6 |
"lora_dropout": 0.1,
|
|
|
|
| 1 |
{
|
| 2 |
+
"model_type": "transformer",
|
| 3 |
+
"task_type": "CAUSAL_LM",
|
| 4 |
"peft_config": {
|
| 5 |
"lora_alpha": 16,
|
| 6 |
"lora_dropout": 0.1,
|