Instructions to use Eterna2/alpaca-lora-7b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Eterna2/alpaca-lora-7b with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("decapoda-research/llama-7b-hf") model = PeftModel.from_pretrained(base_model, "Eterna2/alpaca-lora-7b") - Notebooks
- Google Colab
- Kaggle
Remove enable_lora arg
#2
by twclark - opened
- adapter_config.json +0 -1
adapter_config.json
CHANGED
|
@@ -1,7 +1,6 @@
|
|
| 1 |
{
|
| 2 |
"base_model_name_or_path": "decapoda-research/llama-7b-hf",
|
| 3 |
"bias": "none",
|
| 4 |
-
"enable_lora": null,
|
| 5 |
"fan_in_fan_out": false,
|
| 6 |
"inference_mode": true,
|
| 7 |
"lora_alpha": 16,
|
|
|
|
| 1 |
{
|
| 2 |
"base_model_name_or_path": "decapoda-research/llama-7b-hf",
|
| 3 |
"bias": "none",
|
|
|
|
| 4 |
"fan_in_fan_out": false,
|
| 5 |
"inference_mode": true,
|
| 6 |
"lora_alpha": 16,
|