Instructions to use peft-internal-testing/tiny_T5ForSeq2SeqLM-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use peft-internal-testing/tiny_T5ForSeq2SeqLM-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForSeq2SeqLM base_model = AutoModelForSeq2SeqLM.from_pretrained("peft-internal-testing/tiny-T5ForConditionalGeneration") model = PeftModel.from_pretrained(base_model, "peft-internal-testing/tiny_T5ForSeq2SeqLM-lora") - Notebooks
- Google Colab
- Kaggle
Update adapter_config.json
Browse filesModel was removed from trl repo, replace with PEFT copy.
- adapter_config.json +1 -1
adapter_config.json
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
{
|
| 2 |
-
"base_model_name_or_path": "
|
| 3 |
"bias": "none",
|
| 4 |
"fan_in_fan_out": false,
|
| 5 |
"inference_mode": true,
|
|
|
|
| 1 |
{
|
| 2 |
+
"base_model_name_or_path": "peft-internal-testing/tiny-T5ForConditionalGeneration",
|
| 3 |
"bias": "none",
|
| 4 |
"fan_in_fan_out": false,
|
| 5 |
"inference_mode": true,
|