Instructions to use NewEden/rei-lora-test with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use NewEden/rei-lora-test with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("/home/dgxuser/workspace/Mango/models/dphn-kto-final-merged") model = PeftModel.from_pretrained(base_model, "NewEden/rei-lora-test") - Notebooks
- Google Colab
- Kaggle
rei-dphn-lora
This is a LoRA extracted from a language model. It was extracted using mergekit.
LoRA Details
This LoRA adapter was extracted from /home/dgxuser/workspace/Mango/models/Rei-24B and uses /home/dgxuser/workspace/Mango/models/dphn-kto-final-merged as a base.
Parameters
The following command was used to extract this LoRA adapter:
/raid/workspace/Mango/mergekit/.venv/bin/mergekit-extract-lora --model /home/dgxuser/workspace/Mango/models/Rei-24B --base-model /home/dgxuser/workspace/Mango/models/dphn-kto-final-merged --out-path ./outputs/rei-dphn-lora --cuda --max-rank=16
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support