Extracted LoRA (mergekit)
Collection
PEFT-compatible LoRA adapters produced by mergekit-extract-lora • 17 items • Updated • 4
How to use ngxson/LoRA-Human-Like-Qwen2.5-7B-Instruct with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("ngxson/LoRA-Human-Like-Qwen2.5-7B-Instruct", dtype="auto")How to use ngxson/LoRA-Human-Like-Qwen2.5-7B-Instruct with PEFT:
Task type is invalid.
This is a LoRA extracted from a language model. It was extracted using mergekit.
This LoRA adapter was extracted from HumanLLMs/Human-Like-Qwen2.5-7B-Instruct and uses Qwen/Qwen2.5-7B-Instruct as a base.
The following command was used to extract this LoRA adapter:
mergekit-extract-lora HumanLLMs/Human-Like-Qwen2.5-7B-Instruct Qwen/Qwen2.5-7B-Instruct OUTPUT_PATH --rank=64 --device=cuda
Base model
Qwen/Qwen2.5-7B