here be dragons
Collection
8 items • Updated • 1
How to use DreadPoor/Everything-COT-8B-r128-LoRA with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("DreadPoor/Everything-COT-8B-r128-LoRA", dtype="auto")How to use DreadPoor/Everything-COT-8B-r128-LoRA with PEFT:
Task type is invalid.
This is a LoRA extracted from a language model. It was extracted using mergekit.
This LoRA adapter was extracted from FPHam/L3-8B-Everything-COT and uses NousResearch/Meta-Llama-3.1-8B-Instruct as a base.
The following command was used to extract this LoRA adapter:
mergekit-extract-lora FPHam/L3-8B-Everything-COT NousResearch/Meta-Llama-3.1-8B-Instruct OUTPUT_PATH --no-lazy-unpickle --skip-undecomposable --rank=128 --verbose