metadata
base_model: []
library_name: peft
tags:
- mergekit
- peft
R_128
This is a LoRA extracted from a language model. It was extracted using mergekit.
LoRA Details
This LoRA adapter was extracted from /home/sicarius/Impish_Nemo_12B/ and uses /home/sicarius/Nemo_12B_Vanilla/ as a base.
Parameters
The following command was used to extract this LoRA adapter:
/home/sicarius/mergekit/env/bin/mergekit-extract-lora --model /home/sicarius/Impish_Nemo_12B/ --base-model /home/sicarius/Nemo_12B_Vanilla/ --out-path /mnt/22TB_RED/AI_LLMs/LoRA_Extractions/Impish_Nemo_12B/R_128 --max-rank 128 --multi-gpu --cuda