kromcomp/L3-Gradient-1048k-r256-LoRA

Gradient-1048k-r256-LoRA

This is a LoRA extracted from a language model. It was extracted using mergekit.

LoRA Details

This LoRA adapter was extracted from gradientai/Llama-3-8B-Instruct-Gradient-1048k and uses NousResearch/Meta-Llama-3-8B-Instruct as a base.

Parameters

The following command was used to extract this LoRA adapter:

/usr/local/bin/mergekit-extract-lora --out-path=loras/Gradient-1048k-r256-LoRA --model=gradientai/Llama-3-8B-Instruct-Gradient-1048k --base-model=NousResearch/Meta-Llama-3-8B-Instruct --no-lazy-unpickle --max-rank=256 --gpu-rich -v --embed-lora --skip-undecomposable