ModuLoRA: Finetuning 3-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers
Paper
•
2309.16119
•
Published
•
1
AI & ML interests
Compute-Constrained Data Selection
osieosie
authored
a
paper
over 1 year ago
osieosie
updated
19
models
over 1 year ago
CCDS-Scaling/llama2-7b-ifeval-less-p0.50-lora-seed3-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.50-lora-seed2-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.50-lora-seed1-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.25-lora-seed2-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.25-lora-seed1-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.10-lora-seed3-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.10-lora-seed2-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.10-lora-seed1-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.05-lora-seed5-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.05-lora-seed4-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.05-lora-seed3-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.05-lora-seed2-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.05-lora-seed1-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.025-lora-seed5-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.025-lora-seed4-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.025-lora-seed3-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.025-lora-seed2-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-less-p0.025-lora-seed1-linear-1epoch
Updated
CCDS-Scaling/llama2-7b-ifeval-embed-p0.50-lora-seed3-linear-1epoch
Updated