MiniLLM/MiniLLM-gpt2-340M
Text Generation β’ Updated β’ 376 β’ 6
AI & ML interests
Training efficient language models (MiniLLM, MiniPLM)
MiniLLM/SFT-gpt2-120M
Text Generation β’ 0.1B β’ Updated β’ 398
MiniLLM/SFT-gpt2-760M
Text Generation β’ 0.8B β’ Updated β’ 5
MiniLLM/MiniPLM-Qwen-500M
Text Generation β’ 0.5B β’ Updated β’ 14 β’ β’ 7
MiniLLM/MiniPLM-llama3.1-212M
Text Generation β’ 0.2B β’ Updated β’ 14 β’ 6
MiniLLM/MiniPLM-Mamba-130M
Text Generation β’ 0.1B β’ Updated β’ 14 β’ 4
MiniLLM/MiniPLM-Qwen-1.2B
Text Generation β’ 1B β’ Updated β’ 9 β’ 4
MiniLLM/Ref-Pretrain-Qwen-104M
Text Generation β’ 0.1B β’ Updated β’ 14 β’ 2
MiniLLM/Pretrain-Qwen-1.2B
Text Generation β’ 1B β’ Updated β’ 10
MiniLLM/Pretrain-Qwen-500M
Text Generation β’ 0.5B β’ Updated β’ 8
MiniLLM/Pretrain-Qwen-200M
Text Generation β’ 0.2B β’ Updated β’ 5
MiniLLM/VanillaKD-Pretrain-Qwen-200M
Text Generation β’ 0.2B β’ Updated β’ 3
MiniLLM/VanillaKD-Pretrain-Qwen-500M
Text Generation β’ 0.5B β’ Updated β’ 16 β’
MiniLLM/VanillaKD-Pretrain-Qwen-1.2B
Text Generation β’ 1B β’ Updated β’ 4
MiniLLM/init-gpt2-120M
Text Generation β’ 0.1B β’ Updated β’ 395 β’ 1
MiniLLM/teacher-Llama-13B
Text Generation β’ Updated β’ 5
MiniLLM/MiniLLM-Llama-7B
Text Generation β’ Updated β’ 8 β’ 3
MiniLLM/MiniPLM-Qwen-200M
Text Generation β’ 0.2B β’ Updated β’ 79 β’ 9
MiniLLM/init-Llama-7B
Text Generation β’ Updated β’ 5
MiniLLM/teacher-OPT-13B
Text Generation β’ Updated β’ 7
MiniLLM/SeqKD-Llama-7B
Text Generation β’ Updated β’ 6
MiniLLM/KD-Llama-7B
Text Generation β’ Updated β’ 6
MiniLLM/SFT-Llama-7B
Text Generation β’ Updated β’ 4
MiniLLM/init-OPT-6.7B
Text Generation β’ Updated β’ 5
MiniLLM/init-OPT-2.7B
Text Generation β’ Updated β’ 5
MiniLLM/init-OPT-1.3B
Text Generation β’ Updated β’ 5
MiniLLM/SeqKD-OPT-6.7B
Text Generation β’ Updated β’ 5
MiniLLM/SeqKD-OPT-2.7B
Text Generation β’ Updated β’ 5
MiniLLM/SeqKD-OPT-1.3B
Text Generation β’ Updated β’ 13
MiniLLM/KD-OPT-6.7B
Text Generation β’ Updated β’ 5