Qwen/Qwen2.5-7B-Instruct
Text Generation • 8B • Updated • 12.9M • • 1.39k
Engineering w/ LLMs
<8B instruct models with AWQ, GPTQ quantizations available
-
-
Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4
Text Generation • 8B • Updated • 65.2k • 33 -
Qwen/Qwen2.5-7B-Instruct-AWQ
Text Generation • 8B • Updated • 3.52M • 47 -
meta-llama/Llama-3.2-3B-Instruct
Text Generation • 3B • Updated • 2.15M • • 2.29k -
ModelCloud/Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3
Text Generation • 4B • Updated • 12 • 5 -
fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_awq-int4-gs128-sym
Text Generation • 4B • Updated • 12 -
amd/Llama-3.2-3B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 15 -
mistralai/Mistral-7B-Instruct-v0.3
7B • Updated • 3.42M • 2.68k -
solidrust/Mistral-7B-Instruct-v0.3-AWQ
Text Generation • 7B • Updated • 5.53k • 10 -
RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation • 7B • Updated • 1.17k • 25 -
meta-llama/Llama-3.2-1B-Instruct
Text Generation • 1B • Updated • 8.71M • • 1.5k -
ciCic/llama-3.2-1B-Instruct-AWQ
Text Generation • 1B • Updated • 250 -
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v1
Text Generation • 1B • Updated • 41 • 2 -
fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int4-gs128-asym
Text Generation • 8B • Updated • 9 -
amd/Llama-3.1-8B-Instruct-awq-asym-uint4-g128-lmhead-onnx-hybrid
Updated • 27 -
fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-sym
Text Generation • 8B • Updated • 8 • 2 -
lurker18/Llama_3.1_8B_Instruct_AWQ_4bit
Text Generation • 8B • Updated • 279 • 1 -
Aaron2599/Meta-Llama-3.1-8B-Instruct-TurboMind-AWQ-4bit
Updated • 2 -
meta-llama/Llama-3.1-8B-Instruct
Text Generation • 8B • Updated • 9.87M • • 6.2k -
iqbalamo93/Meta-Llama-3.1-8B-Instruct-GPTQ-Q_8
Text Generation • 8B • Updated • 864 • 3 -
amd/Llama-3.2-1B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 40 -
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2.5
Text Generation • 1B • Updated • 45 • 5