Qwen/Qwen2.5-7B-Instruct
Text Generation • 8B • Updated • 7.14M • • 2.44k
Engineering w/ LLMs
<8B instruct models with AWQ, GPTQ quantizations available
-
-
Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4
Text Generation • 8B • Updated • 297k • 37 -
Qwen/Qwen2.5-7B-Instruct-AWQ
Text Generation • 8B • Updated • 2.26M • 58 -
meta-llama/Llama-3.2-3B-Instruct
Text Generation • 3B • Updated • 1.25M • • 2.8k -
ModelCloud/Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3
Text Generation • 4B • Updated • 36 • 5 -
fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_awq-int4-gs128-sym
Text Generation • 4B • Updated • 16 -
amd/Llama-3.2-3B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 30 -
mistralai/Mistral-7B-Instruct-v0.3
7B • Updated • 1.99M • 3.8k -
solidrust/Mistral-7B-Instruct-v0.3-AWQ
Text Generation • 7B • Updated • 36.9k • 11 -
RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation • 7B • Updated • 820 • 25 -
meta-llama/Llama-3.2-1B-Instruct
Text Generation • 1B • Updated • 5.84M • • 1.85k -
ciCic/llama-3.2-1B-Instruct-AWQ
Text Generation • 1B • Updated • 23 -
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v1
Text Generation • 1B • Updated • 177 • 2 -
fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int4-gs128-asym
Text Generation • 8B • Updated • 39 -
amd/Llama-3.1-8B-Instruct-awq-asym-uint4-g128-lmhead-onnx-hybrid
Updated • 20 -
fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-sym
Text Generation • 8B • Updated • 28 • 2 -
lurker18/Llama_3.1_8B_Instruct_AWQ_4bit
Text Generation • 8B • Updated • 26 • 1 -
Aaron2599/Meta-Llama-3.1-8B-Instruct-TurboMind-AWQ-4bit
Updated • 22 • 1 -
meta-llama/Llama-3.1-8B-Instruct
Text Generation • 8B • Updated • 5.76M • • 8.46k -
iqbalamo93/Meta-Llama-3.1-8B-Instruct-GPTQ-Q_8
Text Generation • 8B • Updated • 71 • 3 -
amd/Llama-3.2-1B-Instruct-awq-g128-int4-asym-fp16-onnx-hybrid
Updated • 26 -
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2.5
Text Generation • 1B • Updated • 89 • 5