ModelCloud/TinyLlama-1.1B-Chat-v1.0-autoround-4bit Text Generation • 0.3B • Updated Jul 12, 2024 • 14
ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit Text Generation • 12B • Updated Jul 23, 2024 • 14 • 5
ModelCloud/TinyLlama-1.1B-Chat-v1.0-GPTQ-4bit-sharded Text Generation • 1B • Updated Jul 23, 2024 • 17
ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit Text Generation • 8B • Updated Jul 29, 2024 • 698 • 4
ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit Text Generation • 71B • Updated Jul 27, 2024 • 26 • 4
ModelCloud/Mistral-Large-Instruct-2407-gptq-4bit Text Generation • 123B • Updated Jul 26, 2024 • 19 • 1
ModelCloud/Meta-Llama-3.1-405B-Instruct-gptq-4bit Text Generation • 410B • Updated Jul 30, 2024 • 22 • 2
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v1 Text Generation • 1B • Updated Nov 11, 2024 • 157 • 2
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2 Text Generation • 1B • Updated Nov 11, 2024 • 28 • 3
ModelCloud/Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3 Text Generation • 4B • Updated Nov 11, 2024 • 37 • 5