AWQ Models
updated
TitanML/Qwen2-7B-Instruct-AWQ
Text Generation
• 8B • Updated • 1
• 1
TitanML/Qwen2-0.5B-Instruct-AWQ
Text Generation
• 0.6B • Updated
TitanML/Qwen2-1.5B-Instruct-AWQ
Text Generation
• 2B • Updated
TitanML/InternVL2-Llama3-76B-AWQ
Image-Text-to-Text
• Updated • 27
TitanML/tiny-mixtral-AWQ-4bit
Text Generation
• 0.2B • Updated • 43
TitanML/TinyLlama-1.1B-step-50K-105b-AWQ-4bit
Text Generation
• 1B • Updated • 2
TitanML/llama-3-8b-awq-experimental
Text Generation
• 8B • Updated
TitanML/Mistral-7B-Instruct-v0.3-AWQ-4bit
Text Generation
• 7B • Updated • 29
TitanML/Meta-Llama-3-70B-Instruct-AWQ-4bit
Text Generation
• 71B • Updated
TitanML/Llama3-8B-Chinese-Chat-AWQ-4bit
Text Generation
• 8B • Updated • 3
TitanML/Llama3-ChatQA-1.5-70B-AWQ-4bit
Text Generation
• 71B • Updated • 6
• 4
TitanML/ChatQA-1.5-8B-AWQ-4bit
Text Generation
• 8B • Updated • 4
TitanML/Mistral-7B-Instruct-v0.2-AWQ-4bit
Text Generation
• 7B • Updated • 3
TitanML/opt-125m-AWQ-4bit
Text Generation
• 0.2B • Updated • 2
TitanML/Llama3-OpenBioLLM-70B-AWQ-4bit
Text Generation
• 71B • Updated • 6.1k
TitanML/Meta-Llama-3-8B-AWQ-4bit
Text Generation
• 8B • Updated • 5
TitanML/Meta-Llama-3-8B-Instruct-AWQ-4bit
Text Generation
• 8B • Updated • 2
TitanML/llava-1.5-13b-hf-awq
Image-Text-to-Text
• 2B • Updated • 3
TitanML/llama2-70b-base-4bit-AWQ
Text Generation
• 69B • Updated • 2
TitanML/llama2-13b-base-4bit-AWQ
Text Generation
• 13B • Updated • 3
TitanML/llama2-7b-base-4bit-AWQ
Text Generation
• 7B • Updated • 2
TitanML/llama2-70b-chat-4bit-AWQ
Text Generation
• 69B • Updated • 4
TitanML/llama2-7b-chat-4bit-AWQ
Text Generation
• 7B • Updated • 20