relaxml/Llama-2-13b-chat-QTIP-2Bit
2B • Updated • 1
relaxml/Llama-2-7b-chat-QTIP-2Bit
1B • Updated • 9
• 1
relaxml/Llama-3.1-405B-Instruct-QTIP-4Bit
105B • Updated • 9
relaxml/Llama-3.1-405B-Instruct-QTIP-3Bit
80B • Updated • 2
• 1
relaxml/Llama-2-7b-QTIP-4Bit
2B • Updated • 53
• 2
relaxml/Llama-2-7b-QTIP-3Bit
1B • Updated • 11
• 1
relaxml/Llama-2-13b-QTIP-3Bit
3B • Updated • 3
relaxml/Llama-2-70b-QTIP-3Bit
13B • Updated • 3
• 1
relaxml/Llama-2-13b-QTIP-4Bit
4B • Updated • 1
relaxml/Llama-2-70b-QTIP-4Bit
18B • Updated • 1
relaxml/Llama-2-70b-QTIP-2Bit
9B • Updated • 15
relaxml/Llama-2-13b-QTIP-2Bit
2B • Updated • 33
relaxml/Llama-3.1-8b-Instruct-QTIP-4Bit
3B • Updated • 28
• 2
relaxml/Llama-3.1-8b-Instruct-QTIP-3Bit
2B • Updated • 21
relaxml/Llama-2-70b-chat-E8PRVQ-4Bit
Text Generation
• 5B • Updated • 10
relaxml/Llama-2-13b-chat-E8PRVQ-4Bit
Text Generation
• 1B • Updated • 10
relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation
• 0.7B • Updated • 10
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation
• 5B • Updated • 12
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation
• 1B • Updated • 13
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation
• 0.7B • Updated • 12
relaxml/Llama-2-70b-chat-E8PRVQ-3Bit
Text Generation
• 4B • Updated • 3
relaxml/Llama-2-13b-chat-E8PRVQ-3Bit
Text Generation
• 0.9B • Updated • 12
relaxml/Llama-2-7b-chat-E8PRVQ-3Bit
Text Generation
• 0.6B • Updated • 13
relaxml/Llama-2-70b-E8PRVQ-3Bit
Text Generation
• 4B • Updated • 9
relaxml/Llama-2-13b-E8PRVQ-3Bit
Text Generation
• 0.9B • Updated • 9
relaxml/Llama-2-7b-E8PRVQ-3Bit
Text Generation
• 0.6B • Updated • 23
relaxml/Llama-2-70b-chat-E8P-2Bit
Text Generation
• 3B • Updated • 16
• 6
relaxml/Llama-2-13b-chat-E8P-2Bit
Text Generation
• 0.7B • Updated • 19
• 1
relaxml/Llama-2-7b-chat-E8P-2Bit
Text Generation
• 0.5B • Updated • 167
• 2
relaxml/Llama-2-70b-E8P-2Bit
Text Generation
• 3B • Updated • 10
• 3