relaxml/Llama-2-13b-chat-QTIP-2Bit
2B • Updated • 7
relaxml/Llama-2-7b-chat-QTIP-2Bit
1B • Updated • 7
• 1
relaxml/Llama-3.1-405B-Instruct-QTIP-4Bit
105B • Updated • 9
relaxml/Llama-3.1-405B-Instruct-QTIP-3Bit
80B • Updated • 10
• 1
relaxml/Llama-2-7b-QTIP-4Bit
2B • Updated • 12
• 2
relaxml/Llama-2-7b-QTIP-3Bit
1B • Updated • 20
• 1
relaxml/Llama-2-13b-QTIP-3Bit
3B • Updated • 8
relaxml/Llama-2-70b-QTIP-3Bit
13B • Updated • 20
• 1
relaxml/Llama-2-13b-QTIP-4Bit
4B • Updated • 6
relaxml/Llama-2-70b-QTIP-4Bit
18B • Updated • 7
relaxml/Llama-2-70b-QTIP-2Bit
9B • Updated • 34
relaxml/Llama-2-13b-QTIP-2Bit
2B • Updated • 13
relaxml/Llama-3.1-8b-Instruct-QTIP-4Bit
3B • Updated • 13
• 2
relaxml/Llama-3.1-8b-Instruct-QTIP-3Bit
2B • Updated • 13
relaxml/Llama-2-70b-chat-E8PRVQ-4Bit
Text Generation
• 5B • Updated • 17
relaxml/Llama-2-13b-chat-E8PRVQ-4Bit
Text Generation
• 1B • Updated • 18
relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation
• 0.7B • Updated • 17
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation
• 5B • Updated • 33
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation
• 1B • Updated • 18
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation
• 0.7B • Updated • 21
relaxml/Llama-2-70b-chat-E8PRVQ-3Bit
Text Generation
• 4B • Updated • 24
relaxml/Llama-2-13b-chat-E8PRVQ-3Bit
Text Generation
• 0.9B • Updated • 21
relaxml/Llama-2-7b-chat-E8PRVQ-3Bit
Text Generation
• 0.6B • Updated • 15
relaxml/Llama-2-70b-E8PRVQ-3Bit
Text Generation
• 4B • Updated • 56
relaxml/Llama-2-13b-E8PRVQ-3Bit
Text Generation
• 0.9B • Updated • 19
relaxml/Llama-2-7b-E8PRVQ-3Bit
Text Generation
• 0.6B • Updated • 40
relaxml/Llama-2-70b-chat-E8P-2Bit
Text Generation
• 3B • Updated • 23
• 6
relaxml/Llama-2-13b-chat-E8P-2Bit
Text Generation
• 0.7B • Updated • 22
• 1
relaxml/Llama-2-7b-chat-E8P-2Bit
Text Generation
• 0.5B • Updated • 17
• 2
relaxml/Llama-2-70b-E8P-2Bit
Text Generation
• 3B • Updated • 52
• 3