Llama Quantized - bnb Contains Llama Models Quantized using bitsandbytes. lierseleow/Llama-3.3-70B-Instruct-bnb-8bit 71B • Updated Aug 23 • 11 lierseleow/Llama-3.3-70B-Instruct-bnb-4bit 71B • Updated Aug 23 • 11 lierseleow/Llama-3.1-70B-Instruct-bnb-8bit 71B • Updated Aug 23 • 11 lierseleow/Llama-3.1-70B-Instruct-bnb-4bit 71B • Updated Aug 23 • 11
Qwen Quantized - bnb Contains Qwen Models Quantized using bitsandbytes. lierseleow/Qwen2.5-32B-Instruct-bnb-4bit 33B • Updated Aug 25 • 9 lierseleow/Qwen2.5-72B-Instruct-bnb-8bit 73B • Updated Aug 25 • 6 lierseleow/Qwen2.5-72B-Instruct-bnb-4bit 73B • Updated Aug 25 • 6
Gemma Quantized - bnb Contains Gemma Models Quantized using bitsandbytes. lierseleow/gemma-4-31B-it-bnb-8bit 31B • Updated Aug 23 • 17 lierseleow/gemma-4-31B-it-bnb-4bit 31B • Updated Aug 23 • 12
Llama Quantized - bnb Contains Llama Models Quantized using bitsandbytes. lierseleow/Llama-3.3-70B-Instruct-bnb-8bit 71B • Updated Aug 23 • 11 lierseleow/Llama-3.3-70B-Instruct-bnb-4bit 71B • Updated Aug 23 • 11 lierseleow/Llama-3.1-70B-Instruct-bnb-8bit 71B • Updated Aug 23 • 11 lierseleow/Llama-3.1-70B-Instruct-bnb-4bit 71B • Updated Aug 23 • 11
Gemma Quantized - bnb Contains Gemma Models Quantized using bitsandbytes. lierseleow/gemma-4-31B-it-bnb-8bit 31B • Updated Aug 23 • 17 lierseleow/gemma-4-31B-it-bnb-4bit 31B • Updated Aug 23 • 12
Qwen Quantized - bnb Contains Qwen Models Quantized using bitsandbytes. lierseleow/Qwen2.5-32B-Instruct-bnb-4bit 33B • Updated Aug 25 • 9 lierseleow/Qwen2.5-72B-Instruct-bnb-8bit 73B • Updated Aug 25 • 6 lierseleow/Qwen2.5-72B-Instruct-bnb-4bit 73B • Updated Aug 25 • 6