Contains Llama Models Quantized using bitsandbytes.
Leo Wilhelm Lierse
lierseleow
AI & ML interests
Interested in Carbon-, Energy-, and Cost-Efficient and -Aware AI/ML Systems
Organizations
None yet
models 13
lierseleow/Qwen2.5-72B-Instruct-bnb-8bit
73B • Updated • 6
lierseleow/Qwen2.5-72B-Instruct-bnb-4bit
73B • Updated • 6
lierseleow/Qwen2.5-32B-Instruct-bnb-4bit
33B • Updated • 9
lierseleow/gemma-4-31B-it-bnb-8bit
31B • Updated • 17
lierseleow/gemma-4-31B-it-bnb-4bit
31B • Updated • 12
lierseleow/Llama-2-70b-chat-hf-bnb-4bit
69B • Updated • 7
lierseleow/Llama-2-70b-chat-hf-bnb-8bit
69B • Updated • 12
lierseleow/Meta-Llama-3-70B-Instruct-bnb-4bit
71B • Updated • 6
lierseleow/Meta-Llama-3-70B-Instruct-bnb-8bit
71B • Updated • 6
lierseleow/Llama-3.1-70B-Instruct-bnb-8bit
71B • Updated • 11
datasets 0
None public yet