TQ2_0 quantization of the bitnet model: https://huggingface.co/1bitLLM/bitnet_b1_58-3B

Downloads last month
70
GGUF
Model size
3B params
Architecture
bitnet
Hardware compatibility
Log In to add your hardware

2-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for gianni-cor/bitnet_b1_58-3B-TQ2_0

Quantized
(9)
this model