Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Open4bits
/
Nanbeige4.1-3B-GGUF
like
0
Follow
Open4bit
5
Text Generation
Transformers
GGUF
English
Chinese
open4bits
llm
nanbeige
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
README.md exists but content is empty.
Downloads last month
4,342
GGUF
Model size
4B params
Architecture
llama
Chat template
Hardware compatibility
Log In
to add your hardware
2-bit
Q2_K
1.62 GB
3-bit
IQ3_XXS
1.66 GB
Q3_K_S
1.86 GB
IQ3_M
1.91 GB
Q3_K_M
2.02 GB
Q3_K_L
2.15 GB
4-bit
IQ4_XS
2.22 GB
IQ4_NL
2.33 GB
Q4_0
2.33 GB
Q4_K_M
2.44 GB
5-bit
Q5_K_S
2.77 GB
Q5_0
2.77 GB
Q5_K_M
2.83 GB
6-bit
Q6_K
3.23 GB
8-bit
Q8_0
4.18 GB
Inference Providers
NEW
Text Generation
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for
Open4bits/Nanbeige4.1-3B-GGUF
Base model
Nanbeige/Nanbeige4-3B-Base
Finetuned
Nanbeige/Nanbeige4.1-3B
Quantized
(
47
)
this model
Collection including
Open4bits/Nanbeige4.1-3B-GGUF
GGUF
Collection
17 items
•
Updated
2 days ago