Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
numind
/
NuMarkdown-8B-Thinking-GGUF
like
1
Follow
NuMind
430
GGUF
conversational
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
No model card
Downloads last month
396
GGUF
Model size
8B params
Architecture
qwen2vl
Chat template
Hardware compatibility
Log In
to view the estimation
1-bit
TQ1_0
2.14 GB
2-bit
Q2_K
3.02 GB
TQ2_0
2.44 GB
3-bit
IQ3_XS
3.35 GB
IQ3_S
3.5 GB
Q3_K_S
3.49 GB
IQ3_M
3.57 GB
Q3_K_M
3.81 GB
Q3_K_L
4.09 GB
4-bit
IQ4_XS
4.25 GB
Q4_K_S
4.46 GB
IQ4_NL
4.46 GB
Q4_0
4.43 GB
Q4_1
4.87 GB
Q4_K_M
4.68 GB
5-bit
Q5_K_S
5.32 GB
Q5_0
5.32 GB
Q5_1
5.76 GB
Q5_K_M
5.44 GB
6-bit
Q6_K
6.25 GB
8-bit
Q8_0
8.1 GB
16-bit
BF16
15.2 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Collection including
numind/NuMarkdown-8B-Thinking-GGUF
NuMarkdown
Collection
5 items
โข
Updated
Nov 24
โข
5