Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
Alcoft
/
SmolLM2-135M-Instruct-GGUF
like
0
Text Generation
GGUF
English
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
README.md exists but content is empty.
Downloads last month
8
GGUF
Model size
0.1B params
Architecture
llama
Chat template
Hardware compatibility
Log In
to add your hardware
2-bit
Q2_K
88.2 MB
3-bit
Q3_K_S
88.2 MB
Q3_K_M
93.5 MB
Q3_K_L
97.5 MB
4-bit
Q4_K_S
102 MB
Q4_K_M
105 MB
5-bit
Q5_K_S
110 MB
Q5_K_M
112 MB
6-bit
Q6_K
138 MB
8-bit
Q8_0
145 MB
16-bit
BF16
271 MB
F16
271 MB
Inference Providers
NEW
Text Generation
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for
Alcoft/SmolLM2-135M-Instruct-GGUF
Base model
HuggingFaceTB/SmolLM2-135M
Quantized
HuggingFaceTB/SmolLM2-135M-Instruct
Quantized
(
92
)
this model
Collection including
Alcoft/SmolLM2-135M-Instruct-GGUF
TAO71-AI Quants: SmolLM2
Collection
3 items
•
Updated
Jul 26, 2025