Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
PrunaAI
/
PowerInfer-SmallThinker-3B-Preview-GGUF-smashed
like
0
Follow
Pruna AI
313
Pruna AI
GGUF
conversational
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
PowerInfer-SmallThinker-3B-Preview-GGUF-smashed
/
PowerInfer
31.4 GB
1 contributor
History:
16 commits
sharpenb
Upload PowerInfer/SmallThinker-3B-Preview.Q3_K_L.gguf with huggingface_hub
090f15a
verified
10 months ago
SmallThinker-3B-Preview.Q2_K.gguf
1.38 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.Q2_K.gguf with huggingface_hub
10 months ago
SmallThinker-3B-Preview.Q3_K_L.gguf
1.84 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.Q3_K_L.gguf with huggingface_hub
10 months ago
SmallThinker-3B-Preview.Q3_K_M.gguf
1.72 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.Q3_K_M.gguf with huggingface_hub
10 months ago
SmallThinker-3B-Preview.Q3_K_S.gguf
1.59 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.Q3_K_S.gguf with huggingface_hub
10 months ago
SmallThinker-3B-Preview.Q4_0.gguf
2 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.Q4_0.gguf with huggingface_hub
10 months ago
SmallThinker-3B-Preview.Q4_1.gguf
2.19 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.Q4_1.gguf with huggingface_hub
10 months ago
SmallThinker-3B-Preview.Q4_K_M.gguf
2.1 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.Q4_K_M.gguf with huggingface_hub
10 months ago
SmallThinker-3B-Preview.Q4_K_S.gguf
2.01 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.Q4_K_S.gguf with huggingface_hub
10 months ago
SmallThinker-3B-Preview.Q5_0.gguf
2.38 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.Q5_0.gguf with huggingface_hub
10 months ago
SmallThinker-3B-Preview.Q5_1.gguf
2.58 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.Q5_1.gguf with huggingface_hub
10 months ago
SmallThinker-3B-Preview.Q5_K_M.gguf
2.44 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.Q5_K_M.gguf with huggingface_hub
10 months ago
SmallThinker-3B-Preview.Q5_K_S.gguf
2.38 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.Q5_K_S.gguf with huggingface_hub
10 months ago
SmallThinker-3B-Preview.fp16.bin
6.8 GB
xet
Upload PowerInfer/SmallThinker-3B-Preview.fp16.bin with huggingface_hub
10 months ago
