Quantized version of: PowerInfer/SmallThinker-3B-Preview
'Make knowledge free for everyone'
Made with
- Downloads last month
- 9
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Model tree for DevQuasar/PowerInfer.SmallThinker-3B-Preview-GGUF
Base model
Qwen/Qwen2.5-3B Finetuned
Qwen/Qwen2.5-3B-Instruct Finetuned
Tiiny/SmallThinker-3B-Preview