QuantFactory/SmallThinker-3B-Preview-abliterated-GGUF
This is quantized version of huihui-ai/SmallThinker-3B-Preview-abliterated created using llama.cpp
Original Model Card
huihui-ai/SmallThinker-3B-Preview-abliterated
This is an uncensored version of PowerInfer/SmallThinker-3B-Preview created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
Use with ollama
You can use huihui_ai/smallthinker-abliterated directly
ollama run huihui_ai/smallthinker-abliterated
- Downloads last month
- 47
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for QuantFactory/SmallThinker-3B-Preview-abliterated-GGUF
Base model
Qwen/Qwen2.5-3B Finetuned
Qwen/Qwen2.5-3B-Instruct Finetuned
Tiiny/SmallThinker-3B-Preview