ReasonCritic-7B-GGUF
A reasoning critic β evaluates and improves chain-of-thought.
Base model: fableforge-ai/ReasonCritic-7B Β· Part of the FableForge ecosystem.
β‘ Quickest start β Ollama (these pulls credit the source, not a mirror)
ollama run hf.co/fableforge-ai/ReasonCritic-7B-GGUF:Q4_K_M
π¦ llama.cpp
llama-cli -hf fableforge-ai/ReasonCritic-7B-GGUF:Q4_K_M -p "Hello!"
π LM Studio
Search fableforge-ai/ReasonCritic-7B-GGUF and pick a quant below.
π¦ Provided quants (download one file, not the whole repo)
| File | Quant | Size | Notes |
|---|---|---|---|
| reasoncritic-7b.F16.gguf | F16 |
14.43 GB | Full precision (unquantized). Reference / conversion. |
| reasoncritic-7b.Q8_0.gguf | Q8_0 |
8.71 GB | Extremely high quality β usually overkill. |
| reasoncritic-7b.Q6_K.gguf | Q6_K |
6.73 GB | Very high quality, near-perfect. Recommended if you have the RAM. |
| reasoncritic-7b.Q5_K_M.gguf | Q5_K_M |
5.85 GB | High quality. Recommended. |
| reasoncritic-7b.Q4_K_M.gguf | Q4_K_M |
5.03 GB | β Best size/quality balance β default pick for most users. |
| reasoncritic-7b.Q4_0.gguf | Q4_0 |
4.77 GB | Legacy format β prefer Q4_K_M. |
| reasoncritic-7b.Q3_K_M.gguf | Q3_K_M |
4.12 GB | Lower quality; usable when RAM is tight. |
| reasoncritic-7b.Q2_K.gguf | Q2_K |
3.28 GB | Very low quality β surprisingly usable. |
Not sure? Take Q4_K_M. Low RAM β Q3_K_M. Max quality β Q6_K.
π§ Prompt format (ChatML)
<|im_start|>system
{system_prompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
π See it live β the FableForge demos
This family powers a galaxy of free, interactive HF Spaces:
- π§ FableForge Nexus
- πΊ Infinite NPC
- π Dual-GM
- π» ShellWhisperer
- π» Ghost Writer
π Related models
- π§ Base model (safetensors):
ReasonCritic-7B
β Like & share β it helps people find the source instead of a mirror.
- Downloads last month
- 281
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Model tree for fableforge-ai/ReasonCritic-7B-GGUF
Unable to build the model tree, the base model loops to the model itself. Learn more.