Text Generation
Transformers
GGUF
English
qwen3
chain-of-thought
critic
evaluation
fableforge
imatrix
llama.cpp
lm-studio
ollama
reasoning
conversational
Instructions to use fableforge-ai/ReasonCritic-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use fableforge-ai/ReasonCritic-7B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="fableforge-ai/ReasonCritic-7B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("fableforge-ai/ReasonCritic-7B") model = AutoModelForCausalLM.from_pretrained("fableforge-ai/ReasonCritic-7B", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use fableforge-ai/ReasonCritic-7B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "fableforge-ai/ReasonCritic-7B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "fableforge-ai/ReasonCritic-7B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/fableforge-ai/ReasonCritic-7B
- SGLang
How to use fableforge-ai/ReasonCritic-7B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "fableforge-ai/ReasonCritic-7B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "fableforge-ai/ReasonCritic-7B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "fableforge-ai/ReasonCritic-7B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "fableforge-ai/ReasonCritic-7B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use fableforge-ai/ReasonCritic-7B with Docker Model Runner:
docker model run hf.co/fableforge-ai/ReasonCritic-7B
Accurate viral card: critic purpose, params, usage, funnel
Browse files
README.md
CHANGED
|
@@ -7,60 +7,87 @@ pipeline_tag: text-generation
|
|
| 7 |
base_model: unsloth/Qwen3-8B
|
| 8 |
base_model_relation: finetune
|
| 9 |
tags:
|
| 10 |
-
-
|
| 11 |
- critic
|
|
|
|
| 12 |
- evaluation
|
| 13 |
-
-
|
|
|
|
|
|
|
|
|
|
| 14 |
- gguf
|
| 15 |
-
- imatrix
|
| 16 |
-
- llama.cpp
|
| 17 |
-
- lm-studio
|
| 18 |
- ollama
|
| 19 |
-
-
|
| 20 |
-
-
|
| 21 |
---
|
| 22 |
|
| 23 |
-
# ReasonCritic-7B
|
| 24 |
|
| 25 |
-
> **A reasoning critic β
|
| 26 |
|
| 27 |
[](https://huggingface.co/fableforge-ai/ReasonCritic-7B) [](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
|
| 28 |
|
| 29 |
-
|
| 30 |
|
| 31 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
|
| 33 |
-
## β‘
|
| 34 |
|
| 35 |
```bash
|
| 36 |
ollama run hf.co/fableforge-ai/ReasonCritic-7B:Q4_K_M
|
| 37 |
```
|
| 38 |
|
| 39 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 40 |
|
| 41 |
```bash
|
| 42 |
-
|
| 43 |
```
|
| 44 |
|
| 45 |
-
##
|
| 46 |
-
Search **`fableforge-ai/ReasonCritic-7B`** and pick a quant below.
|
| 47 |
|
| 48 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 49 |
|
| 50 |
-
## π¦ Provided quants
|
| 51 |
|
| 52 |
| File | Quant | Size | Notes |
|
| 53 |
| ---- | ----- | ---- | ----- |
|
| 54 |
-
| [qwen3-8b.F16.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.F16.gguf) | `F16` | 14.43 GB | Full precision
|
| 55 |
-
| [qwen3-8b.Q8_0.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q8_0.gguf) | `Q8_0` | 8.71 GB |
|
| 56 |
-
| [qwen3-8b.Q6_K.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q6_K.gguf) | `Q6_K` | 6.73 GB |
|
| 57 |
| [qwen3-8b.Q5_K_M.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q5_K_M.gguf) | `Q5_K_M` | 5.85 GB | High quality. **Recommended.** |
|
| 58 |
-
| [qwen3-8b.Q4_K_M.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q4_K_M.gguf) | `Q4_K_M` | 5.03 GB | β **Best
|
| 59 |
-
| [qwen3-8b.Q4_0.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q4_0.gguf) | `Q4_0` | 4.77 GB | Legacy
|
| 60 |
-
| [qwen3-8b.Q3_K_M.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q3_K_M.gguf) | `Q3_K_M` | 4.12 GB | Lower quality
|
| 61 |
-
| [qwen3-8b.Q2_K.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q2_K.gguf) | `Q2_K` | 3.28 GB | Very low quality
|
| 62 |
|
| 63 |
-
|
| 64 |
|
| 65 |
## π§ Prompt format (ChatML)
|
| 66 |
|
|
@@ -68,20 +95,21 @@ Search **`fableforge-ai/ReasonCritic-7B`** and pick a quant below.
|
|
| 68 |
<|im_start|>system
|
| 69 |
{system_prompt}<|im_end|>
|
| 70 |
<|im_start|>user
|
| 71 |
-
{
|
| 72 |
<|im_start|>assistant
|
| 73 |
```
|
| 74 |
|
| 75 |
-
## π
|
| 76 |
|
| 77 |
-
|
| 78 |
|
| 79 |
- π§ [FableForge Nexus](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
|
| 80 |
- πΊ [Infinite NPC](https://huggingface.co/spaces/fableforge-ai/infinite-npc)
|
| 81 |
-
- π [Dual-GM](https://huggingface.co/spaces/King3Djbl/dual-gm-simulator)
|
| 82 |
- π» [ShellWhisperer](https://huggingface.co/spaces/King3Djbl/shellwhisperer-terminal)
|
| 83 |
-
-
|
|
|
|
|
|
|
| 84 |
|
| 85 |
---
|
| 86 |
|
| 87 |
-
*β Like & share β
|
|
|
|
| 7 |
base_model: unsloth/Qwen3-8B
|
| 8 |
base_model_relation: finetune
|
| 9 |
tags:
|
| 10 |
+
- reasoning
|
| 11 |
- critic
|
| 12 |
+
- verification
|
| 13 |
- evaluation
|
| 14 |
+
- fact-checking
|
| 15 |
+
- chain-of-thought
|
| 16 |
+
- agent
|
| 17 |
+
- qwen3
|
| 18 |
- gguf
|
|
|
|
|
|
|
|
|
|
| 19 |
- ollama
|
| 20 |
+
- no-refusals
|
| 21 |
+
- fableforge
|
| 22 |
---
|
| 23 |
|
| 24 |
+
# ReasonCritic-7B β the verifier that catches your agent's bad reasoning
|
| 25 |
|
| 26 |
+
> **A reasoning critic that scores and repairs logic chains β PASS/FAIL verdicts, confidence scores, fallacy detection, and actionable fixes.**
|
| 27 |
|
| 28 |
[](https://huggingface.co/fableforge-ai/ReasonCritic-7B) [](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
|
| 29 |
|
| 30 |
+
Most agents fail *silently* β they produce confident, wrong reasoning. **ReasonCritic-7B** is the verification layer: point it at any reasoning chain or agent output and it returns a structured critique you can act on.
|
| 31 |
|
| 32 |
+
## π What it does
|
| 33 |
+
- β
**PASS / FAIL verdict** + a **confidence score** on any reasoning chain
|
| 34 |
+
- π Flags **logical fallacies, unsupported claims, and gaps**
|
| 35 |
+
- π οΈ Returns **actionable suggestions** to repair the reasoning
|
| 36 |
+
- π€ Designed to sit in an **agent loop** as the checker before an answer is trusted
|
| 37 |
|
| 38 |
+
## β‘ Quick start β Ollama
|
| 39 |
|
| 40 |
```bash
|
| 41 |
ollama run hf.co/fableforge-ai/ReasonCritic-7B:Q4_K_M
|
| 42 |
```
|
| 43 |
|
| 44 |
+
**Recommended sampling for deterministic critique:** `temperature 0.3 Β· top_p 0.9 Β· top_k 40 Β· repeat_penalty 1.1 Β· num_ctx 4096`.
|
| 45 |
+
|
| 46 |
+
Build the tuned critic locally with those defaults baked in:
|
| 47 |
+
|
| 48 |
+
```dockerfile
|
| 49 |
+
# Modelfile
|
| 50 |
+
FROM hf.co/fableforge-ai/ReasonCritic-7B:Q4_K_M
|
| 51 |
+
PARAMETER num_ctx 4096
|
| 52 |
+
PARAMETER temperature 0.3
|
| 53 |
+
PARAMETER top_p 0.9
|
| 54 |
+
PARAMETER top_k 40
|
| 55 |
+
PARAMETER repeat_penalty 1.1
|
| 56 |
+
SYSTEM """You are ReasonCritic, a reasoning critic. Evaluate, score, and improve logical
|
| 57 |
+
reasoning chains. Identify fallacies, unsupported claims, and gaps. Produce structured
|
| 58 |
+
verification: PASS/FAIL verdict, confidence score, issue list, and actionable suggestions."""
|
| 59 |
+
```
|
| 60 |
|
| 61 |
```bash
|
| 62 |
+
ollama create reasoncritic -f Modelfile && ollama run reasoncritic
|
| 63 |
```
|
| 64 |
|
| 65 |
+
## π§Ύ Example output
|
|
|
|
| 66 |
|
| 67 |
+
```
|
| 68 |
+
VERDICT: FAIL (confidence 0.82)
|
| 69 |
+
ISSUES:
|
| 70 |
+
- Step 3 asserts X with no supporting evidence (unsupported claim)
|
| 71 |
+
- Steps 4 and 6 are mutually circular
|
| 72 |
+
SUGGESTIONS:
|
| 73 |
+
- Cite evidence for X, or mark it explicitly as an assumption
|
| 74 |
+
- Derive step 6 independently of step 4
|
| 75 |
+
```
|
| 76 |
|
| 77 |
+
## π¦ Provided quants
|
| 78 |
|
| 79 |
| File | Quant | Size | Notes |
|
| 80 |
| ---- | ----- | ---- | ----- |
|
| 81 |
+
| [qwen3-8b.F16.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.F16.gguf) | `F16` | 14.43 GB | Full precision / reference. |
|
| 82 |
+
| [qwen3-8b.Q8_0.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q8_0.gguf) | `Q8_0` | 8.71 GB | Max quality, overkill. |
|
| 83 |
+
| [qwen3-8b.Q6_K.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q6_K.gguf) | `Q6_K` | 6.73 GB | Near-perfect. **Recommended** if RAM allows. |
|
| 84 |
| [qwen3-8b.Q5_K_M.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q5_K_M.gguf) | `Q5_K_M` | 5.85 GB | High quality. **Recommended.** |
|
| 85 |
+
| [qwen3-8b.Q4_K_M.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q4_K_M.gguf) | `Q4_K_M` | 5.03 GB | β **Best balance β default pick.** |
|
| 86 |
+
| [qwen3-8b.Q4_0.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q4_0.gguf) | `Q4_0` | 4.77 GB | Legacy β prefer Q4_K_M. |
|
| 87 |
+
| [qwen3-8b.Q3_K_M.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q3_K_M.gguf) | `Q3_K_M` | 4.12 GB | Lower quality, low RAM. |
|
| 88 |
+
| [qwen3-8b.Q2_K.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q2_K.gguf) | `Q2_K` | 3.28 GB | Very low quality. |
|
| 89 |
|
| 90 |
+
> βΉοΈ Files are currently named `qwen3-8b.*`; the Ollama `:Q4_K_M` tag still resolves correctly.
|
| 91 |
|
| 92 |
## π§ Prompt format (ChatML)
|
| 93 |
|
|
|
|
| 95 |
<|im_start|>system
|
| 96 |
{system_prompt}<|im_end|>
|
| 97 |
<|im_start|>user
|
| 98 |
+
{reasoning_chain_to_verify}<|im_end|>
|
| 99 |
<|im_start|>assistant
|
| 100 |
```
|
| 101 |
|
| 102 |
+
## π Part of the FableForge ecosystem
|
| 103 |
|
| 104 |
+
ReasonCritic is the **verification layer** for the FableForge agent stack. Try the live demos:
|
| 105 |
|
| 106 |
- π§ [FableForge Nexus](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
|
| 107 |
- πΊ [Infinite NPC](https://huggingface.co/spaces/fableforge-ai/infinite-npc)
|
|
|
|
| 108 |
- π» [ShellWhisperer](https://huggingface.co/spaces/King3Djbl/shellwhisperer-terminal)
|
| 109 |
+
- π [Dual-GM](https://huggingface.co/spaces/King3Djbl/dual-gm-simulator)
|
| 110 |
+
|
| 111 |
+
Base model: [unsloth/Qwen3-8B](https://huggingface.co/unsloth/Qwen3-8B).
|
| 112 |
|
| 113 |
---
|
| 114 |
|
| 115 |
+
*β Like & share β pull from the source, not a mirror.*
|