King3Djbl commited on
Commit
1add296
Β·
verified Β·
1 Parent(s): 02fe8e3

Accurate viral card: critic purpose, params, usage, funnel

Browse files
Files changed (1) hide show
  1. README.md +60 -32
README.md CHANGED
@@ -7,60 +7,87 @@ pipeline_tag: text-generation
7
  base_model: unsloth/Qwen3-8B
8
  base_model_relation: finetune
9
  tags:
10
- - chain-of-thought
11
  - critic
 
12
  - evaluation
13
- - fableforge
 
 
 
14
  - gguf
15
- - imatrix
16
- - llama.cpp
17
- - lm-studio
18
  - ollama
19
- - reasoning
20
- - text-generation
21
  ---
22
 
23
- # ReasonCritic-7B
24
 
25
- > **A reasoning critic β€” evaluates and improves chain-of-thought.**
26
 
27
  [![Downloads](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhuggingface.co%2Fapi%2Fmodels%2Ffableforge-ai%2FReasonCritic-7B&query=downloads&label=downloads&color=blue)](https://huggingface.co/fableforge-ai/ReasonCritic-7B) [![Demos](https://img.shields.io/badge/πŸ€—-Live%20Demos-orange)](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
28
 
29
- Base model: [unsloth/Qwen3-8B](https://huggingface.co/unsloth/Qwen3-8B) Β· Part of the **FableForge** ecosystem.
30
 
31
- ---
 
 
 
 
32
 
33
- ## ⚑ Quickest start β€” Ollama (pulls straight from this repo β†’ credits the source)
34
 
35
  ```bash
36
  ollama run hf.co/fableforge-ai/ReasonCritic-7B:Q4_K_M
37
  ```
38
 
39
- ## πŸ¦™ llama.cpp
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
40
 
41
  ```bash
42
- llama-cli -hf fableforge-ai/ReasonCritic-7B:Q4_K_M -p "Hello!"
43
  ```
44
 
45
- ## πŸ’  LM Studio
46
- Search **`fableforge-ai/ReasonCritic-7B`** and pick a quant below.
47
 
48
- ---
 
 
 
 
 
 
 
 
49
 
50
- ## πŸ“¦ Provided quants (download one file, not the whole repo)
51
 
52
  | File | Quant | Size | Notes |
53
  | ---- | ----- | ---- | ----- |
54
- | [qwen3-8b.F16.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.F16.gguf) | `F16` | 14.43 GB | Full precision (unquantized). Reference / conversion. |
55
- | [qwen3-8b.Q8_0.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q8_0.gguf) | `Q8_0` | 8.71 GB | Extremely high quality β€” usually overkill. |
56
- | [qwen3-8b.Q6_K.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q6_K.gguf) | `Q6_K` | 6.73 GB | Very high quality, near-perfect. **Recommended** if you have the RAM. |
57
  | [qwen3-8b.Q5_K_M.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q5_K_M.gguf) | `Q5_K_M` | 5.85 GB | High quality. **Recommended.** |
58
- | [qwen3-8b.Q4_K_M.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q4_K_M.gguf) | `Q4_K_M` | 5.03 GB | ⭐ **Best size/quality balance β€” default pick for most users.** |
59
- | [qwen3-8b.Q4_0.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q4_0.gguf) | `Q4_0` | 4.77 GB | Legacy format β€” prefer Q4_K_M. |
60
- | [qwen3-8b.Q3_K_M.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q3_K_M.gguf) | `Q3_K_M` | 4.12 GB | Lower quality; usable when RAM is tight. |
61
- | [qwen3-8b.Q2_K.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q2_K.gguf) | `Q2_K` | 3.28 GB | Very low quality β€” surprisingly usable. |
62
 
63
- **Not sure?** Take **`Q4_K_M`**. Low RAM β†’ **`IQ4_XS`**. Max quality β†’ **`Q6_K`**.
64
 
65
  ## 🧠 Prompt format (ChatML)
66
 
@@ -68,20 +95,21 @@ Search **`fableforge-ai/ReasonCritic-7B`** and pick a quant below.
68
  <|im_start|>system
69
  {system_prompt}<|im_end|>
70
  <|im_start|>user
71
- {prompt}<|im_end|>
72
  <|im_start|>assistant
73
  ```
74
 
75
- ## 🌌 See it live β€” the FableForge demos
76
 
77
- This family powers a galaxy of free, interactive HF Spaces:
78
 
79
  - 🧭 [FableForge Nexus](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
80
  - 🍺 [Infinite NPC](https://huggingface.co/spaces/fableforge-ai/infinite-npc)
81
- - 🎭 [Dual-GM](https://huggingface.co/spaces/King3Djbl/dual-gm-simulator)
82
  - πŸ’» [ShellWhisperer](https://huggingface.co/spaces/King3Djbl/shellwhisperer-terminal)
83
- - πŸ‘» [Ghost Writer](https://huggingface.co/spaces/fableforge-ai/ghost-writer)
 
 
84
 
85
  ---
86
 
87
- *⭐ Like & share β€” it helps people find the source instead of a mirror.*
 
7
  base_model: unsloth/Qwen3-8B
8
  base_model_relation: finetune
9
  tags:
10
+ - reasoning
11
  - critic
12
+ - verification
13
  - evaluation
14
+ - fact-checking
15
+ - chain-of-thought
16
+ - agent
17
+ - qwen3
18
  - gguf
 
 
 
19
  - ollama
20
+ - no-refusals
21
+ - fableforge
22
  ---
23
 
24
+ # ReasonCritic-7B β€” the verifier that catches your agent's bad reasoning
25
 
26
+ > **A reasoning critic that scores and repairs logic chains β€” PASS/FAIL verdicts, confidence scores, fallacy detection, and actionable fixes.**
27
 
28
  [![Downloads](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhuggingface.co%2Fapi%2Fmodels%2Ffableforge-ai%2FReasonCritic-7B&query=downloads&label=downloads&color=blue)](https://huggingface.co/fableforge-ai/ReasonCritic-7B) [![Demos](https://img.shields.io/badge/πŸ€—-Live%20Demos-orange)](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
29
 
30
+ Most agents fail *silently* β€” they produce confident, wrong reasoning. **ReasonCritic-7B** is the verification layer: point it at any reasoning chain or agent output and it returns a structured critique you can act on.
31
 
32
+ ## πŸ” What it does
33
+ - βœ… **PASS / FAIL verdict** + a **confidence score** on any reasoning chain
34
+ - πŸ”Ž Flags **logical fallacies, unsupported claims, and gaps**
35
+ - πŸ› οΈ Returns **actionable suggestions** to repair the reasoning
36
+ - πŸ€– Designed to sit in an **agent loop** as the checker before an answer is trusted
37
 
38
+ ## ⚑ Quick start β€” Ollama
39
 
40
  ```bash
41
  ollama run hf.co/fableforge-ai/ReasonCritic-7B:Q4_K_M
42
  ```
43
 
44
+ **Recommended sampling for deterministic critique:** `temperature 0.3 Β· top_p 0.9 Β· top_k 40 Β· repeat_penalty 1.1 Β· num_ctx 4096`.
45
+
46
+ Build the tuned critic locally with those defaults baked in:
47
+
48
+ ```dockerfile
49
+ # Modelfile
50
+ FROM hf.co/fableforge-ai/ReasonCritic-7B:Q4_K_M
51
+ PARAMETER num_ctx 4096
52
+ PARAMETER temperature 0.3
53
+ PARAMETER top_p 0.9
54
+ PARAMETER top_k 40
55
+ PARAMETER repeat_penalty 1.1
56
+ SYSTEM """You are ReasonCritic, a reasoning critic. Evaluate, score, and improve logical
57
+ reasoning chains. Identify fallacies, unsupported claims, and gaps. Produce structured
58
+ verification: PASS/FAIL verdict, confidence score, issue list, and actionable suggestions."""
59
+ ```
60
 
61
  ```bash
62
+ ollama create reasoncritic -f Modelfile && ollama run reasoncritic
63
  ```
64
 
65
+ ## 🧾 Example output
 
66
 
67
+ ```
68
+ VERDICT: FAIL (confidence 0.82)
69
+ ISSUES:
70
+ - Step 3 asserts X with no supporting evidence (unsupported claim)
71
+ - Steps 4 and 6 are mutually circular
72
+ SUGGESTIONS:
73
+ - Cite evidence for X, or mark it explicitly as an assumption
74
+ - Derive step 6 independently of step 4
75
+ ```
76
 
77
+ ## πŸ“¦ Provided quants
78
 
79
  | File | Quant | Size | Notes |
80
  | ---- | ----- | ---- | ----- |
81
+ | [qwen3-8b.F16.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.F16.gguf) | `F16` | 14.43 GB | Full precision / reference. |
82
+ | [qwen3-8b.Q8_0.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q8_0.gguf) | `Q8_0` | 8.71 GB | Max quality, overkill. |
83
+ | [qwen3-8b.Q6_K.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q6_K.gguf) | `Q6_K` | 6.73 GB | Near-perfect. **Recommended** if RAM allows. |
84
  | [qwen3-8b.Q5_K_M.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q5_K_M.gguf) | `Q5_K_M` | 5.85 GB | High quality. **Recommended.** |
85
+ | [qwen3-8b.Q4_K_M.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q4_K_M.gguf) | `Q4_K_M` | 5.03 GB | ⭐ **Best balance β€” default pick.** |
86
+ | [qwen3-8b.Q4_0.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q4_0.gguf) | `Q4_0` | 4.77 GB | Legacy β€” prefer Q4_K_M. |
87
+ | [qwen3-8b.Q3_K_M.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q3_K_M.gguf) | `Q3_K_M` | 4.12 GB | Lower quality, low RAM. |
88
+ | [qwen3-8b.Q2_K.gguf](https://huggingface.co/fableforge-ai/ReasonCritic-7B/blob/main/qwen3-8b.Q2_K.gguf) | `Q2_K` | 3.28 GB | Very low quality. |
89
 
90
+ > ℹ️ Files are currently named `qwen3-8b.*`; the Ollama `:Q4_K_M` tag still resolves correctly.
91
 
92
  ## 🧠 Prompt format (ChatML)
93
 
 
95
  <|im_start|>system
96
  {system_prompt}<|im_end|>
97
  <|im_start|>user
98
+ {reasoning_chain_to_verify}<|im_end|>
99
  <|im_start|>assistant
100
  ```
101
 
102
+ ## 🌌 Part of the FableForge ecosystem
103
 
104
+ ReasonCritic is the **verification layer** for the FableForge agent stack. Try the live demos:
105
 
106
  - 🧭 [FableForge Nexus](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
107
  - 🍺 [Infinite NPC](https://huggingface.co/spaces/fableforge-ai/infinite-npc)
 
108
  - πŸ’» [ShellWhisperer](https://huggingface.co/spaces/King3Djbl/shellwhisperer-terminal)
109
+ - 🎭 [Dual-GM](https://huggingface.co/spaces/King3Djbl/dual-gm-simulator)
110
+
111
+ Base model: [unsloth/Qwen3-8B](https://huggingface.co/unsloth/Qwen3-8B).
112
 
113
  ---
114
 
115
+ *⭐ Like & share β€” pull from the source, not a mirror.*