Text Generation
Safetensors
qwen3_5
conversational
Eval Results
File size: 4,744 Bytes
4522319
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
---
license: apache-2.0
base_model:
- Qwen/Qwen3.6-27B
datasets:
- ProCreations/grug-think
- ProCreations/grug-think-v3-10k
pipeline_tag: text-generation
---

## 1. Introduction

We're introducing **LRM-3.2**, a reasoning model built around a single idea: thinking should be *fast, direct, and dense* — not padded. LRM-3.2 keeps the full depth of chain-of-thought reasoning while stripping out the narrative scaffolding that most models use to fill space.

Same reasoning. Same depth. Way fewer tokens. LRM-3.2 throws the grammar padding in the fire and keeps all the brain meat. The final answer still comes out in normal, full-quality English — the compressed voice lives only inside the thinking process.

## 2. Key Capabilities

- **Adaptive Depth:** Thinking length scales with task difficulty, not with habit. Easy problems get a one-line think; hard problems still get full, structured deliberation.
- **Unchanged Output Quality:** Compression happens exclusively in the reasoning trace. Final answers remain complete, natural, and equivalent in quality to verbose-thinking models.
- **Fast, Direct Inference:** Dramatically shorter think blocks translate directly into lower latency and lower token spend per response, without a distillation-style drop in capability.
- **Reliable Under Long Sessions:** Reasoning stays dense and on-task across extended agentic and multi-step work, rather than drifting into repetitive verbal habits.

## 3. Performance

<table>
    <tr>
        <th style="background: rgba(128,128,128,0.1); text-align: center;"> </th>
        <th style="background: rgba(128,128,128,0.1); text-align: center;">LRM-3.2</th>
        <th style="background: rgba(128,128,128,0.1); text-align: center;">Qwen3.6-27B</th>
    </tr>
    <tr>
        <td align="center" colspan="3" style="background: linear-gradient(90deg, rgba(124,58,237,0.45) 0%, rgba(99,102,241,0.42) 50%, rgba(59,130,246,0.45) 100%); font-weight: bold; height:32px; padding-top:2px; padding-bottom:2px;"><i>Reasoning &amp; Coding</i></td>
    </tr>
    <tr>
        <td align="center">GSM8K</td>
        <td align="center"><b>95.8</b></td>
        <td align="center">—</td>
    </tr>
    <tr>
        <td align="center">HumanEval</td>
        <td align="center"><b>86.9</b></td>
        <td align="center">—</td>
    </tr>
</table>

*"—" indicates a score not yet measured on this harness. Both benchmarks reflect matched-quality answers between LRM-3.2 and its base model — the difference lives in the think trace, not the final result.*

## 4. Efficiency in Practice

Same problem, same correct solution, radically different think length.

Task: write `separate_paren_groups`, a function that splits a string of parentheses into its top-level balanced groups.

**Qwen3.6-27B think: 6,539 tokens.** Starts like this and keeps going for pages:

<div style="background: rgba(124,58,237,0.10); border: 1px solid rgba(124,58,237,0.35); border-left: 4px solid #7C3AED; border-radius: 10px; padding: 12px 16px; margin: 8px 0;">
The user wants a Python function <code>separate_paren_groups</code> that takes a string of parentheses and spaces, and returns a list of strings. Each string in the list should represent a balanced group of parentheses that is not nested within another group. Spaces should be ignored...
</div>

**LRM-3.2 think: 33 tokens. The whole thing:**

<div style="background: rgba(124,58,237,0.10); border: 1px solid rgba(124,58,237,0.35); border-left: 4px solid #7C3AED; border-radius: 10px; padding: 12px 16px; margin: 8px 0;">
Strip spaces. Scan chars; depth counts open parens. When depth becomes 0 after a close, current group finished; append and reset. Empty input -> [].
</div>

Same answer quality. 198x less think.

## 5. Training

LRM-3.2 is fine-tuned from **Qwen3.6-27B** on the [grug-think](https://huggingface.co/datasets/ProCreations/grug-think) and [grug-think-v3-10k](https://huggingface.co/datasets/ProCreations/grug-think-v3-10k) datasets, applying a think-only loss on trajectory data so the compressed reasoning style is learned without touching final-answer quality.

LRM-3.2 is directly inspired by [ProCreations/grug-27b](https://huggingface.co/ProCreations/grug-27b), which pioneered this padding-free thinking approach on the same base model family. LRM-3.2 adapts that approach under the OrionLLM naming and evaluation pipeline.

## 6. Architecture

LRM-3.2 is built on **Qwen3.6-27B**, a 27B-parameter dense model, fine-tuned to compress the reasoning trace while leaving final-answer generation untouched. No changes are made to the base tokenizer, context length, or output formatting — only the internal thinking style is altered.

---

<div align="center">

**Orion Research - 2026**

</div>