README.md

---
license: apache-2.0
base_model:
- Qwen/Qwen3.5-4B
pipeline_tag: image-text-to-text
library_name: transformers
tags:
- efficient
- qwen
- qwen3.5
- nomi
- lazyloopstudio
- unsloth
- nomi2
---

<p align="center">
  <img src="https://cdn-uploads.huggingface.co/production/uploads/6921fa6332f7fb129563d495/aR36SrpWzksbcGbcp84pE.png" width="128">
</p>

# Nomi 2.0

## Introduction

Introducing **Nomi 2**, an 4B LLM based on **Qwen 3.5 4B**, that thinks more efficient while keeping great performance.

In this training, we used another base and improved it's reasoning. It's base, Qwen 3.5 4B was great, but overthought most of the requests und looped.
**Nomi 2** fixes that. 
Even at more complicated prompts it only thinks for about 10 sec on consumer hardware (~500 Reasoning tokens).

Nomi 2 works by using one specific reasoning style:
Instead of human like CoT, Nomi uses what I like to call **RASV**.
In it's reasoning, it got 4 main parts:
- Restatement
- Approach
- Step-by-step derivation
- Verification

These steps help the LLM to **keep the reasoning short, while keeping it effective, and avoiding loops.**

## 🌟 Key Features & Improvements

* **Architecture:** Qwen-3.5-4B (runs on 8 GB VRAM GPUs like the RTX 4060).
* **Multilingual Support:** Can understand and generate text in German and English and many other languages.
* **Efficiency:** Runs with 60+ Tokens/s at Q4 with an Context Window of almost 100k tokens on consumer hardware.

## 📃 Evals and Showcase

### Evals

| Model Name | GSM8K* | GPQA Diamond (0-Shot)*
| --- | --- | --- |
| Nomi 2.0 | 41/100 | 32/50

<details>
  <summary>*</summary>
  Benchmarks were done without reasoning (didn't got it to work) and only the first 100/50 Questions of the Benchmark were used.
</details>

### Reasoning Style Showcase

Q: What is 8x8x8+43+(432+432x3)-39?

<details>
<summary>Nomi</summary>
<div style="background-color: #616161; padding: 12px; border-radius: 8px;">

## Restatement
We need to evaluate the arithmetic expression 8 × 8 × 8 + 43 + (432 + 432 × 3) − 39. The operations include multiplication, addition, and subtraction, and we must apply the standard order of operations (PEMDAS/BODMAS).

## Approach
Multiplication has higher precedence than addition and subtraction, so we compute all products first, then handle the parentheses grouping, then add/subtract from left to right. Specifically:
- Inside the parentheses: 432 × 3 first, then add 432
- Outside: 8 × 8 × 8, then combine everything

## Step-by-step derivation
**Step 1 — Inside parentheses:** 432 × 3 = 1296. Then 432 + 1296 = 1728. So (432 + 432 × 3) = 1728.

**Step 2 — Outside:** 8 × 8 × 8 = 64 × 8 = 512.

**Step 3 — Combine:** 512 + 43 + 1728 − 39.
- 512 + 43 = 555
- 555 + 1728 = 2283
- 2283 − 39 = 2244

**Answer: 2244.**

## Verification
Check by recombining: 512 + 43 + 1728 = 2283, and 2283 − 39 = 2244. Alternatively, note 512 + 1728 = 2240, then 2240 + 43 − 39 = 2240 + 4 = 2244. Both methods agree.
</div>
  
**2244**

To evaluate 8 × 8 × 8 + 43 + (432 + 432 × 3) − 39, we follow the order of operations: multiplication first, then parentheses, then addition and subtraction from left to right.

Inside the parentheses, we compute 432 × 3 = 1296, then 432 + 1296 = 1728. Outside, we compute 8 × 8 × 8 = 64 × 8 = 512. The expression now reads 512 + 43 + 1728 − 39.

Adding from left to right: 512 + 43 = 555, then 555 + 1728 = 2283, and finally 2283 − 39 = 2244.

As a sanity check, I can reorder the additions: 512 + 1728 = 2240, and 2240 + 43 − 39 = 2240 + 4 = 2244. The two independent paths give the same result, confirming the answer.

</details>
<details>
<summary>Qwen</summary>
<div style="background-color: #616161; padding: 12px; border-radius: 8px;">

Here's my thought process for solving this math problem:

1.  **Analyze the Request:** The user wants to solve a specific arithmetic expression: $8 \times 8 \times 8 + 43 + (432 + 432 \times 3) - 39$.

2.  **Identify the Operations:** I need to perform multiplication, addition, and subtraction.
3.  **Apply Order of Operations (PEMDAS/BODMAS):**
    *   **P/B:** Parentheses/Brackets. I need to solve the expression inside the parentheses first.
    *   **E/O:** Exponents/Orders. There are none here (unless $8 \times 8 \times 8$ is interpreted as a power, but standard notation implies multiplication).
    *   **MD/DM:** Multiplication and Division (left to right).
    *   **AS:** Addition and Subtraction (left to right).

4.  **Step-by-Step Breakdown:**

    *   **Expression:** $8 \times 8 \times 8 + 43 + (432 + 432 \times 3) - 39$

    *   **Step 1: Parentheses**
        *   Inside the parentheses: $(432 + 432 \times 3)$
        *   Within the parentheses, multiplication comes before addition.
        *   Calculate $432 \times 3$.
            *   $400 \times 3 = 1200$
            *   $30 \times 3 = 90$
            *   $2 \times 3 = 6$
            *   $1200 + 90 + 6 = 1296$
        *   Now add 432 to the result.
            *   $432 + 1296$
            *   $2 + 6 = 8$
            *   $3 + 9 = 12$ (carry 1)
            *   $4 + 2 + 1 = 7$
            *   $1$
            *   Result: $1728$
        *   So, the expression becomes: $8 \times 8 \times 8 + 43 + 1728 - 39$

    *   **Step 2: Multiplication (outside the parentheses)**
        *   Calculate $8 \times 8 \times 8$.
        *   $8 \times 8 = 64$
        *   $64 \times 8 = 512$
        *   (Note: $8^3 = 512$)
        *   The expression becomes: $512 + 43 + 1728 - 39$

    *   **Step 3: Addition and Subtraction (Left to Right)**
        *   Current expression: $512 + 43 + 1728 - 39$
        *   First addition: $512 + 43$
            *   $512 + 40 = 552$
            *   $552 + 3 = 555$
        *   Current expression: $555 + 1728 - 39$
        *   Second addition: $555 + 1728$
            *   $500 + 1700 = 2200$
            *   $55 + 28 = 83$
            *   $2200 + 83 = 2283$
        *   Current expression: $2283 - 39$
        *   Final subtraction: $2283 - 39$
            *   $2283 - 30 = 2253$
            *   $2253 - 9 = 2244$
            *   Alternatively: $2283 - 40 + 1 = 2243 + 1 = 2244$

5.  **Double Check:**
    *   Original: $8 \times 8 \times 8 + 43 + (432 + 432 \times 3) - 39$
    *   $8^3 = 512$
    *   $432 \times 3 = 1296$
    *   $432 + 1296 = 1728$
    *   Sum so far: $512 + 43 + 1728 - 39$
    *   $512 + 43 = 555$
    *   $555 + 1728 = 2283$
    *   $2283 - 39 = 2244$

    *   Wait, let me re-read the expression carefully.
    *   $8 \times 8 \times 8 + 43 + (432 + 432 \times 3) - 39$
    *   Is it possible the user meant $432 + (432 \times 3)$? Yes, that's what I did.
    *   Is it possible there is a typo in my reading? "8x8x8+43+(432+432x3)-39"
    *   Let's check the numbers again.
    *   $512 + 43 = 555$
    *   $432 \times 3 = 1296$
    *   $432 + 1296 = 1728$
    *   $555 + 1728 = 2283$
    *   $2283 - 39 = 2244$

    *   Let's check if there's any ambiguity. "432+432x3" is inside parentheses.
    *   Multiplication takes precedence inside the parentheses.
    *   $432 + 1296 = 1728$. Correct.
    *   $8^3 = 512$. Correct.
    *   $512 + 43 + 1728 - 39$.
    *   $512 + 43 = 555$.
    *   $555 + 1728 = 2283$.
    *   $2283 - 39 = 2244$.

    *   Wait, is there a trick?
    *   $432 + 432 \times 3$...
    *   $432(1+3) = 432 \times 4 = 1728$.
    *   Ah, that's a nice shortcut. $432 \times 4$.
    *   $432 \times 2 = 864$.
    *   $864 \times 2 = 1728$.
    *   Yes, calculation holds up.
    *   $8 \times 8 \times 8 = 512$.
    *   $512 + 43 + 1728 - 39$.
    *   $512 + 1728 = 2240$.
    *   $2240 + 43 = 2283$.
    *   $2283 - 39 = 2244$.
    *   Wait, $2240 + 43 - 39$.
    *   $43 - 39 = 4$.
    *   $2240 + 4 = 2244$.
    *   This confirms the previous calculation ($2283 - 39 = 2244$) but is slightly faster to verify.

6.  **Construct Final Output:**
    *   State the expression.
    *   Show the order of operations steps clearly.
    *   Calculate the power ($8^3$).
    *   Calculate the multiplication inside parentheses.
    *   Add inside parentheses.
    *   Perform the final additions and subtractions.
    *   State the final answer clearly.

7.  **Final Polish:**
    *   Expression: $8 \times 8 \times 8 + 43 + (432 + 432 \times 3) - 39$
    *   Step 1: Parentheses. $432 \times 3 = 1296$. Then $432 + 1296 = 1728$.
    *   Step 2: Multiplication. $8 \times 8 \times 8 = 512$.
    *   Step 3: Remaining additions/subtractions. $512 + 43 + 1728 - 39$.
    *   $555 + 1728 - 39$.
    *   $2283 - 39 = 2244$.

    Looks solid. Ready to write.

    Wait, just a quick sanity check on the numbers.
    $432 + 432 \times 3$.
    $432 \times (1+3) = 432 \times 4$.
    $400 \times 4 = 1600$.
    $32 \times 4 = 128$.
    $1600 + 128 = 1728$.
    Correct.

    $8^3 = 512$.
    Correct.

    $512 + 43 = 555$.
    Correct.

    $555 + 1728 = 2283$.
    Correct.

    $2283 - 39 = 2244$.
    Correct.

    All checks pass.

    Wait, could the input be interpreted differently?
    "8x8x8+43+(432+432x3)-39"
    Is it possible "432" is a variable? No, context implies arithmetic.
    Is it possible "8x8x8" is $8 \times 8 \times 8$? Yes.
    Is it possible the user meant a specific math puzzle with a trick?
    Usually, these are just straight arithmetic.
    The number $432$ is specific.
    $432 \times 3 = 1296$.
    $432 + 1296 = 1728$.
    $8^3 = 512$.
    $512 + 43 + 1728 - 39$.
    Maybe there is a pattern?
    $1728 = 12^3$.
    $512 = 8^3$.
    $43 = 43$.
    $-39$.
    So $8^3 + 43 + 12^3 - 39$.
    $8^3 + 12^3 + (43 - 39)$.
    $512 + 1728 + 4$.
    $2240 + 4 = 2244$.
    Interesting, but not a "trick", just observation. The calculation stands.

    Okay, proceed with generating the response.
    Structure:
    1.  State order of operations (PEMDAS).
    2.  Solve parentheses.
    3.  Solve multiplication.
    4.  Solve addition/subtraction.
    5.  Final result.
    Keep it clear and concise.

    Wait, re-read the input string one more time to ensure no typos in my transcription.
    "8x8x8+43+(432+432x3)-39"
    My transcription: $8 \times 8 \times 8 + 43 + (432 + 432 \times 3) - 39$
    Matches perfectly.

    Ready.

</div>


To solve the expression **8x8x8+43+(432+432x3)-39**, we follow the order of operations (PEMDAS/BODMAS): Parentheses, Exponents/Multiplication, then Addition and Subtraction.

**Step 1: Simplify the parentheses**
Inside the parentheses, we have: `(432 + 432x3)`
Multiplication comes before addition.
*   $432 \times 3 = 1296$
*   $432 + 1296 = 1728$

Now the expression looks like this:
$8 \times 8 \times 8 + 43 + 1728 - 39$

**Step 2: Perform the multiplication**
*   $8 \times 8 \times 8 = 512$

Now the expression looks like this:
$512 + 43 + 1728 - 39$

**Step 3: Perform addition and subtraction (left to right)**
*   $512 + 43 = 555$
*   $555 + 1728 = 2283$
*   $2283 - 39 = 2244$

**Answer:**
**2244**

</details>


## 🧠 Training Details

* **Base Model:** `Qwen/Qwen3.5-4B`
* **Fine-tuning:** SFT (Supervised Fine-Tuning).
* **Training Tool:** **Unsloth** (for 4-bit optimized training).


## 😎 Cool License

**Feel free to use or improve Nomi! Benchmark results are always welcome.**

---