---
library_name: transformers
license: apache-2.0
base_model: LLM-OS-Models/Fabliq-8B-Agent-FromBase
base_model_relation: finetune
tags:
  - lfm
  - liquid-ai
  - moe
  - agentic
  - terminal
  - reasoning
  - fable-5
  - withinus
  - helio
  - distillation
  - sft
  - ablation
language:
  - en
pipeline_tag: text-generation
---

# Fabliq-8B-Agent-FromBase-Reasoning 🌊🔬🧠

> **Reasoning-expanded sibling** of [Fabliq-8B-Agent-FromBase](https://huggingface.co/LLM-OS-Models/Fabliq-8B-Agent-FromBase). Adds general + deep reasoning (WithinUs + Helio) on top of the FromBase agentic foundation. Mirrors [Fabliq-8B-Agent-Reasoning](https://huggingface.co/LLM-OS-Models/Fabliq-8B-Agent-Reasoning) but for the FromBase ablation lineage.

## 🔬 Why this variant?

Two parallel lineages, both end with reasoning expansion:

| Lineage | Phase-1 | Phase-2 |
| --- | --- | --- |
| **ToolBench line** | `Fabliq-8B-Agent` (ToolBench → Fable-5) | `Fabliq-8B-Agent-Reasoning` |
| **FromBase line (this)** | `Fabliq-8B-Agent-FromBase` (base → Fable-5) | `Fabliq-8B-Agent-FromBase-Reasoning` (this) |

Comparing the two Phase-2 endpoints answers: **does ToolBench foundation matter for the final reasoning model, or is Fable-5 + reasoning enough?**

## 🧪 Model details

| | |
| --- | --- |
| **Architecture** | Lfm2MoeForCausalLM (24 layers, 32 experts, 4 experts/token) |
| **Parameters** | ~8B total / ~1B active (MoE) |
| **Context** | 8,192 trained · 128K native |
| **Precision** | bfloat16 |
| **Fine-tune type** | Full-parameter SFT continuation |
| **License** | Apache 2.0 |

## 📚 Training data (Phase-2B only)

Same as Phase-2: WithinUs 135 + Helio 146 = 281 rows × 4 epoch.

## 🔧 Training procedure

| Hyperparameter | Value |
| --- | --- |
| Base | `LLM-OS-Models/Fabliq-8B-Agent-FromBase` |
| Schedule | 4 epochs, LR 3e-7 |
| Max sequence length | 8,192 |
| GPUs | 8× H200 (effective batch 64) |
| Train runtime | ~6 min |

## 🌳 Model tree

```
LiquidAI/LFM2.5-8B-A1B
  ├─ ToolBench line:
  │   └─ LFM2.5-8B-A1B-Terminal-ToolBench-Full-SFT-1Epoch
  │       └─ Fabliq-8B-Agent
  │           └─ Fabliq-8B-Agent-Reasoning
  └─ FromBase line (this):
      └─ Fabliq-8B-Agent-FromBase
          └─ Fabliq-8B-Agent-FromBase-Reasoning  ← this model
```

## 📜 License

Apache 2.0.