---
license: apache-2.0
language:
- en
- multilingual
tags:
- deepnarra
- paham
- 4.17m
- v1.0
- sovereign-sage
- 3-gear-router
- elastic-sizing
- hybrid-gla-dsa
- awake-continuum
- bitnet-b158
- tq1_0
- gguf
- safetensors
datasets:
- HuggingFaceFW/fineweb-edu
- CohereForAI/aya_collection
- m-a-p/CodeFeedback-Filtered-Instruction
pipeline_tag: text-generation
library_name: transformers
---

# 👑 DeepNarra Paham 1.0 (4.17M-A1.2M Elastic Edge)
### *The Sovereign Sage — Omniversal Synthesis (Hiraya IQ × Narra Bedrock × Mako Velocity × Awake Continuum)*

[![Organization](https://img.shields.io/badge/Organization-DeepNarra-blue?style=for-the-badge)](https://huggingface.co/DeepNarra)
[![License](https://img.shields.io/badge/License-Apache_2.0-green?style=for-the-badge)](LICENSE)
[![Params](https://img.shields.io/badge/Safetensors_Params-4,171,887_(4.17M)-purple?style=for-the-badge)](https://huggingface.co/DeepNarra/Paham)
[![GGUF](https://img.shields.io/badge/BitNet_TQ1__0_GGUF-0.81_MB_(1.58_bpw)-orange?style=for-the-badge)](model-TQ1_0.gguf)

> **Organization:** [DeepNarra](https://huggingface.co/DeepNarra)  
> **Designation:** **The Sovereign Sage** (*Pahám — Tagalog for The Mind of Profound Wisdom & Deep Comprehension*)  
> **Architecture:** `DeepNarraPahamForCausalLM` — Shannon Entropy 3-Gear Elastic Router + Hybrid GLA/DSA + Awake GGUF-QLoRA Sidecars  
> **Empirically Measured Velocity:** **1,680.7 tok/s (`9.52 ms` latency)** *(Verified live on single Tesla T4 GPU)*  
> **Evaluation Governance:** Zero Fake Scores Policy — 100% Verifiable Engineering Facts Only  

---

```text
       🌲 NARRA                          🦈 MAKO                          🍎 HIRAYA
 The Tree Anchored in the Sand     The Water Where the Shark Thrives    The Fruit of All That Work
(Unyielding Strength & Deep Roots)     (Fluid Speed & Freedom)       (Realization of Hopes & Dreams)
                                     ⚡
                           👑 DEEPNARRA PAHAM (THE SAGE)
                     (The Sovereign Final Frontier)
```

---

## 🏛️ Verified Technical Specifications (Exact Repository Match)

| Architectural Metric | Exact Verified Value in This Repository |
| :--- | :--- |
| **Official Model Name** | **DeepNarra Paham 1.0 (4.17M-A1.2M Elastic Edge)** |
| **Exact Safetensors Parameter Count** | **`4,171,887` parameters** (`15.92 MB` in `model.safetensors`, `60` tensors) |
| **Native Ternary GGUF Binary** | **`0.81 MB`** (`model-TQ1_0.gguf` — BitNet b1.58 Ternary `TQ1_0` at `1.58 bits/weight`) |
| **Elastic Active Compute / Token** | **Gear 1 (Reflex):** `~1.2M` ➔ **Gear 2 (Standard):** `~2.5M` ➔ **Gear 3 (Sovereign Deep):** `4.17M` |
| **Sovereign Root Status** | **Independent Top-Level Sovereign Architecture** (Omniversal 3-Gear Synthesis) |
| **Measured Inference Throughput** | **`1,680.7 tokens/sec`** (`9.52 ms` step latency on Tesla T4) |
| **Hybrid Attention Mechanism** | **75% Lyapunov GLA Recurrence + 25% GLM-5 IndexShare Dynamic Sparse Attention (DSA)** |
| **Continuous Latent Deliberation** | **768-D Coconut Symplectic Phase Space** (Measured energy drift `ΔE = 2.37e-16`) |
| **Speculative Leap Engine** | Latent-Guided Multi-Token Prediction (`k=4` MTP) + Prompt Lookup Decoding (`k=50` PLD) |
| **Lifelong Awake Learning** | Zero-downtime hot-swappable **GGUF-QLoRA Sidecar Adapters** (`B = 0`, `Δ = 0.0e+00` init drift) |

---

## ⚡ Distinct Architectural Innovations (Unique to Paham)

1. **Shannon Entropy 3-Gear Elastic Router:**
   - Computes token-level Shannon entropy `H(x) = -∑ p_i log(p_i)` on the fly to route compute elastically:
     - **Gear 1 (`GEAR_1_MAKO_REFLEX`, `H < 0.8`):** Bypasses heavy latent loops for instant reflexive token emission (`1,680.7 tok/s`).
     - **Gear 2 (`GEAR_2_NARRA_STEADY`, `0.8 ≤ H < 2.0`):** Engages recurrent Lyapunov GLA memory across medium-complexity sequences.
     - **Gear 3 (`GEAR_3_HIRAYA_SOVEREIGN`, `H ≥ 2.0`):** Triggers full 768-D Coconut continuous latent deliberation and symplectic verification.

2. **Lyapunov-IndexShare Hybrid Attention (`O(1)` PahamStateCache):**
   - Blends Narra's chunk-wise Gated Linear Attention (`6.0 B/rec` constant state pool) with GLM-5 Dynamic Sparse Attention (DSA), maintaining $\Delta = 0.0	ext{e}+00$ numerical parity on standard contexts.

3. **Awake Continuum Self-Play & GGUF-QLoRA Sidecars:**
   - Designed to remain awake during deployment: base ternary weights stay permanently frozen while low-rank sidecar adapters (`lora_a`, `lora_b`) learn from verified sandboxed trajectories.

---

## 🚀 Quickstart Usage

### 1. Ollama (Native `TQ1_0` GGUF + Included `Modelfile`)
```bash
# Download model-TQ1_0.gguf and Modelfile from this repo, then run:
ollama create deepnarra-paham -f Modelfile
ollama run deepnarra-paham
```

### 2. Python SafeTensors Inspection & Loading
```python
from safetensors.torch import load_file
from huggingface_hub import hf_hub_download

weights_path = hf_hub_download(repo_id="DeepNarra/Paham", filename="model.safetensors")
state_dict = load_file(weights_path)
print(f"Loaded {len(state_dict)} tensors ({sum(v.numel() for v in state_dict.values()):,} parameters)")
```

---

## ⚖️ License, Dataset Attributions & Responsible AI Compliance

### 1. Model License (`Apache-2.0`)
This repository, including all model weights (`.safetensors` and `.gguf`), configuration manifests, and custom architectural code, is licensed under the **[Apache License, Version 2.0](LICENSE)** (`http://www.apache.org/licenses/LICENSE-2.0`). See the [`LICENSE`](LICENSE) and [`NOTICE`](NOTICE) files in the root of this repository for full legal terms.

### 2. Upstream Dataset & Open-Data Attributions (`ODC-By-1.0` & `Apache-2.0`)
In strict compliance with open-data attribution requirements:
* **HuggingFaceFW/fineweb-edu:** Licensed under the *Open Data Commons Attribution License (ODC-By) v1.0*.
* **CohereForAI/aya_collection:** Licensed under the *Apache License 2.0*.
* **m-a-p/CodeFeedback-Filtered-Instruction:** Licensed under the *Apache License 2.0*.
* **HuggingFaceH4/no_robots:** Attributed under *CC-BY-NC-4.0* for instruction-following research evaluation.
* **SymPy CAS Procedural Reasoning Stream:** Synthetically generated and formally verified via *SymPy* (*BSD-3-Clause*).

### 3. Intended Use, Safety & Limitations
* **Intended Use:** Research and development in continuous latent reasoning, speculative decoding, sub-quadratic recurrent memory, edge BitNet b1.58 GGUF deployment, and sandboxed autonomous agents.
* **Safety & Execution Airlock:** Code execution and tool-calling capabilities are designed to run strictly inside the **DeepNarra Airlock Sandbox** with AST static verification and SSRF network firewalling (`169.254.169.254` and RFC-1918 private subnets blocked).
* **Limitations & Disclaimer:** As an experimental sovereign architecture trained on compact compute budgets, outputs should be independently verified for high-stakes medical, legal, financial, or safety-critical systems. Provided `"AS IS"` without warranties of any kind under Section 7 of the Apache 2.0 License.