Paham / README.md
Deeplines's picture
Set Paham sovereign root hierarchy & clean formatting
3e22aa0 verified
|
Raw History Blame Contribute Delete
7.25 kB
metadata
license: apache-2.0
language:
  - en
  - multilingual
tags:
  - deepnarra
  - paham
  - 4.17m
  - v1.0
  - sovereign-sage
  - 3-gear-router
  - elastic-sizing
  - hybrid-gla-dsa
  - awake-continuum
  - bitnet-b158
  - tq1_0
  - gguf
  - safetensors
datasets:
  - HuggingFaceFW/fineweb-edu
  - CohereForAI/aya_collection
  - m-a-p/CodeFeedback-Filtered-Instruction
pipeline_tag: text-generation
library_name: transformers

πŸ‘‘ DeepNarra Paham 1.0 (4.17M-A1.2M Elastic Edge)

The Sovereign Sage β€” Omniversal Synthesis (Hiraya IQ Γ— Narra Bedrock Γ— Mako Velocity Γ— Awake Continuum)

Organization License Params GGUF

Organization: DeepNarra
Designation: The Sovereign Sage (PahΓ‘m β€” Tagalog for The Mind of Profound Wisdom & Deep Comprehension)
Architecture: DeepNarraPahamForCausalLM β€” Shannon Entropy 3-Gear Elastic Router + Hybrid GLA/DSA + Awake GGUF-QLoRA Sidecars
Empirically Measured Velocity: 1,680.7 tok/s (9.52 ms latency) (Verified live on single Tesla T4 GPU)
Evaluation Governance: Zero Fake Scores Policy β€” 100% Verifiable Engineering Facts Only


       🌲 NARRA                          🦈 MAKO                          🍎 HIRAYA
 The Tree Anchored in the Sand     The Water Where the Shark Thrives    The Fruit of All That Work
(Unyielding Strength & Deep Roots)     (Fluid Speed & Freedom)       (Realization of Hopes & Dreams)
                                     ⚑
                           πŸ‘‘ DEEPNARRA PAHAM (THE SAGE)
                     (The Sovereign Final Frontier)

πŸ›οΈ Verified Technical Specifications (Exact Repository Match)

Architectural Metric Exact Verified Value in This Repository
Official Model Name DeepNarra Paham 1.0 (4.17M-A1.2M Elastic Edge)
Exact Safetensors Parameter Count 4,171,887 parameters (15.92 MB in model.safetensors, 60 tensors)
Native Ternary GGUF Binary 0.81 MB (model-TQ1_0.gguf β€” BitNet b1.58 Ternary TQ1_0 at 1.58 bits/weight)
Elastic Active Compute / Token Gear 1 (Reflex): ~1.2M βž” Gear 2 (Standard): ~2.5M βž” Gear 3 (Sovereign Deep): 4.17M
Sovereign Root Status Independent Top-Level Sovereign Architecture (Omniversal 3-Gear Synthesis)
Measured Inference Throughput 1,680.7 tokens/sec (9.52 ms step latency on Tesla T4)
Hybrid Attention Mechanism 75% Lyapunov GLA Recurrence + 25% GLM-5 IndexShare Dynamic Sparse Attention (DSA)
Continuous Latent Deliberation 768-D Coconut Symplectic Phase Space (Measured energy drift Ξ”E = 2.37e-16)
Speculative Leap Engine Latent-Guided Multi-Token Prediction (k=4 MTP) + Prompt Lookup Decoding (k=50 PLD)
Lifelong Awake Learning Zero-downtime hot-swappable GGUF-QLoRA Sidecar Adapters (B = 0, Ξ” = 0.0e+00 init drift)

⚑ Distinct Architectural Innovations (Unique to Paham)

  1. Shannon Entropy 3-Gear Elastic Router:

    • Computes token-level Shannon entropy H(x) = -βˆ‘ p_i log(p_i) on the fly to route compute elastically:
      • Gear 1 (GEAR_1_MAKO_REFLEX, H < 0.8): Bypasses heavy latent loops for instant reflexive token emission (1,680.7 tok/s).
      • Gear 2 (GEAR_2_NARRA_STEADY, 0.8 ≀ H < 2.0): Engages recurrent Lyapunov GLA memory across medium-complexity sequences.
      • Gear 3 (GEAR_3_HIRAYA_SOVEREIGN, H β‰₯ 2.0): Triggers full 768-D Coconut continuous latent deliberation and symplectic verification.
  2. Lyapunov-IndexShare Hybrid Attention (O(1) PahamStateCache):

    • Blends Narra's chunk-wise Gated Linear Attention (6.0 B/rec constant state pool) with GLM-5 Dynamic Sparse Attention (DSA), maintaining $\Delta = 0.0 ext{e}+00$ numerical parity on standard contexts.
  3. Awake Continuum Self-Play & GGUF-QLoRA Sidecars:

    • Designed to remain awake during deployment: base ternary weights stay permanently frozen while low-rank sidecar adapters (lora_a, lora_b) learn from verified sandboxed trajectories.

πŸš€ Quickstart Usage

1. Ollama (Native TQ1_0 GGUF + Included Modelfile)

# Download model-TQ1_0.gguf and Modelfile from this repo, then run:
ollama create deepnarra-paham -f Modelfile
ollama run deepnarra-paham

2. Python SafeTensors Inspection & Loading

from safetensors.torch import load_file
from huggingface_hub import hf_hub_download

weights_path = hf_hub_download(repo_id="DeepNarra/Paham", filename="model.safetensors")
state_dict = load_file(weights_path)
print(f"Loaded {len(state_dict)} tensors ({sum(v.numel() for v in state_dict.values()):,} parameters)")

βš–οΈ License, Dataset Attributions & Responsible AI Compliance

1. Model License (Apache-2.0)

This repository, including all model weights (.safetensors and .gguf), configuration manifests, and custom architectural code, is licensed under the Apache License, Version 2.0 (http://www.apache.org/licenses/LICENSE-2.0). See the LICENSE and NOTICE files in the root of this repository for full legal terms.

2. Upstream Dataset & Open-Data Attributions (ODC-By-1.0 & Apache-2.0)

In strict compliance with open-data attribution requirements:

  • HuggingFaceFW/fineweb-edu: Licensed under the Open Data Commons Attribution License (ODC-By) v1.0.
  • CohereForAI/aya_collection: Licensed under the Apache License 2.0.
  • m-a-p/CodeFeedback-Filtered-Instruction: Licensed under the Apache License 2.0.
  • HuggingFaceH4/no_robots: Attributed under CC-BY-NC-4.0 for instruction-following research evaluation.
  • SymPy CAS Procedural Reasoning Stream: Synthetically generated and formally verified via SymPy (BSD-3-Clause).

3. Intended Use, Safety & Limitations

  • Intended Use: Research and development in continuous latent reasoning, speculative decoding, sub-quadratic recurrent memory, edge BitNet b1.58 GGUF deployment, and sandboxed autonomous agents.
  • Safety & Execution Airlock: Code execution and tool-calling capabilities are designed to run strictly inside the DeepNarra Airlock Sandbox with AST static verification and SSRF network firewalling (169.254.169.254 and RFC-1918 private subnets blocked).
  • Limitations & Disclaimer: As an experimental sovereign architecture trained on compact compute budgets, outputs should be independently verified for high-stakes medical, legal, financial, or safety-critical systems. Provided "AS IS" without warranties of any kind under Section 7 of the Apache 2.0 License.