Text Generation
Transformers
TensorBoard
Safetensors
gpt_neox
ida-family
ida-lattice
causal-lm
edge-body
paired-body
governed-memory
recurrent-state
local-attention
cognitive-routing
text-generation-inference
Instructions to use KissTheHabit/IDA_Edge with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use KissTheHabit/IDA_Edge with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="KissTheHabit/IDA_Edge")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("KissTheHabit/IDA_Edge") model = AutoModelForCausalLM.from_pretrained("KissTheHabit/IDA_Edge") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use KissTheHabit/IDA_Edge with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "KissTheHabit/IDA_Edge" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KissTheHabit/IDA_Edge", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/KissTheHabit/IDA_Edge
- SGLang
How to use KissTheHabit/IDA_Edge with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "KissTheHabit/IDA_Edge" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KissTheHabit/IDA_Edge", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "KissTheHabit/IDA_Edge" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KissTheHabit/IDA_Edge", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use KissTheHabit/IDA_Edge with Docker Model Runner:
docker model run hf.co/KissTheHabit/IDA_Edge
| license: other | |
| license_name: business-source-license-1.1 | |
| license_link: https://mariadb.com/bsl11/ | |
| license_change_date: "2028-01-01" | |
| license_post_change: Apache-2.0 | |
| commercial_use: Requires explicit permission prior to Change Date. | |
| library_name: transformers | |
| pipeline_tag: text-generation | |
| tags: | |
| - ida-family | |
| - ida-lattice | |
| - causal-lm | |
| - edge-body | |
| - paired-body | |
| - governed-memory | |
| - recurrent-state | |
| - local-attention | |
| - cognitive-routing | |
| - tensorboard | |
| - safetensors | |
| - region:us | |
| # IDA EDGE Body | |
| `KissTheHabit/IDA_Edge` is the lightweight EDGE-side artifact repository for the IDA family. | |
| The active architecture is **IDA Lattice**, a custom causal language model architecture. Legacy Hub metadata may still identify older uploaded artifacts as GPT-NeoX. That metadata is not authoritative for current native Lattice training runs. | |
| ## Architecture | |
| - Model family: `ida_lattice` | |
| - Model class: `IDALatticeForCausalLM` | |
| - Task: causal language modeling and text generation | |
| - Deployment role: lightweight edge-side body | |
| - Shared tokenizer: [`KissTheHabit/ida_lattice_bpe_32k`](https://hf.co/KissTheHabit/ida_lattice_bpe_32k) | |
| - Paired deep body: [`KissTheHabit/IDA_AI`](https://hf.co/KissTheHabit/IDA_AI) | |
| The EDGE body preserves the same Lattice physiology as the AI body at a smaller deployment envelope: | |
| - recurrent selective state | |
| - local-attention workspace | |
| - controlled merging | |
| - cognitive-pressure routing | |
| - lateral inhibition | |
| - routed cognitive circuits | |
| - governed memory | |
| - thalamic routing | |
| - prefrontal workspace summaries | |
| - action gating | |
| - student-state output | |
| - shared GH expression projection | |
| - future-token auxiliary prediction | |
| - fidelity verification | |
| ## Current EDGE Tiers | |
| | Tier | Hidden Size | Layers | Heads | Intermediate | Context | Purpose | | |
| |---|---:|---:|---:|---:|---:|---| | |
| | `edge/swift` | 256 | 6 | 4 | 768 | 1,024 | Lightweight comparison and deployment tier | | |
| | `edge/full` | 384 | 6 | 6 | 1,024 | Recommended production EDGE tier | | |
| ### Current `edge/swift` Proof Shape | |
| - Approximate parameters: `~54M` | |
| - Recurrent state size: `192` | |
| - Local attention window: `128` | |
| - Workspace: `6 × 192` | |
| - Student state size: `192` | |
| - Future prediction horizon: `1` | |
| - Thalamic route count: `4` | |
| - Action gate size: `6` | |
| ## Paired-Body Lineage | |
| EDGE is not a reduced generic assistant. | |
| It is the lightweight half of a paired EDGE ↔ AI lineage. EDGE preserves the family’s identity, routing, and governed-control surfaces under a smaller local deployment budget. AI carries the deeper body for cases that justify the additional compute. | |
| ## Promotion Rule | |
| An uploaded EDGE artifact is not automatically canonical. | |
| Promotion requires: | |
| - paired EDGE and AI evidence | |
| - identity agreement across both bodies | |
| - held-out evaluation | |
| - lineage packet completion | |
| - terminal promotion approval | |
| ## Evidence Surfaces | |
| - TensorBoard archive: [`KissTheHabit/IDA-tensorboard`](https://hf.co/datasets/KissTheHabit/IDA-tensorboard) | |
| - Lineage packets: [`KissTheHabit/IDA-lineage`](https://hf.co/datasets/KissTheHabit/IDA-lineage) | |
| - Held-out evaluation: [`KissTheHabit/IDA-eval`](https://hf.co/datasets/KissTheHabit/IDA-eval) | |
| - Identity curriculum: [`KissTheHabit/ida-family-identity`](https://hf.co/datasets/KissTheHabit/ida-family-identity) | |
| - Family substrate: [`KissTheHabit/IDA-family-data`](https://hf.co/datasets/KissTheHabit/IDA-family-data) | |
| ## Intended Use | |
| This repository is intended for controlled edge deployment, local inference research, paired-body identity validation, and governed RegOS integration. | |
| It is not presented as a general-purpose internet-scale assistant. | |
| ## License | |
| Business Source License 1.1, with Change Date `2028-01-01`. | |
| Apache-2.0 applies after the Change Date. Commercial use before the Change Date requires explicit permission. |