Instructions to use KissTheHabit/IDA_Edge with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use KissTheHabit/IDA_Edge with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="KissTheHabit/IDA_Edge")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("KissTheHabit/IDA_Edge") model = AutoModelForCausalLM.from_pretrained("KissTheHabit/IDA_Edge") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use KissTheHabit/IDA_Edge with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "KissTheHabit/IDA_Edge" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KissTheHabit/IDA_Edge", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/KissTheHabit/IDA_Edge
- SGLang
How to use KissTheHabit/IDA_Edge with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "KissTheHabit/IDA_Edge" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KissTheHabit/IDA_Edge", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "KissTheHabit/IDA_Edge" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KissTheHabit/IDA_Edge", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use KissTheHabit/IDA_Edge with Docker Model Runner:
docker model run hf.co/KissTheHabit/IDA_Edge
license: other
license_name: business-source-license-1.1
license_link: https://mariadb.com/bsl11/
license_change_date: '2028-01-01'
license_post_change: Apache-2.0
commercial_use: Requires explicit permission prior to Change Date.
library_name: transformers
pipeline_tag: text-generation
tags:
- ida-family
- ida-lattice
- causal-lm
- edge-body
- paired-body
- governed-memory
- recurrent-state
- local-attention
- cognitive-routing
- tensorboard
- safetensors
- region:us
IDA EDGE Body
KissTheHabit/IDA_Edge is the lightweight EDGE-side artifact repository for the IDA family.
The active architecture is IDA Lattice, a custom causal language model architecture. Legacy Hub metadata may still identify older uploaded artifacts as GPT-NeoX. That metadata is not authoritative for current native Lattice training runs.
Architecture
- Model family:
ida_lattice - Model class:
IDALatticeForCausalLM - Task: causal language modeling and text generation
- Deployment role: lightweight edge-side body
- Shared tokenizer:
KissTheHabit/ida_lattice_bpe_32k - Paired deep body:
KissTheHabit/IDA_AI
The EDGE body preserves the same Lattice physiology as the AI body at a smaller deployment envelope:
- recurrent selective state
- local-attention workspace
- controlled merging
- cognitive-pressure routing
- lateral inhibition
- routed cognitive circuits
- governed memory
- thalamic routing
- prefrontal workspace summaries
- action gating
- student-state output
- shared GH expression projection
- future-token auxiliary prediction
- fidelity verification
Current EDGE Tiers
| Tier | Hidden Size | Layers | Heads | Intermediate | Context | Purpose |
|---|---|---|---|---|---|---|
edge/swift |
256 | 6 | 4 | 768 | 1,024 | Lightweight comparison and deployment tier |
edge/full |
384 | 6 | 6 | 1,024 | Recommended production EDGE tier |
Current edge/swift Proof Shape
- Approximate parameters:
~54M - Recurrent state size:
192 - Local attention window:
128 - Workspace:
6 × 192 - Student state size:
192 - Future prediction horizon:
1 - Thalamic route count:
4 - Action gate size:
6
Paired-Body Lineage
EDGE is not a reduced generic assistant.
It is the lightweight half of a paired EDGE ↔ AI lineage. EDGE preserves the family’s identity, routing, and governed-control surfaces under a smaller local deployment budget. AI carries the deeper body for cases that justify the additional compute.
Promotion Rule
An uploaded EDGE artifact is not automatically canonical.
Promotion requires:
- paired EDGE and AI evidence
- identity agreement across both bodies
- held-out evaluation
- lineage packet completion
- terminal promotion approval
Evidence Surfaces
- TensorBoard archive:
KissTheHabit/IDA-tensorboard - Lineage packets:
KissTheHabit/IDA-lineage - Held-out evaluation:
KissTheHabit/IDA-eval - Identity curriculum:
KissTheHabit/ida-family-identity - Family substrate:
KissTheHabit/IDA-family-data
Intended Use
This repository is intended for controlled edge deployment, local inference research, paired-body identity validation, and governed RegOS integration.
It is not presented as a general-purpose internet-scale assistant.
License
Business Source License 1.1, with Change Date 2028-01-01.
Apache-2.0 applies after the Change Date. Commercial use before the Change Date requires explicit permission.