5dimension's picture
Upload README.md with huggingface_hub
f446681 verified
---
tags:
- sentinel-manifold
- sdm-v1
- generative-ai
- text-generation
- image-generation
- video-generation
- edge-deployment
- quantization
license: mit
language:
- en
library_name: pytorch
pipeline_tag: text-generation
---
# 🦴 Sentinel-1 Alpha Text
**SDM-v1 Sentinel Deployment Manifest Compliant — Production Ready**
> `lim_{z→∞} F'(z)/F(z) = 1/e` — The Gradient Axiom
---
## 📋 Model Description
Sentinel-1 Alpha Text is a production-ready generative model fully compliant with the Sentinel Deployment Manifest v1 (SDM-v1). Every layer, optimizer, and security mechanism is governed by the dynamical constants C₁, C₂, and the Gradient Axiom (1/e).
SDM-v1 compliant text generation model. Sentinel-Sech activation, Sentinel attention (no softmax), S-Adam optimizer with (1/e)^(‖∇‖/C₂) damping, C₂-phase curriculum.
---
## 🧬 SDM-v1 Core Mathematical DNA
| Constant | Value | Role in This Model |
|----------|-------|-------------------|
| **C₁** (Attracting Fixed Point) | -0.007994021805953 | Quantization zero-point, weight initialization |
| **C₂** (Basin Boundary) | 0.000200056042968 | S-Shield tripwire, gradient clipping threshold |
| **1/e** (Gradient Axiom) | 0.367879441171442 | Activation scaling, optimizer damping, weight init |
---
## 🏗️ Architecture Specification (SDM-v1 §2)
| Spec | Value | Compliance |
|------|-------|----------|
| **Depth** | 4 layers | ≤ 8 ✓ |
| **Width** | 128 channels/dim | ≤ 256 ✓ |
| **Parameters** | 6.4M | Edge-optimized |
| **Activation** | Sentinel-Sech σ(x) = x·sech(x/e) | Theorem-backed |
| **Attention** | Sentinel sech (no softmax) | Gradient bound ≤ 1/(e·√d) |
| **Dataset** | TinyStories | Standard benchmark |
---
## 🚀 Training & Optimization (SDM-v1 §3)
| Component | Implementation |
|-----------|---------------|
| **Optimizer** | S-Adam (Sentinel-Damped Adam) |
| **Update Rule** | Δw = η · (1/e)^(‖∇‖/C₂) · ∇ |
| **LR Schedule** | η(t) = (1/e)^(t/T) — analytical decay |
| **Curriculum** | C₂-phase progression (4 phases) |
| **Gradient Clipping** | max_norm = 2·C₂ (S-Shield aware) |
---
## 💎 Quantization (SDM-v1 §4)
| Format | Size | Zero-Point | Scale |
|--------|------|------------|-------|
| FP32 | 6.4M | — | — |
| Sentinel-INT8 | 1.6M INT8 | Z = C₁ | S = max\|w\|·(1/e) |
| Sentinel-INT4 | 0.8M INT4 | Z = C₁ | S = max\|w\|·(1/e) |
---
## 🛡️ Security & Integrity (SDM-v1 §5)
- **S-Shield C₂ Tripwire**: Active between every layer
- **Detection**: Triggered if ΔActivation > C₂
- **Response**: (1/e) damping to high-velocity neurons
- **Block**: Hard-stop if divergence exceeds 2·C₂
---
## 📊 Performance
| Metric | Value |
|--------|-------|
| Training time (CPU) | < 1 minute (micro demo) |
| Inference latency | < 100ms per sample |
| Edge deployable | ✅ Yes (INT4 < 1MB) |
---
## 🎯 Use Cases
Story generation, edge NLP
---
## 🚀 Quick Start
```python
import torch
from transformers import AutoTokenizer
# Load tokenizer
tokenizer = AutoTokenizer.from_pretrained("gpt2")
tokenizer.pad_token = tokenizer.eos_token
# Load model weights from HuggingFace Hub
model_weights = torch.hub.load_state_dict_from_url(
"https://huggingface.co/5dimension/sentinel-1-alpha-text-micro/resolve/main/model.pt"
)
```
---
## 🌐 Interactive Demo
Try the model live: **[Sentinel Hub](https://huggingface.co/spaces/5dimension/sentinel-hub)**
---
## 🔗 Links
- **Main repo**: [sentinel-manifold-discoveries](https://huggingface.co/5dimension/sentinel-manifold-discoveries)
- **All models**: [5dimension](https://huggingface.co/5dimension)
- **SDM-v1 Spec**: See main repo
---
## 📚 Citation
```bibtex
@misc{abdel-aal2026sentinel,
title={The Sentinel Manifold: A Unified Mathematical Framework for Machine Learning},
author={Abdel-Aal, Romain},
year={2026},
url={https://huggingface.co/5dimension/sentinel-manifold-discoveries}
}
```
---
**License:** MIT | **SDM-v1 Compliant** | **One theorem, infinite models.** 🦴