Text Generation
Safetensors
Rust
RWKV
English
oicio-rs
ternary
matmul-free
cpu-only
1.58-bit
bitnet
bonsai
infinite-context
em-llm
reattention
recursive-agent-harness
rlm
rah
edge-ai
needle
hadamard
mlgru
mamba
liquid-neural-networks
turbovec
turboquant
t-mac
vec-lut
axon
consumer-hardware
better-quality
intelligence-density
Instructions to use deeprcurs/OICIO with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- RWKV
How to use deeprcurs/OICIO with RWKV:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -149,52 +149,6 @@ Based on BitNet Training Tips FAQ, Bonsai whitepaper, QLoRA, ZeRO-Offload, Axon:
|
|
| 149 |
|
| 150 |
- **Tier 3 OICIO-Frontier (100% from scratch, high-end consumer):** Train 1.7B 0.4GB or 8B 1.75GB from scratch with 400B-1T tokens on Mac Studio M2 Ultra 192GB ~20-30 days. True ownership, no attribution.
|
| 151 |
|
| 152 |
-
## Implementation — Snapshot Rules
|
| 153 |
-
|
| 154 |
-
**Snapshot limit:** 128MB / 10K files
|
| 155 |
-
|
| 156 |
-
**Snapshot-safe (<1MB):** Code only `oicio/` Python POC + `oicio-rs/` Rust CPU-only + whitepapers + README + Dockerfile + app.py + .github/workflows
|
| 157 |
-
|
| 158 |
-
**Excluded (can re-download, outside snapshot):**
|
| 159 |
-
- `.cache/`: Rust toolchain (Cargo, rustup), Python venv (torch 191MB CPU, transformers, safetensors, fastapi, gradio), models (BitNet 2B 1.1GB), swap files (10GB+5GB=14GB active, autoscale 20GB,30GB), checkpoints (32MB)
|
| 160 |
-
- `.venv/`: Python venv
|
| 161 |
-
- `.cargo/`, `target/`, `oicio-rs/target/`: Rust build artifacts
|
| 162 |
-
- `__pycache__/`, `*.pt`, `*.safetensors`: Cache and weights
|
| 163 |
-
- Total excluded: ~17GB
|
| 164 |
-
|
| 165 |
-
**Rules:**
|
| 166 |
-
- Do not disturb snapshot: keep code <128MB / 10K files, toolchain in `.cache` excluded
|
| 167 |
-
- If RAM insufficient by calculation, swap before OOM: OS swap 10GB,20GB,30GB... in `.cache` + Python/Rust offload via memmap2
|
| 168 |
-
|
| 169 |
-
**Proof:**
|
| 170 |
-
- Snapshot: 64 files, 526KB total after cleanup, 57 files 466KB after Rust port
|
| 171 |
-
- Swap: 14GB active (10+5), autoscale logic to 20GB demonstrated
|
| 172 |
-
- Training: 6.8M model 50 steps 23.4s loss drop 0.0111 sparsity 31->34% in 1.9GB RAM + 14GB swap
|
| 173 |
-
- Real weights: BitNet 2B 1.1GB safetensors 542 tensors loaded, ternary matmul no mul
|
| 174 |
-
- Rust binary: 501KB native + 607KB musl static (like Needle2 14MB) + 4.5MB generated via rustc CPU-only, all MatMul-free CPU-only
|
| 175 |
-
|
| 176 |
-
## Infrastructure — Free Tier Without Credit Card/Phone
|
| 177 |
-
|
| 178 |
-
**For automation without manual steps, using 2 tokens (GH + HF) shared:**
|
| 179 |
-
|
| 180 |
-
- **GitHub Token `ghp_...` (repo scope):** Push to `deepRcurs/OICIO`, setup Actions Secrets, trigger training in GitHub Actions Free (2-core CPU, 7GB RAM, 2000 min/month, no credit card, no phone verification). Already proven: Run 32607984794 status completed success with 11 steps success including Rust build 501KB and training from scratch HERE and push checkpoint to HF Hub via secret.
|
| 181 |
-
|
| 182 |
-
- **HF Token `hf_...` (write):** Push to HuggingFace Hub `deeprcurs-staff/OICIO` (100GB private free, 5TB public best-effort, no credit card, no phone). Already proven: 61 files including BitNet 2B 1.1GB real weights + `training_logs/github_actions/training_log_here.json` pushed from GitHub Actions.
|
| 183 |
-
|
| 184 |
-
- **MyBinder.org:** No account needed, just GitHub repo public https://github.com/deepRcurs/OICIO, VM 2GB RAM, auto-build https://mybinder.org/v2/gh/deepRcurs/OICIO/main, no credit card, no phone.
|
| 185 |
-
|
| 186 |
-
- **Cloudflare R2:** 10GB free forever, 1M write, 10M read, unlimited egress, no credit card required per tutorial, S3-compatible, for backup.
|
| 187 |
-
|
| 188 |
-
- **GitHub Releases:** Unlimited for public repo, for 14MB binary and whitepapers.
|
| 189 |
-
|
| 190 |
-
**HF Spaces Free CPU per 2026:** As of July 2026, free CPU Basic for Gradio/Docker Spaces discontinued for new free users (community complaint 12 July 2026: "completely eliminate the free CPU Basic instance flavor"), only ZeroGPU remains with quota 3.5 min/day and Static Spaces free. So training in HF Spaces free is not feasible, but GitHub Actions free still works and Hub storage still free.
|
| 191 |
-
|
| 192 |
-
**Final URLs:**
|
| 193 |
-
- GitHub: https://github.com/deepRcurs/OICIO
|
| 194 |
-
- HF Hub: https://huggingface.co/deeprcurs-staff/OICIO
|
| 195 |
-
- MyBinder: https://mybinder.org/v2/gh/deepRcurs/OICIO/main
|
| 196 |
-
- Latest Successful Run: https://github.com/deepRcurs/OICIO/actions/runs/32607984794
|
| 197 |
-
|
| 198 |
## References
|
| 199 |
|
| 200 |
- EM-LLM: Human-inspired Episodic Memory for Infinite Context LLMs (ICLR 2025) — https://github.com/em-llm/EM-LLM-model
|
|
@@ -219,6 +173,6 @@ Apache 2.0 — for OICIO code (following Bonsai and Needle2). Model weights foll
|
|
| 219 |
|
| 220 |
---
|
| 221 |
|
| 222 |
-
**Built in limited environment 1.9GB RAM + 14GB swap, consumer hardware only, no data center, no H100, no excuses, training from scratch HERE, Rust CPU-only, MatMul-free
|
| 223 |
|
| 224 |
**OICIO = Outside-In Contextual Intelligence Orchestration, MatMul-Free CPU-Only, Intelligence Density > Parameter Count.**
|
|
|
|
| 149 |
|
| 150 |
- **Tier 3 OICIO-Frontier (100% from scratch, high-end consumer):** Train 1.7B 0.4GB or 8B 1.75GB from scratch with 400B-1T tokens on Mac Studio M2 Ultra 192GB ~20-30 days. True ownership, no attribution.
|
| 151 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 152 |
## References
|
| 153 |
|
| 154 |
- EM-LLM: Human-inspired Episodic Memory for Infinite Context LLMs (ICLR 2025) — https://github.com/em-llm/EM-LLM-model
|
|
|
|
| 173 |
|
| 174 |
---
|
| 175 |
|
| 176 |
+
**Built in limited environment 1.9GB RAM + 14GB swap, consumer hardware only, no data center, no H100, no excuses, training from scratch HERE, Rust CPU-only, MatMul-free.**
|
| 177 |
|
| 178 |
**OICIO = Outside-In Contextual Intelligence Orchestration, MatMul-Free CPU-Only, Intelligence Density > Parameter Count.**
|