acasavaraju commited on
Commit
c4b8e21
·
verified ·
1 Parent(s): a9cdf33

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -10
README.md CHANGED
@@ -1,10 +1,23 @@
1
- ---
2
- title: README
3
- emoji: 🌖
4
- colorFrom: green
5
- colorTo: green
6
- sdk: static
7
- pinned: false
8
- ---
9
-
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # AIOS — CPU-Native LLM Inference Architecture
2
+
3
+ A memory residency controller and Model Contract for deploying
4
+ large language models efficiently on CPU hardware.
5
+
6
+ ## What We're Building
7
+ AIOS addresses the memory bandwidth bottleneck in CPU inference
8
+ through weight aliasing, sparsity maps, KV cache tiering, and
9
+ activation chunking — targeting 7B+ models on hardware
10
+ organizations already own.
11
+
12
+ ## Current State
13
+ Framework and specification published. Runtime implementation
14
+ is the primary contribution opportunity.
15
+
16
+ ## Links
17
+ - Paper: https://ssrn.com/abstract=6467298
18
+ - GitHub: https://github.com/acasavaraju/AIOS
19
+ - Primary validation target: GitHub Issue #2
20
+
21
+ ## How to Contribute
22
+ Clone the repo, run validation/compliance.py on any GGUF model,
23
+ post results to the relevant GitHub issue.