goautomate-ai commited on
Commit
cb2bd73
·
verified ·
1 Parent(s): c749d01

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +93 -7
README.md CHANGED
@@ -1,10 +1,96 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
- title: README
3
- emoji: 🐠
4
- colorFrom: red
5
- colorTo: yellow
6
- sdk: static
7
- pinned: false
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
1
+ <div align="center">
2
+
3
+ # GoAutomate AI Institute
4
+ ### Canadian Sovereign AI, built for public benefit 🍁
5
+
6
+ **Accessible · Responsible · Canadian‑governed**
7
+
8
+ [Website](https://goautomate.ai) · [Collaborate](mailto:info@goautomate.ai)
9
+
10
+ </div>
11
+
12
+ ---
13
+
14
+ The **GoAutomate AI Institute** is a not‑for‑profit advancing **Canadian sovereign artificial intelligence** — AI models, tools, and research designed for Canadian organizations and aligned with Canadian values, ethics, and governance.
15
+
16
+ We don't believe Canada has to win only the race toward ever‑larger frontier models. **Purpose‑built, efficient, Canadian‑governed models** can deliver real outcomes in real environments — hospitals, health authorities, public institutions, businesses, researchers, and not‑for‑profits — while keeping people in control and accountable.
17
+
18
+ This organization is where we publish our open‑weight models, inference research, and technical reports.
19
+
20
+ ---
21
+
22
+ ## 🔬 Our research bet: **ternary**
23
+
24
+ Modern AI isn't limited by intelligence — it's limited by **the cost of storing and moving it**. Most of the cost of running a language model is the memory bandwidth spent streaming billions of weights for every token, and the arithmetic of multiplying them.
25
+
26
+ **Ternary** representation constrains every weight to one of three values — **{ −1, 0, +1 }** — and attacks both costs at once:
27
+
28
+ - **≈8–10× smaller.** Each weight carries ≈1.58 bits of information (log₂3) instead of 16 — roughly an order of magnitude below half precision, and about half the size of 4‑bit quantization.
29
+ - **Multiply‑free inference.** A weight in { −1, 0, +1 } turns the expensive multiply into *add*, *subtract*, or *skip*. Roughly a third of the work disappears as structured sparsity.
30
+ - **Capability preserved.** We reach ternary through **distillation** — training a ternary student to reproduce a high‑precision teacher — so the constraint is *learned*, not crudely imposed after the fact. The guiding principle: **subtract cost, not intelligence.**
31
+
32
+ The payoff spans hardware generations: ternary's footprint lets capable models **fit on memory‑constrained edge devices** and **revive legacy datacenter GPUs** that modern models had outgrown — extending the useful life of existing silicon — while on modern accelerators the same savings mean **far more concurrent users per device**. It's an environmental story as much as a performance one: less energy per token, fewer accelerators per unit of served intelligence, and a slower path to e‑waste.
33
+
34
+ ---
35
+
36
+ ## 📦 What you'll find in this organization
37
+
38
+ **Ternary‑distilled Gemma‑4‑E2B** — our first release, and the first in a planned series.
39
+
40
+ A ternary (≈1.6‑bit) distillation of **Gemma‑4‑E2B**, a capability‑dense model with a **transparent, Western open‑weight lineage**. Distributed as **GGUF** for efficient local and datacenter serving.
41
+
42
+ > ⚠️ **Pre‑release checkpoint.** The published weights are an early checkpoint (~1B training tokens), shared to demonstrate the method and invite community evaluation. **Production weights (~15B tokens) with full capability benchmarks will follow and replace them.** We defer quantitative capability claims to that release rather than over‑state a pre‑release checkpoint.
43
+
44
+ Browse the model repositories in this organization for files, quantizations, and usage.
45
+
46
  ---
47
+
48
+ ## 🎯 Why Gemma‑4 as the base
49
+
50
+ - **Exceptional intelligence‑per‑FLOP.** An already capability‑dense family; ternary distillation compounds that efficiency.
51
+ - **Elastic architecture.** The E2B ("effective‑2B") design fits edge and multi‑tier deployment — and ternary lowers the floor of that range further.
52
+ - **Provenance you can defend.** For regulated and sovereignty‑sensitive sectors — healthcare, public sector, critical infrastructure — the *provenance* of a model's knowledge is a governance requirement, not a preference. A transparent, auditable, Western open‑weight base gives the resulting ternary model a clear, documentable lineage. **Efficiency should not come at the cost of provenance.**
53
+
54
+ ---
55
+
56
+ ## ⚙️ An engine built to spend ternary's footprint on throughput
57
+
58
+ Ternary's memory savings are only as valuable as a serving stack's ability to convert them into useful work. We maintain an inference engine (a fork of the open‑source llama.cpp lineage) tuned so footprint becomes **concurrency and throughput**:
59
+
60
+ - **Footprint → concurrent contexts** — small weights leave far more device memory for KV cache, so one accelerator serves many more simultaneous sessions.
61
+ - **Hardware‑best matmul dispatch** — the engine picks the path that fits the device by batch size, so capability‑dense models serve efficiently even on GPUs that lack dedicated matrix‑multiply units.
62
+ - **Device‑side sampling** and **shared‑prefix / cross‑session cache reuse** — agentic workloads pay for a large shared system prompt once, not once per user.
63
+
64
+ We validate this across **deliberately different accelerator families** — legacy datacenter GPUs and earlier‑generation tensor‑core GPUs — to prove the ternary‑plus‑engine approach spans hardware generations. Every serving optimization is held to a **token‑identical correctness gate** before it ships: throughput work never silently degrades output.
65
+
66
+ ---
67
+
68
+ ## 📄 Research
69
+
70
+ - **TR‑2026‑001 — *Ternary Foundations for Efficient, Sovereign AI*** — the mathematics of ternary, why Gemma‑4, the engine that turns footprint into throughput, and the implications for legacy and modern hardware.
71
+ - **TR‑2026‑002 — *Quantization‑Aware Training and Ternary Weights: Method vs. Representation*** — clears the "QAT vs ternary" category error and places both on one efficiency curve.
72
+
73
+ Further reports — on serving engines across accelerator families, multi‑GPU parallelism for heterogeneous fleets, shared‑context concurrency, ternary at larger scales, and governable agentic orchestration — are on the Institute's roadmap.
74
+
75
+ ---
76
+
77
+ ## 🤝 What we stand for
78
+
79
+ - **Sovereignty** — reduce dependency on foreign‑controlled AI models and infrastructure; support Canadian laws, governance, and interests.
80
+ - **Responsibility** — steerable, explainable, accountable, secure systems that keep humans at the helm.
81
+ - **Accessibility** — capable models, tools, and documentation available to organizations across Canada.
82
+ - **Efficiency** — capability that scales **down** in cost as readily as it scales up in ability.
83
+
84
+ ---
85
+
86
+ ## 📬 Get involved
87
+
88
+ The GoAutomate AI Institute welcomes collaboration with Canadian organizations, healthcare systems, public institutions, researchers, policymakers, and technology leaders who share our commitment to responsible and accessible AI.
89
+
90
+ **→ [info@goautomate.ai](mailto:info@goautomate.ai) · [goautomate.ai](https://www.goautomate.ai)**
91
+
92
  ---
93
 
94
+ <div align="center">
95
+ <sub>© 2026 GoAutomate AI Institute · Canadian Sovereign AI · Responsible Adoption · Public Benefit</sub>
96
+ </div>