Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# Atto: Extreme Intelligence Density Research
|
| 2 |
|
| 3 |
Atto is an exploration into the fundamental limits of **Intelligence Density** — how much knowledge and generative capability can be packed into a neural network with a strictly limited parameter budget.
|
|
@@ -47,5 +52,22 @@ The models are exported as dependency-free JSON files in the `models/` directory
|
|
| 47 |
### Sample generations:
|
| 48 |
```
|
| 49 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
|
| 51 |
```
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: cc0-1.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
---
|
| 6 |
# Atto: Extreme Intelligence Density Research
|
| 7 |
|
| 8 |
Atto is an exploration into the fundamental limits of **Intelligence Density** — how much knowledge and generative capability can be packed into a neural network with a strictly limited parameter budget.
|
|
|
|
| 52 |
### Sample generations:
|
| 53 |
```
|
| 54 |
|
| 55 |
+
============================================================
|
| 56 |
+
atto-8192 | 8192 params | embd=16 ctx=28 vocab=64
|
| 57 |
+
============================================================
|
| 58 |
+
prompt="the":
|
| 59 |
+
Math Laer axfourith tipht's gord me hour hace (remaat ond,
|
| 60 |
+
I'll wore ser ar now pre's for word to styous the mall, stpoul folthis yow apt and be a
|
| 61 |
+
|
| 62 |
+
prompt="to be":
|
| 63 |
+
CPon. How gue. O- whut feathent. Thou the in ap bast. gos A thing of be rith nosset?
|
| 64 |
+
[Tiths that hintend kyele in younk hore;
|
| 65 |
+
Gat sgees wis
|
| 66 |
+
|
| 67 |
+
prompt="Ham":
|
| 68 |
+
. HaCleata,
|
| 69 |
+
Wlotsef yow preerant fore thipe matte of iche in you?
|
| 70 |
+
And spour, the tang offe herees welr then[foritr her veut arve id for houn w
|
| 71 |
+
|
| 72 |
|
| 73 |
```
|