AGofficial commited on
Commit
45e7712
·
verified ·
1 Parent(s): 53d5954

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md CHANGED
@@ -1,3 +1,8 @@
 
 
 
 
 
1
  # Atto: Extreme Intelligence Density Research
2
 
3
  Atto is an exploration into the fundamental limits of **Intelligence Density** — how much knowledge and generative capability can be packed into a neural network with a strictly limited parameter budget.
@@ -47,5 +52,22 @@ The models are exported as dependency-free JSON files in the `models/` directory
47
  ### Sample generations:
48
  ```
49
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
 
51
  ```
 
1
+ ---
2
+ license: cc0-1.0
3
+ language:
4
+ - en
5
+ ---
6
  # Atto: Extreme Intelligence Density Research
7
 
8
  Atto is an exploration into the fundamental limits of **Intelligence Density** — how much knowledge and generative capability can be packed into a neural network with a strictly limited parameter budget.
 
52
  ### Sample generations:
53
  ```
54
 
55
+ ============================================================
56
+ atto-8192 | 8192 params | embd=16 ctx=28 vocab=64
57
+ ============================================================
58
+ prompt="the":
59
+ Math Laer axfourith tipht's gord me hour hace (remaat ond,
60
+ I'll wore ser ar now pre's for word to styous the mall, stpoul folthis yow apt and be a
61
+
62
+ prompt="to be":
63
+ CPon. How gue. O- whut feathent. Thou the in ap bast. gos A thing of be rith nosset?
64
+ [Tiths that hintend kyele in younk hore;
65
+ Gat sgees wis
66
+
67
+ prompt="Ham":
68
+ . HaCleata,
69
+ Wlotsef yow preerant fore thipe matte of iche in you?
70
+ And spour, the tang offe herees welr then[foritr her veut arve id for houn w
71
+
72
 
73
  ```