Update README.md
Browse files
README.md
CHANGED
|
@@ -59,7 +59,7 @@ This is a from-scratch interpretation, not a reproduction of any official code.
|
|
| 59 |
|
| 60 |
| | Meridian-Tiny |
|
| 61 |
|---|---|
|
| 62 |
-
| Parameters (total) | ≈11.8M
|
| 63 |
| Token embedding + LM head (untied) | 8.4M |
|
| 64 |
| Engram table | 2.1M |
|
| 65 |
| Everything else | ≈1.3M (≈1.0M active per token) |
|
|
|
|
| 59 |
|
| 60 |
| | Meridian-Tiny |
|
| 61 |
|---|---|
|
| 62 |
+
| Parameters (total) | ≈11.8M |
|
| 63 |
| Token embedding + LM head (untied) | 8.4M |
|
| 64 |
| Engram table | 2.1M |
|
| 65 |
| Everything else | ≈1.3M (≈1.0M active per token) |
|