Update README.md
Browse files
README.md
CHANGED
|
@@ -24,6 +24,8 @@ This repository provides **Model_16_BIT (269M)** — an **ablation model** from
|
|
| 24 |
|
| 25 |
[📚 Paper (Growing Transformers: Modular Composition and Layer-wise Expansion on a Frozen Substrate)](https://huggingface.co/papers/2507.07129) -
|
| 26 |
|
|
|
|
|
|
|
| 27 |
The purpose of this checkpoint is to isolate *whether trainable/semantic input embeddings are necessary at all*.
|
| 28 |
|
| 29 |
Unlike **Model_UNI_GLYPH**, this model uses a **frozen 16-dimensional binary embedding** that contains **no glyph / visual information** — it effectively encodes only the **token identity**.
|
|
|
|
| 24 |
|
| 25 |
[📚 Paper (Growing Transformers: Modular Composition and Layer-wise Expansion on a Frozen Substrate)](https://huggingface.co/papers/2507.07129) -
|
| 26 |
|
| 27 |
+
[📚 Blog Article](https://huggingface.co/blog/Bochkov/emergent-semantics-beyond-token-embeddings)
|
| 28 |
+
|
| 29 |
The purpose of this checkpoint is to isolate *whether trainable/semantic input embeddings are necessary at all*.
|
| 30 |
|
| 31 |
Unlike **Model_UNI_GLYPH**, this model uses a **frozen 16-dimensional binary embedding** that contains **no glyph / visual information** — it effectively encodes only the **token identity**.
|