Article
1
🔄 In a Training Loop
Andrey
Bochkov
AI & ML interests
None yet
Recent Activity
updated a collection about 2 months ago
Language Models Without a Trainable Input Embedding Table updated a collection about 2 months ago
Language Models Without a Trainable Input Embedding Table updated a collection about 2 months ago
Language Models Without a Trainable Input Embedding TableOrganizations
None yet
Paper: 2507.04886 (TMLR, Oct 2025). 'Emergent Semantics Beyond Token Embeddings: Transformer LMs with Frozen Visual Unicode Representations'
-
Bochkov/emergent-semantics-model-uni-glyph-335m
Text Generation • 0.3B • Updated • 4 -
Bochkov/emergent-semantics-model-unfrozen-335m
Text Generation • 0.3B • Updated • 4 -
Bochkov/emergent-semantics-model-16-bit-269m
Text Generation • 0.3B • Updated • 7 • 1 -
Bochkov/emergent-semantics-model-64-bit-272m
Text Generation • 0.3B • Updated • 6
This collection is provided for reproducibility of the paper's main claim
Paper: 2507.04886 (TMLR, Oct 2025). 'Emergent Semantics Beyond Token Embeddings: Transformer LMs with Frozen Visual Unicode Representations'
-
Bochkov/emergent-semantics-model-uni-glyph-335m
Text Generation • 0.3B • Updated • 4 -
Bochkov/emergent-semantics-model-unfrozen-335m
Text Generation • 0.3B • Updated • 4 -
Bochkov/emergent-semantics-model-16-bit-269m
Text Generation • 0.3B • Updated • 7 • 1 -
Bochkov/emergent-semantics-model-64-bit-272m
Text Generation • 0.3B • Updated • 6
models 19
Bochkov/llm-fix-min-affine-recoded-minimal-code-table-free
Text Generation • 0.5B • Updated • 3
Bochkov/llm-fix-min-fixed-minimal-binary-code
Text Generation • 0.5B • Updated • 2
Bochkov/llm-fix-min-baseline-learned-input-table-model-classic
Text Generation • 0.5B • Updated • 3
Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m
Text Generation • 0.2B • Updated • 3
Bochkov/growing-transformers-model-unfrozen-baseline-monolyth-247m
Text Generation • 0.2B • Updated • 5
Bochkov/growing-transformers-model-unfrozen-1-9-247m
Text Generation • 0.2B • Updated • 4
Bochkov/growing-transformers-model-16-bit-1-9-181m
Text Generation • 0.2B • Updated • 6
Bochkov/growing-transformers-model-frozen-unicode-baseline-monolyth-247m
Text Generation • 0.2B • Updated • 3
Bochkov/emergent-semantics-model-uni-glyph-335m
Text Generation • 0.3B • Updated • 4
Bochkov/emergent-semantics-model-unfrozen-335m
Text Generation • 0.3B • Updated • 4
datasets 0
None public yet