Article
1
Andrey
Bochkov
AI & ML interests
None yet
Recent Activity
updated a collection 2 days ago
Language Models Without a Trainable Input Embedding Table updated a collection 2 days ago
Language Models Without a Trainable Input Embedding Table updated a collection 2 days ago
Language Models Without a Trainable Input Embedding TableOrganizations
None yet
Paper: 2507.04886 (TMLR, Oct 2025). 'Emergent Semantics Beyond Token Embeddings: Transformer LMs with Frozen Visual Unicode Representations'
-
Bochkov/emergent-semantics-model-uni-glyph-335m
Text Generation • Updated • 8 -
Bochkov/emergent-semantics-model-unfrozen-335m
Text Generation • Updated • 6 -
Bochkov/emergent-semantics-model-16-bit-269m
Text Generation • Updated • 10 • 1 -
Bochkov/emergent-semantics-model-64-bit-272m
Text Generation • Updated • 4
This collection is provided for reproducibility of the paper's main claim
Paper: 2507.04886 (TMLR, Oct 2025). 'Emergent Semantics Beyond Token Embeddings: Transformer LMs with Frozen Visual Unicode Representations'
-
Bochkov/emergent-semantics-model-uni-glyph-335m
Text Generation • Updated • 8 -
Bochkov/emergent-semantics-model-unfrozen-335m
Text Generation • Updated • 6 -
Bochkov/emergent-semantics-model-16-bit-269m
Text Generation • Updated • 10 • 1 -
Bochkov/emergent-semantics-model-64-bit-272m
Text Generation • Updated • 4
models 19
Bochkov/llm-fix-min-affine-recoded-minimal-code-table-free
Text Generation • 0.5B • Updated • 26
Bochkov/llm-fix-min-fixed-minimal-binary-code
Text Generation • 0.5B • Updated • 32
Bochkov/llm-fix-min-baseline-learned-input-table-model-classic
Text Generation • 0.5B • Updated • 34
Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m
Text Generation • Updated • 33
Bochkov/growing-transformers-model-unfrozen-baseline-monolyth-247m
Text Generation • Updated • 5
Bochkov/growing-transformers-model-unfrozen-1-9-247m
Text Generation • Updated • 3
Bochkov/growing-transformers-model-16-bit-1-9-181m
Text Generation • Updated • 4
Bochkov/growing-transformers-model-frozen-unicode-baseline-monolyth-247m
Text Generation • Updated • 1
Bochkov/emergent-semantics-model-uni-glyph-335m
Text Generation • Updated • 8
Bochkov/emergent-semantics-model-unfrozen-335m
Text Generation • Updated • 6
datasets 0
None public yet