Hugging Face's logo
Bochkov 's Collections
Beyond the Parameter Monolith: Modular Language Modeling
Do Language Models Need a Trainable Input Embedding Table?
Language Models Without a Trainable Input Embedding Table
Emergent Semantics Beyond Token Embeddings
Growing Transformers:Layer-wise Expansion Comparative Study
Tokenizers

Beyond the Parameter Monolith: Modular Language Modeling

This collection is provided for reproducibility of the paper's main claim