metadata
language:
- id
tags:
- mdeberta
- pruning
- nlp
license: mit
mdeberta-id-20k
This model is a vocabulary-pruned version of microsoft/mdeberta-v3-base, specifically optimized for the Indonesian language.
Vocabulary: 20k tokens (Indonesian)
Note: This model is part of an ongoing research project on efficient Transformer deployment. Full paper and benchmarks will be linked upon publication.