| language: | |
| - id | |
| tags: | |
| - mdeberta | |
| - pruning | |
| - nlp | |
| license: mit | |
| # mdeberta-id-20k | |
| This model is a **vocabulary-pruned** version of [microsoft/mdeberta-v3-base](https://huggingface.co/microsoft/mdeberta-v3-base), specifically optimized for the **Indonesian language**. | |
| **Vocabulary:** 20k tokens (Indonesian) | |
| _Note: This model is part of an ongoing research project on efficient Transformer deployment. Full paper and benchmarks will be linked upon publication._ | |