---
language:
- id
tags:
- mdeberta
- pruning
- nlp
license: mit
---

# mdeberta-id-30k

This model is a **vocabulary-pruned** version of [microsoft/mdeberta-v3-base](https://huggingface.co/microsoft/mdeberta-v3-base), specifically optimized for the **Indonesian language**.

**Vocabulary:** 30k tokens (Indonesian)

_Note: This model is part of an ongoing research project on efficient Transformer deployment. Full paper and benchmarks will be linked upon publication._