File size: 471 Bytes
2f69f99
a8d5b68
 
 
 
 
 
 
2f69f99
 
a8d5b68
2f69f99
a8d5b68
2f69f99
4e9db8f
2f69f99
a8d5b68
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
---
language:
- id
tags:
- mdeberta
- pruning
- nlp
license: mit
---

# mdeberta-id-20k

This model is a **vocabulary-pruned** version of [microsoft/mdeberta-v3-base](https://huggingface.co/microsoft/mdeberta-v3-base), specifically optimized for the **Indonesian language**.

**Vocabulary:** 20k tokens (Indonesian)

_Note: This model is part of an ongoing research project on efficient Transformer deployment. Full paper and benchmarks will be linked upon publication._