mdeberta-id-30k / README.md
muchad's picture
Add Model Card
4e37f3f verified
metadata
language:
  - id
tags:
  - mdeberta
  - pruning
  - nlp
license: mit

mdeberta-id-30k

This model is a vocabulary-pruned version of microsoft/mdeberta-v3-base, specifically optimized for the Indonesian language.

Vocabulary: 30k tokens (Indonesian)

Note: This model is part of an ongoing research project on efficient Transformer deployment. Full paper and benchmarks will be linked upon publication.