STD-BPE-LLAMA3.2 / README.md
MikkelWK's picture
Create README.md
dbc02c5 verified
---
library_name: transformers
tags: [Danish, BPE Tokenization, LLaMA]
---
### STD-BPE-LLAMA3.2
A standard LLaMA-3.2 model trained with a pretrained Byte-Pair-Encoding (BPE) tokenizer. It provides a benchmark for evaluating the performance of more advanced tokenization approaches.