Hugging Face's logo

devngho
/
phi3-jamo-ko-large-tokenizer

Transformers
Model card Files
xet
Community
devngho commited on
Commit
ec360a4
·
verified ·
1 Parent(s): 3a07b4f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -5,4 +5,4 @@ tags: []
5
 
6
  expanded 49556 tokens
7
 
8
- Following [The Optimal Vocabulary Size Predictor](https://huggingface.co/spaces/sail/scaling-with-vocab-demo) (for [Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies](https://huggingface.co/papers/2407.13623)), I recommend using this tokenizer with 13B model.
 
5
 
6
  expanded 49556 tokens
7
 
8
+ Following [The Optimal Vocabulary Size Predictor](https://huggingface.co/spaces/sail/scaling-with-vocab-demo), I recommend using this tokenizer with 13B model.