Hugging Face's logo

LULab
/
myTokenizers

Model card Files
xet
 Community
ThuraAung1601 commited on
Commit
7d425c1
·
verified ·
1 Parent(s): 11d97cc

Upload 5 files

Browse files
Files changed (6) hide show
  1. .gitattributes +1 -0
  2. Models/bpe_sentencepiece_model.model +3 -0
  3. Models/bpe_sentencepiece_model.vocab +0 -0
  4. Models/unigram_sentencepiece_model.model +3 -0
  5. Models/unigram_sentencepiece_model.vocab +0 -0
  6. Models/wordseg_c2_crf.crfsuite +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Models/wordseg_c2_crf.crfsuite filter=lfs diff=lfs merge=lfs -text
Models/bpe_sentencepiece_model.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b953364f42c667ad28f3bb8cd8f9f803e6f05aca867da7c9df0ac0c9f06fbbf3
3
+ size 485378
Models/bpe_sentencepiece_model.vocab ADDED
The diff for this file is too large to render. See raw diff
 
Models/unigram_sentencepiece_model.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e11ba76adc07aac981fc470f238fc7b328aee2977ba75876a72ec29479f84fe
3
+ size 490723
Models/unigram_sentencepiece_model.vocab ADDED
The diff for this file is too large to render. See raw diff
 
Models/wordseg_c2_crf.crfsuite ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b708c7ace313c27e69e20cf3da544fffbc476930324a946ca5cb32acaa710ba9
3
+ size 3363844