rg1683 commited on
Commit
2318921
·
verified ·
1 Parent(s): 99ed16c

Upload tokenizer

Browse files
Files changed (3) hide show
  1. merges.txt +0 -29
  2. tokenizer.json +0 -0
  3. vocab.json +0 -0
merges.txt CHANGED
@@ -49742,32 +49742,3 @@ z ation
49742
  नत ह
49743
  à¤ī à¤®à¤¦à¤ľ
49744
  Ġà¤Ĩव शà¤ķ
49745
- Ġà¤ľà¤® प
49746
- Ġà¤¬à¤ľ à¤Ĺ
49747
- Ġà¤¬à¤ľ à¤Łà¤ķ
49748
- Ġà¤Ī à¤ıसड
49749
- Ġसमà¤Ŀ प
49750
- Ġलड र
49751
- लà¤ķ ब
49752
- Ġबल à¤ķरन
49753
- Ġà¤ħà¤ķ à¤ļ
49754
- Ġ0 207
49755
- Ġà¤Ĺर à¤Ĺर
49756
- बल à¤Ī
49757
- à¤Łà¤² ल
49758
- à¤Ĩà¤Ī à¤Ĩà¤Īà¤ıम
49759
- यद à¤Ĺ
49760
- Ġढ à¤Ĺल
49761
- मर à¤ijनल
49762
- धर र
49763
- Ġ11 341
49764
- षà¤ķ श
49765
- Ġनà¤Ĺर य
49766
- Ġà¤ħà¤Ĺ सत
49767
- Ġà¤ħà¤Ĺ णन
49768
- दद म
49769
- Ġà¤ıम à¤Ĩरय
49770
- Ġनà¤Ī व
49771
- Ġमहत त
49772
- Ġमहत à¤Ĺ
49773
- Ġनà¤ı प
 
49742
  नत ह
49743
  à¤ī à¤®à¤¦à¤ľ
49744
  Ġà¤Ĩव शà¤ķ
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
tokenizer.json CHANGED
The diff for this file is too large to render. See raw diff
 
vocab.json CHANGED
The diff for this file is too large to render. See raw diff