luisfrentzen/wordpiece_5_49152
Updated
•
8
SOAR TIMTC Tokenizers
Models uploaded from https://github.com/kensho-technologies/timtc_vocabs_models
-
-
luisfrentzen/wordpiece_5_40960
Updated • 4 -
luisfrentzen/pathpiecer_none_18_32768
Updated • 3 -
luisfrentzen/wordpiece_5_32768
Updated • 7 -
luisfrentzen/unigram_pathpiecel_17_49152
Updated • 6 -
luisfrentzen/unigram_pathpiecel_17_40960
Updated • 5 -
luisfrentzen/unigram_pathpiecel_17_32768
Updated • 4 -
luisfrentzen/unigram_likelihood_2_49152
Updated • 7 -
luisfrentzen/unigram_likelihood_2_40960
Updated • 7 -
luisfrentzen/unigram_likelihood_2_32768
Updated • 2 -
luisfrentzen/unigram_greedy_7_49152
0.4B • Updated • 4 -
luisfrentzen/unigram_greedy_7_40960
0.3B • Updated • 5 -
luisfrentzen/unigram_greedy_7_32768
0.3B • Updated • 2 -
luisfrentzen/sage_initunigram_firstspace_10_49152
Updated • 1 -
luisfrentzen/sage_initunigram_firstspace_10_40960
Updated • 3 -
luisfrentzen/sage_initunigram_firstspace_10_32768
Updated • 7 -
luisfrentzen/sage_initngram_firstspace_8_49152
Updated • 2 -
luisfrentzen/sage_initngram_firstspace_8_40960
Updated • 6 -
luisfrentzen/sage_initngram_firstspace_8_32768
0.3B • Updated • 3 -
luisfrentzen/sage_initngram_firstspacedigit_11_49152
Updated • 8 -
luisfrentzen/sage_initngram_firstspacedigit_11_40960
Updated • 2 -
luisfrentzen/sage_initngram_firstspacedigit_11_32768
Updated • 4 -
luisfrentzen/sage_initbpe_firstspace_6_49152
Updated • 7 -
luisfrentzen/sage_initbpe_firstspace_6_40960
Updated • 7 -
luisfrentzen/sage_initbpe_firstspace_6_32768
Updated • 3 -
luisfrentzen/pathpiecer_spacedigit_12_49152
Updated • 3 -
luisfrentzen/pathpiecer_spacedigit_12_40960
0.3B • Updated • 4 -
luisfrentzen/pathpiecer_spacedigit_12_32768
Updated • 6 -
luisfrentzen/pathpiecer_none_18_49152
Updated • 6 -
luisfrentzen/pathpiecer_none_18_40960
Updated • 4 -
luisfrentzen/pathpiecer_firstspacedigit_14_49152
Updated • 4 -
luisfrentzen/pathpiecer_firstspacedigit_14_40960
Updated • 4 -
luisfrentzen/pathpiecer_firstspacedigit_14_32768
Updated • 4 -
luisfrentzen/pathpiecel_initunigram_firstspace_9_49152
Updated • 3 -
luisfrentzen/pathpiecel_initunigram_firstspace_9_40960
Updated • 5 -
luisfrentzen/pathpiecel_initunigram_firstspace_9_32768
Updated • 4 -
luisfrentzen/pathpiecel_initngram_firstspacedigit_15_49152
Updated • 4 -
luisfrentzen/pathpiecel_initngram_firstspacedigit_15_40960
Updated • 3 -
luisfrentzen/pathpiecel_initngram_firstspacedigit_15_32768
0.3B • Updated • 4 -
luisfrentzen/pathpiecel_initngram_firstspace_16_49152
Updated • 3 -
luisfrentzen/pathpiecel_initngram_firstspace_16_40960
Updated • 3 -
luisfrentzen/pathpiecel_initngram_firstspace_16_32768
Updated • 3 -
luisfrentzen/pathpiecel_initbpe_firstspace_1_49152
Updated • 2 -
luisfrentzen/pathpiecel_initbpe_firstspace_1_40960
Updated • 5 -
luisfrentzen/pathpiecel_initbpe_firstspace_1_32768
Updated • 2 -
luisfrentzen/bpe_pathpiecel_13_49152
Updated • 4 -
luisfrentzen/bpe_pathpiecel_13_40960
Updated • 4 -
luisfrentzen/bpe_pathpiecel_13_32768
Updated • 4 -
luisfrentzen/bpe_merge_3_49152
Updated • 4 -
luisfrentzen/bpe_merge_3_40960
Updated • 5 -
luisfrentzen/bpe_merge_3_32768
Updated • 4 -
luisfrentzen/bpe_greedy_4_49152
0.4B • Updated • 3 -
luisfrentzen/bpe_greedy_4_40960
0.3B • Updated • 3 -
luisfrentzen/bpe_greedy_4_32768
0.3B • Updated • 5