16.4 MB

Ctrl+K

1 contributor

bytelex v1: FULL lexicon translation matrix (1.25M tokens across 12 vocabularies) + byte_lexicon_v1 corpus tables (8.2MB mixed corpus, char1-4 exact, hashed 9-gram, word-grams)

3d25c99 verified 3 days ago

char1.jsonl

2.15 kB
bytelex v1: FULL lexicon translation matrix (1.25M tokens across 12 vocabularies) + byte_lexicon_v1 corpus tables (8.2MB mixed corpus, char1-4 exact, hashed 9-gram, word-grams) 3 days ago
char2.jsonl

56.7 kB
bytelex v1: FULL lexicon translation matrix (1.25M tokens across 12 vocabularies) + byte_lexicon_v1 corpus tables (8.2MB mixed corpus, char1-4 exact, hashed 9-gram, word-grams) 3 days ago
char3.jsonl

426 kB
bytelex v1: FULL lexicon translation matrix (1.25M tokens across 12 vocabularies) + byte_lexicon_v1 corpus tables (8.2MB mixed corpus, char1-4 exact, hashed 9-gram, word-grams) 3 days ago
char4.jsonl

1.57 MB
bytelex v1: FULL lexicon translation matrix (1.25M tokens across 12 vocabularies) + byte_lexicon_v1 corpus tables (8.2MB mixed corpus, char1-4 exact, hashed 9-gram, word-grams) 3 days ago
hash9.jsonl

13.7 MB
xet

bytelex v1: FULL lexicon translation matrix (1.25M tokens across 12 vocabularies) + byte_lexicon_v1 corpus tables (8.2MB mixed corpus, char1-4 exact, hashed 9-gram, word-grams) 3 days ago
meta.json

168 Bytes
bytelex v1: FULL lexicon translation matrix (1.25M tokens across 12 vocabularies) + byte_lexicon_v1 corpus tables (8.2MB mixed corpus, char1-4 exact, hashed 9-gram, word-grams) 3 days ago
words.jsonl

657 kB
bytelex v1: FULL lexicon translation matrix (1.25M tokens across 12 vocabularies) + byte_lexicon_v1 corpus tables (8.2MB mixed corpus, char1-4 exact, hashed 9-gram, word-grams) 3 days ago