romance-sentencepiece / oscar

70.6 MB

1 contributor

History: 1 commit

versae

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish

20ab046 almost 3 years ago

es-fr-it-pt-ro_16000_bpe.sp.model
457 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es-fr-it-pt-ro_16000_bpe.sp.vocab
192 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es-fr-it-pt-ro_16000_unigram.sp.model
465 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es-fr-it-pt-ro_16000_unigram.sp.vocab
242 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es-fr-it-pt-ro_32000_bpe.sp.model
732 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es-fr-it-pt-ro_32000_bpe.sp.vocab
451 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es-fr-it-pt-ro_32000_unigram.sp.model
756 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es-fr-it-pt-ro_32000_unigram.sp.vocab
547 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es-fr-it-pt-ro_64000_bpe.sp.model
1.31 MB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es-fr-it-pt-ro_64000_bpe.sp.vocab
997 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es-fr-it-pt-ro_64000_unigram.sp.model
1.36 MB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es-fr-it-pt-ro_64000_unigram.sp.vocab
1.17 MB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_16000_bpe.100extra.sp.model
470 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_16000_bpe.100extra.sp.vocab
202 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_16000_bpe.sp.model
467 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_16000_bpe.sp.vocab
202 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_16000_unigram.100extra.sp.model
478 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_16000_unigram.100extra.sp.vocab
253 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_16000_unigram.sp.model
476 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_16000_unigram.sp.vocab
253 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_32000_bpe.100extra.sp.model
753 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_32000_bpe.100extra.sp.vocab
470 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_32000_bpe.sp.model
751 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_32000_bpe.sp.vocab
470 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_32000_unigram.100extra.sp.model
774 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_32000_unigram.100extra.sp.vocab
562 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_32000_unigram.sp.model
772 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_32000_unigram.sp.vocab
562 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_64000_bpe.100extra.sp.model
1.33 MB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_64000_bpe.100extra.sp.vocab
1.02 MB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_64000_bpe.sp.model
1.33 MB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_64000_bpe.sp.vocab
1.02 MB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_64000_unigram.100extra.sp.model
1.37 MB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_64000_unigram.100extra.sp.vocab
1.19 MB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_64000_unigram.sp.model
1.37 MB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
es_64000_unigram.sp.vocab
1.19 MB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_16000_bpe.100extra.sp.model
464 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_16000_bpe.100extra.sp.vocab
196 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_16000_bpe.sp.model
461 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_16000_bpe.sp.vocab
196 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_16000_unigram.100extra.sp.model
470 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_16000_unigram.100extra.sp.vocab
244 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_16000_unigram.sp.model
468 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_16000_unigram.sp.vocab
244 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_32000_bpe.100extra.sp.model
743 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_32000_bpe.100extra.sp.vocab
460 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_32000_bpe.sp.model
740 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_32000_bpe.sp.vocab
460 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_32000_unigram.100extra.sp.model
759 kB
xet

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago
fr_32000_unigram.100extra.sp.vocab
547 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish almost 3 years ago