Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

wikilangs
/
lfn

Text Generation
fastText
Lingua Franca Nova
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
feature-extraction
sentence-similarity
tokenization
n-grams
markov-chain
text-mining
babelvec
vocabulous
vocabulary
monolingual
family-constructed_auxlang
Model card Files Files and versions
xet
Community
lfn / models /tokenizer
4.86 MB
  • 1 contributor
History: 1 commit
omarkamali's picture
omarkamali
Upload all models and assets for lfn (latest)
4d2e9eb verified 3 days ago
  • lfn_tokenizer_16k.model
    508 kB
    xet
    Upload all models and assets for lfn (latest) 3 days ago
  • lfn_tokenizer_16k.vocab
    234 kB
    Upload all models and assets for lfn (latest) 3 days ago
  • lfn_tokenizer_32k.model
    775 kB
    xet
    Upload all models and assets for lfn (latest) 3 days ago
  • lfn_tokenizer_32k.vocab
    485 kB
    Upload all models and assets for lfn (latest) 3 days ago
  • lfn_tokenizer_64k.model
    1.35 MB
    xet
    Upload all models and assets for lfn (latest) 3 days ago
  • lfn_tokenizer_64k.vocab
    1.03 MB
    Upload all models and assets for lfn (latest) 3 days ago
  • lfn_tokenizer_8k.model
    373 kB
    xet
    Upload all models and assets for lfn (latest) 3 days ago
  • lfn_tokenizer_8k.vocab
    108 kB
    Upload all models and assets for lfn (latest) 3 days ago