Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
wikilangs
/
av
like
0
Follow
WikiLangs
10
Text Generation
fastText
omarkamali/wikipedia-monthly
Avaric
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
feature-extraction
sentence-similarity
tokenization
n-grams
markov-chain
text-mining
babelvec
vocabulous
vocabulary
monolingual
family-caucasian_northeast
License:
mit
Model card
Files
Files and versions
xet
Community
Use this model
7caef94
av
/
models
/
tokenizer
6.12 MB
1 contributor
History:
2 commits
omarkamali
Upload all models and assets for av (20251001)
7caef94
verified
2 months ago
av_tokenizer_16k.model
580 kB
xet
Upload all models and assets for av (20251001)
2 months ago
av_tokenizer_16k.vocab
Safe
306 kB
Upload all models and assets for av (20251001)
2 months ago
av_tokenizer_32k.model
944 kB
xet
Upload all models and assets for av (20251001)
2 months ago
av_tokenizer_32k.vocab
Safe
653 kB
Upload all models and assets for av (20251001)
2 months ago
av_tokenizer_64k.model
1.71 MB
xet
Upload all models and assets for av (20251001)
2 months ago
av_tokenizer_64k.vocab
Safe
1.39 MB
Upload all models and assets for av (20251001)
2 months ago
av_tokenizer_8k.model
404 kB
xet
Upload all models and assets for av (20251001)
2 months ago
av_tokenizer_8k.vocab
Safe
140 kB
Upload all models and assets for av (20251001)
2 months ago