Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
wikilangs
/
av
like
0
Follow
WikiLangs
2
Feature Extraction
omarkamali/wikipedia-monthly
Avaric
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
monolingual
family-caucasian_northeast
License:
mit
Model card
Files
Files and versions
xet
Community
main
av
/
models
/
tokenizer
6.12 MB
1 contributor
History:
1 commit
omarkamali
Upload all models and assets for av (20251201)
6c55f26
verified
about 22 hours ago
av_tokenizer_16k.model
577 kB
xet
Upload all models and assets for av (20251201)
about 22 hours ago
av_tokenizer_16k.vocab
302 kB
Upload all models and assets for av (20251201)
about 22 hours ago
av_tokenizer_32k.model
937 kB
xet
Upload all models and assets for av (20251201)
about 22 hours ago
av_tokenizer_32k.vocab
647 kB
Upload all models and assets for av (20251201)
about 22 hours ago
av_tokenizer_64k.model
1.72 MB
xet
Upload all models and assets for av (20251201)
about 22 hours ago
av_tokenizer_64k.vocab
1.39 MB
Upload all models and assets for av (20251201)
about 22 hours ago
av_tokenizer_8k.model
403 kB
xet
Upload all models and assets for av (20251201)
about 22 hours ago
av_tokenizer_8k.vocab
139 kB
Upload all models and assets for av (20251201)
about 22 hours ago
