Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
wikilangs
/
shi
like
1
Follow
Wikilangs
12
Text Generation
fastText
omarkamali/wikipedia-monthly
Tachelhit
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
feature-extraction
sentence-similarity
tokenization
n-grams
markov-chain
text-mining
babelvec
vocabulous
vocabulary
monolingual
family-berber
License:
mit
Model card
Files
Files and versions
xet
Community
Use this model
main
shi
/
visualizations
3.01 MB
1 contributor
History:
2 commits
omarkamali
Upload all models and assets for shi (latest)
8c16188
verified
11 days ago
embedding_alignment_quality.png
Safe
44.9 kB
Upload all models and assets for shi (latest)
11 days ago
embedding_isotropy.png
Safe
45.7 kB
Upload all models and assets for shi (latest)
11 days ago
embedding_norms.png
Safe
35 kB
Upload all models and assets for shi (latest)
11 days ago
embedding_similarity.png
153 kB
xet
Upload all models and assets for shi (latest)
11 days ago
embedding_tsne_multilingual.png
307 kB
xet
Upload all models and assets for shi (latest)
11 days ago
markov_branching.png
Safe
36.3 kB
Upload all models and assets for shi (latest)
11 days ago
markov_contexts.png
Safe
34.7 kB
Upload all models and assets for shi (latest)
11 days ago
markov_entropy.png
Safe
87.1 kB
Upload all models and assets for shi (latest)
11 days ago
model_sizes.png
Safe
52.6 kB
Upload all models and assets for shi (latest)
11 days ago
nearest_neighbors.png
Safe
69.8 kB
Upload all models and assets for shi (latest)
2 months ago
ngram_coverage.png
Safe
92.5 kB
Upload all models and assets for shi (latest)
11 days ago
ngram_entropy.png
Safe
46.9 kB
Upload all models and assets for shi (latest)
11 days ago
ngram_perplexity.png
Safe
76.1 kB
Upload all models and assets for shi (latest)
11 days ago
ngram_unique.png
Safe
35.6 kB
Upload all models and assets for shi (latest)
11 days ago
performance_dashboard.png
416 kB
xet
Upload all models and assets for shi (latest)
11 days ago
position_encoding_comparison.png
101 kB
xet
Upload all models and assets for shi (latest)
11 days ago
tokenizer_compression.png
Safe
49.7 kB
Upload all models and assets for shi (latest)
11 days ago
tokenizer_fertility.png
Safe
45.5 kB
Upload all models and assets for shi (latest)
2 months ago
tokenizer_oov.png
Safe
45.8 kB
Upload all models and assets for shi (latest)
11 days ago
tokenizer_total_tokens.png
Safe
47.4 kB
Upload all models and assets for shi (latest)
11 days ago
top20_words.png
Safe
51.7 kB
Upload all models and assets for shi (latest)
11 days ago
tsne_sentences.png
280 kB
xet
Upload all models and assets for shi (latest)
11 days ago
tsne_words.png
637 kB
xet
Upload all models and assets for shi (latest)
11 days ago
vocab_coverage.png
Safe
66.9 kB
Upload all models and assets for shi (latest)
11 days ago
vocab_freq_dist.png
Safe
54 kB
Upload all models and assets for shi (latest)
11 days ago
zipf_law.png
101 kB
xet
Upload all models and assets for shi (latest)
11 days ago
