Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
wikilangs
/
ami
like
0
Follow
WikiLangs
2
Feature Extraction
omarkamali/wikipedia-monthly
Amis
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
monolingual
family-austronesian_formosan
License:
mit
Model card
Files
Files and versions
xet
Community
main
ami
/
visualizations
2.39 MB
1 contributor
History:
1 commit
omarkamali
Upload all models and assets for ami (20251201)
83fdf8f
verified
1 day ago
embedding_isotropy.png
46.6 kB
Upload all models and assets for ami (20251201)
1 day ago
embedding_norms.png
34.8 kB
Upload all models and assets for ami (20251201)
1 day ago
embedding_similarity.png
144 kB
xet
Upload all models and assets for ami (20251201)
1 day ago
markov_branching.png
37 kB
Upload all models and assets for ami (20251201)
1 day ago
markov_contexts.png
29.5 kB
Upload all models and assets for ami (20251201)
1 day ago
markov_entropy.png
63.7 kB
Upload all models and assets for ami (20251201)
1 day ago
model_sizes.png
51.9 kB
Upload all models and assets for ami (20251201)
1 day ago
nearest_neighbors.png
66.9 kB
Upload all models and assets for ami (20251201)
1 day ago
ngram_coverage.png
80.4 kB
Upload all models and assets for ami (20251201)
1 day ago
ngram_entropy.png
34.2 kB
Upload all models and assets for ami (20251201)
1 day ago
ngram_perplexity.png
51.5 kB
Upload all models and assets for ami (20251201)
1 day ago
ngram_unique.png
31.9 kB
Upload all models and assets for ami (20251201)
1 day ago
performance_dashboard.png
280 kB
xet
Upload all models and assets for ami (20251201)
1 day ago
position_encoding_comparison.png
114 kB
xet
Upload all models and assets for ami (20251201)
1 day ago
tokenizer_compression.png
48.6 kB
Upload all models and assets for ami (20251201)
1 day ago
tokenizer_fertility.png
44.1 kB
Upload all models and assets for ami (20251201)
1 day ago
tokenizer_oov.png
47.6 kB
Upload all models and assets for ami (20251201)
1 day ago
tokenizer_total_tokens.png
43.3 kB
Upload all models and assets for ami (20251201)
1 day ago
top20_words.png
52.4 kB
Upload all models and assets for ami (20251201)
1 day ago
tsne_sentences.png
232 kB
xet
Upload all models and assets for ami (20251201)
1 day ago
tsne_words.png
624 kB
xet
Upload all models and assets for ami (20251201)
1 day ago
vocab_coverage.png
69.4 kB
Upload all models and assets for ami (20251201)
1 day ago
vocab_freq_dist.png
54 kB
Upload all models and assets for ami (20251201)
1 day ago
zipf_law.png
107 kB
xet
Upload all models and assets for ami (20251201)
1 day ago
