Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
wikilangs
/
tpi
like
0
Follow
WikiLangs
5
Text Generation
fastText
omarkamali/wikipedia-monthly
Tok Pisin
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
feature-extraction
sentence-similarity
tokenization
n-grams
markov-chain
text-mining
babelvec
vocabulous
vocabulary
monolingual
family-germanic_west_anglofrisian
License:
mit
Model card
Files
Files and versions
xet
Community
Use this model
main
tpi
/
visualizations
2.95 MB
1 contributor
History:
1 commit
omarkamali
Upload all models and assets for tpi (latest)
9dbdc08
verified
2 days ago
embedding_alignment_quality.png
44.8 kB
Upload all models and assets for tpi (latest)
2 days ago
embedding_isotropy.png
50 kB
Upload all models and assets for tpi (latest)
2 days ago
embedding_norms.png
37.6 kB
Upload all models and assets for tpi (latest)
2 days ago
embedding_similarity.png
158 kB
xet
Upload all models and assets for tpi (latest)
2 days ago
embedding_tsne_multilingual.png
280 kB
xet
Upload all models and assets for tpi (latest)
2 days ago
markov_branching.png
35.5 kB
Upload all models and assets for tpi (latest)
2 days ago
markov_contexts.png
34.6 kB
Upload all models and assets for tpi (latest)
2 days ago
markov_entropy.png
88 kB
Upload all models and assets for tpi (latest)
2 days ago
model_sizes.png
50.6 kB
Upload all models and assets for tpi (latest)
2 days ago
nearest_neighbors.png
69.3 kB
Upload all models and assets for tpi (latest)
2 days ago
ngram_coverage.png
106 kB
xet
Upload all models and assets for tpi (latest)
2 days ago
ngram_entropy.png
48.7 kB
Upload all models and assets for tpi (latest)
2 days ago
ngram_perplexity.png
78 kB
Upload all models and assets for tpi (latest)
2 days ago
ngram_unique.png
37.9 kB
Upload all models and assets for tpi (latest)
2 days ago
performance_dashboard.png
378 kB
xet
Upload all models and assets for tpi (latest)
2 days ago
position_encoding_comparison.png
110 kB
xet
Upload all models and assets for tpi (latest)
2 days ago
tokenizer_compression.png
44.1 kB
Upload all models and assets for tpi (latest)
2 days ago
tokenizer_fertility.png
40.5 kB
Upload all models and assets for tpi (latest)
2 days ago
tokenizer_oov.png
36.7 kB
Upload all models and assets for tpi (latest)
2 days ago
tokenizer_total_tokens.png
35.4 kB
Upload all models and assets for tpi (latest)
2 days ago
top20_words.png
56.6 kB
Upload all models and assets for tpi (latest)
2 days ago
tsne_sentences.png
270 kB
xet
Upload all models and assets for tpi (latest)
2 days ago
tsne_words.png
623 kB
xet
Upload all models and assets for tpi (latest)
2 days ago
vocab_coverage.png
68.7 kB
Upload all models and assets for tpi (latest)
2 days ago
vocab_freq_dist.png
53.9 kB
Upload all models and assets for tpi (latest)
2 days ago
zipf_law.png
109 kB
xet
Upload all models and assets for tpi (latest)
2 days ago
