almaghrabima
/

SARFTokenizer

Text Generation

Model card Files Files and versions

SARFTokenizer / morfessor_models

7.48 MB

1 contributor

History: 4 commits

almaghrabima's picture

Upload morfessor_models/morf_map_reverse.json with huggingface_hub

2772bff verified 26 days ago

morf_map.json

683 kB

Upload morfessor_models/morf_map.json with huggingface_hub 26 days ago
morf_map_reverse.json

776 kB

Upload morfessor_models/morf_map_reverse.json with huggingface_hub 26 days ago
morfessor_ar.bin
Detected Pickle imports (6)
- "morfessor.baseline.ConstrNode",
- "morfessor.baseline.CorpusEncoding",
- "morfessor.baseline.LexiconEncoding",
- "morfessor.baseline.BaselineModel",
- "collections.Counter",
- "morfessor.baseline.FixedCorpusWeight"
How to fix it?
4.12 MB
xet

Upload morfessor_models/morfessor_ar.bin with huggingface_hub 26 days ago
morfessor_en.bin
Detected Pickle imports (6)
- "morfessor.baseline.BaselineModel",
- "morfessor.baseline.FixedCorpusWeight",
- "collections.Counter",
- "morfessor.baseline.ConstrNode",
- "morfessor.baseline.CorpusEncoding",
- "morfessor.baseline.LexiconEncoding"
How to fix it?
1.9 MB
xet

Upload morfessor_models/morfessor_en.bin with huggingface_hub 26 days ago