ByteSpanTokenisers
/

bytelevel-models

Model card Files Files and versions

bytelevel-models / ngram

7.42 MB

1 contributor

History: 1 commit

codebyzeb's picture

Upload folder using huggingface_hub

54fc2ca verified 9 months ago

5-gram-model.pkl
Detected Pickle imports (8)
- "nltk.lm.smoothing.KneserNey",
- "nltk.probability.FreqDist",
- "nltk.lm.counter.NgramCounter",
- "nltk.probability.ConditionalFreqDist",
- "collections.Counter",
- "nltk.lm.models.KneserNeyInterpolated",
- "collections.defaultdict",
- "nltk.lm.vocabulary.Vocabulary"
How to fix it?
7.42 MB
xet

Upload folder using huggingface_hub 9 months ago