FoundationVision
/

unitok_tokenizer

Feature Extraction

Model card Files Files and versions

unitok_tokenizer

3.55 GB

3 contributors

History: 4 commits

nielsr's picture

nielsr HF Staff

Improve model card

fe59873 verified about 1 year ago

external
init about 1 year ago
.gitattributes

1.52 kB

initial commit about 1 year ago
README.md

4 kB

Improve model card about 1 year ago
unitok_tokenizer.pth
Detected Pickle imports (4)
- "torch.bfloat16",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
3.31 GB
xet

clean weights about 1 year ago