Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
MCplayer
/
XY_Tokenizer
like
0
PyTorch
xy_tokenizer
custom_code
arxiv:
2506.23325
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
0b4c806
XY_Tokenizer
2.14 GB
Ctrl+K
Ctrl+K
1 contributor
History:
3 commits
MCplayer
pre-release version
0b4c806
10 months ago
examples
XY_Tokenizer AutoModel version support
10 months ago
.gitattributes
Safe
1.56 kB
XY_Tokenizer AutoModel version support
10 months ago
README.md
Safe
3.24 kB
pre-release version
10 months ago
config.json
Safe
3.31 kB
pre-release version
10 months ago
configuration_xy_tokenizer.py
Safe
3.49 kB
XY_Tokenizer AutoModel version support
10 months ago
feature_extraction_xy_tokenizer.py
Safe
8.7 kB
pre-release version
10 months ago
modeling_xy_tokenizer.py
Safe
61 kB
pre-release version
10 months ago
preprocessor_config.json
Safe
267 Bytes
pre-release version
10 months ago
pytorch_model.bin
pickle
Detected Pickle imports (4)
"torch.BoolStorage"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
,
"torch.FloatStorage"
What is a pickle import?
2.14 GB
xet
XY_Tokenizer AutoModel version support
10 months ago