Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
2ira
/
Byte-lingua-code
like
0
Model card
Files
Files and versions
xet
Community
main
Byte-lingua-code
/
superbpe
/
tokenizers_superbpe
/
bindings
/
python
/
src
/
utils
59.3 kB
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
2ira
offline_compression_graph_code
72c0672
verified
4 months ago
iterators.rs
3.98 kB
offline_compression_graph_code
4 months ago
mod.rs
1.67 kB
offline_compression_graph_code
4 months ago
normalization.rs
17.6 kB
offline_compression_graph_code
4 months ago
pretokenization.rs
11.6 kB
offline_compression_graph_code
4 months ago
regex.rs
571 Bytes
offline_compression_graph_code
4 months ago
serde_pyo3.rs
23.9 kB
offline_compression_graph_code
4 months ago