Hugging Face's logo

Buckets:
hf-doc-build
/
doc-dev

Files
xet
hf-doc-build/doc-dev / tokenizers /pr_2476 /en /api
237 GB
2,543,294 files
Updated 4 minutes ago
Name
Size
added-tokens.html15.4 kB
xet
added-tokens.md579 Bytes
xet
decoders.html29.6 kB
xet
decoders.md1.26 kB
xet
encode-inputs.html20.7 kB
xet
encode-inputs.md2.34 kB
xet
encoding.html15.5 kB
xet
encoding.md697 Bytes
xet
input-sequences.html19.3 kB
xet
input-sequences.md1.5 kB
xet
models.html20.8 kB
xet
models.md772 Bytes
xet
normalizers.html34 kB
xet
normalizers.md1.55 kB
xet
post-processors.html17.2 kB
xet
post-processors.md941 Bytes
xet
pre-tokenizers.html31.7 kB
xet
pre-tokenizers.md1.6 kB
xet
tokenizer.html15.4 kB
xet
tokenizer.md647 Bytes
xet
trainers.html21.2 kB
xet
trainers.md911 Bytes
xet
visualizer.html16.8 kB
xet
visualizer.md640 Bytes
xet
Total size
237 GB
Files
2,543,294
Last updated
Oct 29
Pre-warmed CDN
US EU US EU

Contributors