Hugging Face's logo

Buckets:
hf-doc-build
/
doc-dev

Files
xet
hf-doc-build/doc-dev / tokenizers /pr_2471 /en /api
233 GB
2,504,778 files
Updated 8 minutes ago
Name
Size
added-tokens.html15.4 kB
xet
added-tokens.md579 Bytes
xet
decoders.html29.6 kB
xet
decoders.md1.26 kB
xet
encode-inputs.html20.7 kB
xet
encode-inputs.md2.34 kB
xet
encoding.html15.5 kB
xet
encoding.md697 Bytes
xet
input-sequences.html19.3 kB
xet
input-sequences.md1.5 kB
xet
models.html20.8 kB
xet
models.md772 Bytes
xet
normalizers.html34 kB
xet
normalizers.md1.55 kB
xet
post-processors.html17.2 kB
xet
post-processors.md941 Bytes
xet
pre-tokenizers.html31.7 kB
xet
pre-tokenizers.md1.6 kB
xet
tokenizer.html15.4 kB
xet
tokenizer.md647 Bytes
xet
trainers.html21.2 kB
xet
trainers.md911 Bytes
xet
visualizer.html16.8 kB
xet
visualizer.md640 Bytes
xet
Total size
233 GB
Files
2,504,778
Last updated
Oct 28
Pre-warmed CDN
US EU US EU

Contributors