Hugging Face's logo

Buckets:
hf-doc-build
/
doc-dev

Files
xet
hf-doc-build/doc-dev / tokenizers /pr_1893 /en /api
169 GB
2,740,725 files
Updated about 1 hour ago
NameSize
added-tokens.html54.6 kB
xet
added-tokens.md2.56 kB
xet
decoders.html75 kB
xet
decoders.md4.07 kB
xet
encode-inputs.html20.3 kB
xet
encode-inputs.md2.08 kB
xet
encoding.html159 kB
xet
encoding.md9.37 kB
xet
input-sequences.html18.8 kB
xet
input-sequences.md1.17 kB
xet
models.html133 kB
xet
models.md8.5 kB
xet
normalizers.html90.2 kB
xet
normalizers.md4.48 kB
xet
post-processors.html55.3 kB
xet
post-processors.md4.78 kB
xet
pre-tokenizers.html108 kB
xet
pre-tokenizers.md8.19 kB
xet
tokenizer.html287 kB
xet
tokenizer.md18.8 kB
xet
trainers.html76.5 kB
xet
trainers.md4.31 kB
xet
visualizer.html36.1 kB
xet
visualizer.md2.1 kB
xet
Total size
169 GB
Files
2,740,725
Last updated
May 23
Pre-warmed CDN
US EU US EU

Contributors