Hugging Face's logo

Buckets:
hf-doc-build
/
doc-dev

Files
xet
hf-doc-build/doc-dev / tokenizers /pr_2009 /en /api
151 GB
2,493,915 files
Updated 38 minutes ago
NameSize
added-tokens.html54.6 kB
xet
added-tokens.md2.56 kB
xet
decoders.html127 kB
xet
decoders.md9.53 kB
xet
encode-inputs.html20.3 kB
xet
encode-inputs.md2.08 kB
xet
encoding.html164 kB
xet
encoding.md9.95 kB
xet
input-sequences.html18.8 kB
xet
input-sequences.md1.17 kB
xet
models.html149 kB
xet
models.md10.1 kB
xet
normalizers.html136 kB
xet
normalizers.md10.1 kB
xet
post-processors.html65.7 kB
xet
post-processors.md5.65 kB
xet
pre-tokenizers.html141 kB
xet
pre-tokenizers.md11.4 kB
xet
tokenizer.html291 kB
xet
tokenizer.md19.9 kB
xet
trainers.html93.5 kB
xet
trainers.md5.84 kB
xet
visualizer.html36.2 kB
xet
visualizer.md2.15 kB
xet
Total size
151 GB
Files
2,493,915
Last updated
May 17
Pre-warmed CDN
US EU US EU

Contributors