Transformers
FlashFormerv1 / tokenizer.json
LastTransformer's picture
FIX: Complete compilation of 32k vocabulary into tokenizer.json
c5ecc2b verified
Raw
History
3.72 MB
File too large to display, you can check the raw version instead.