spitfire4794
/

beng_bpe

Model card Files Files and versions

beng_bpe / tokenizer.json

spitfire4794's picture

Add standard contractions to pre-tokenizer Regex for GGUF compatibility

f15cc49 verified 14 days ago

History Contribute Delete

4.2 MB

File too large to display, you can check the raw version instead.