spitfire4794
/

beng_bpe

Model card Files Files and versions

beng_bpe / tokenizer.json

Commit History

Add standard contractions to pre-tokenizer Regex for GGUF compatibility

f15cc49
verified

spitfire4794 commited on 14 days ago

Upload 4 files

c2b3af0
verified

spitfire4794 commited on 22 days ago