spitfire4794
/

Alo-70m-Base

custom-tokenizer

parameter-efficient

Model card Files Files and versions

Alo-70m-Base / tokenizer.json

spitfire4794's picture

Add standard contractions to pre-tokenizer Regex for GGUF compatibility

feceaf6 verified 2 days ago

History Contribute Delete

4.2 MB

File too large to display, you can check the raw version instead.