Commit History

docs: align the status note with the card's fallback counts
0e5c937

janakhpon commited on

docs: split the paired dashes in the corpus-licence sentence
dcdec7f

janakhpon commited on

docs: report byte fallback as a count instead of a rate
c144801

janakhpon commited on

fix: stop declaring MIT over an artifact this project cannot license
810a75e

janakhpon commited on

fix: restate the algorithm comparison from one run
31b4ad3

janakhpon commited on

docs: track the release-discipline notes
997814f

janakhpon commited on

fix: point at the awesome list's real URL
f1214ba

janakhpon commited on

fix: correct the single-token coverage claim to 98.74%
b2eb67d

janakhpon commited on

docs: drop a dash pair from the opening claim
73b284c

janakhpon commited on

chore: keep internal engineering docs off the Hub
8fd15e7

janakhpon commited on

feat: migrate the artifact from SentencePiece to tokenizers JSON
954bd9d

janakhpon commited on

docs: withdraw the Git LFS finding
26c2631

janakhpon commited on

docs: record the 2026-08-08 engineering audit
fdfde26

janakhpon commited on

feat: update tokenizer artifacts with 41.4M character corpus
39ad643

janakhpon commited on

feat: restructure and upgrade to 32k vocab model (v2)
90115a5

janakhpon commited on

feat: restructure and upgrade to 32k vocab model (v2)
e909ce1

janakhpon commited on

feat: simplified mon tokenizer in hf format, updated tags, resolve the legacy issue
9d74fcf

janakhpon commited on

feat: simplified mon tokenizer in hf format, updated tags, resolve the legacy issue
1f1b899

janakhpon commited on

feat: simplified mon tokenizer in hf format, updated tags, resolve the legacy issue
e9d0f85

janakhpon commited on

feat: simplified mon tokenizer in hf format, updated tags, resolve the legacy issue
81cf36d

janakhpon commited on

feat: simplified mon tokenizer in hf format, updated tags
9ed3203

janakhpon commited on

feat: simplified mon tokenizer in hf format, updated tags
bece7ec

janakhpon commited on

feat: simplified mon tokenizer in hf format
f51150c

janakhpon commited on

feat: simplified mon tokenizer in hf format
2ded9d3

janakhpon commited on

initial commit
3f73eda
verified

janakhpon commited on