latin-bert / tokenizer_config.json

Commit History

fix: apply do_lower_case to root-level HF-facing files
f25becd

diyclassics Claude Opus 4.6 (1M context) commited on

feat: add LatinBertTokenizerFast with word_ids() support
ed6af90

diyclassics Claude Opus 4.6 (1M context) commited on

chore: add HF model repo files (config, tokenizer, encoder, README)
872519e

diyclassics Claude Opus 4.6 (1M context) commited on