KcBERT-v2023 / tokenizer.json

Commit History

set new tokenizer
fae1a42

beomi commited on

add tokenizer based on KoLLAMA
c2c606d

beomi commited on