emeraldgoose
/

bad-korean-tokenizer

Model card Files Files and versions

bad-korean-tokenizer / README.md

emeraldgoose's picture

Create README.md

0a3d33a about 4 years ago

|

history blame contribute delete

158 Bytes

KcELECTRA(https://github.com/Beomi/KcELECTRA)의 Tokenizer에서 [UNK]로 대체되는 토큰들을 추가했습니다.