AITRADER commited on
Commit
ab73877
·
verified ·
1 Parent(s): 477934b

Fix Mistral tokenizer regex - replace (?i:) with explicit case variants

Browse files
Files changed (1) hide show
  1. tokenizer.json +2 -2
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b55cfbe56194d11922a2ca8f0af47a42cff9b20d7b081990841ed16ce947e40c
3
- size 14570149
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76d37c1a0de7b40f75bb57bd51bd3085c79313367e5c379c84f805128cb7c100
3
+ size 10179896