AITRADER commited on
Commit
2c959c5
·
verified ·
1 Parent(s): 791241e

Fix tokenizer regex pattern (Mistral regex bug fix)

Browse files
Files changed (1) hide show
  1. tokenizer.json +2 -2
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aeb13307a71acd8fe81861d94ad54ab689df773318809eed3cbe794b4492dae4
3
- size 11422654
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c572724efc446765023a382b33c494684ad4bb9128ece4605ea4997ea9fd239f
3
+ size 14570147