bhavnicksm commited on
Commit
32e227a
·
verified ·
1 Parent(s): ebb7c04

Update tokenizer.tkz to v11 (with pad_token_id)

Browse files
Files changed (1) hide show
  1. tokenizer.tkz +1 -1
tokenizer.tkz CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f6f5a2d0efd3128e2ed3b9a76e9dafe8d45d2f40d3c6c9dddbf76470a231c2c0
3
  size 20616294
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f44ea8567f1d8057856c539c44763d8808599f970308826e422ae85ad8c586a
3
  size 20616294