Upload 2 files
Browse files- tokenizer (1).json +0 -0
- tokenizer_config (1).json +1 -0
tokenizer (1).json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
tokenizer_config (1).json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"do_lower_case": true, "model_max_length": 512}
|