Paul Rock commited on
Commit ·
0515f63
1
Parent(s): 49768a8
Files removed
Browse files- special_tokens_map.json +0 -1
- tokenizer_config.json +0 -1
special_tokens_map.json
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}
|
|
|
|
|
|
tokenizer_config.json
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
{}
|
|
|
|
|
|