Update README.md
Browse files
README.md
CHANGED
|
@@ -4,6 +4,8 @@ language:
|
|
| 4 |
---
|
| 5 |
|
| 6 |
origin tokenizer : 42dot/42dot_LLM-PLM-1.3B
|
|
|
|
|
|
|
| 7 |
```
|
| 8 |
new added special tokens = ["$~me$", "$~the_flow_of_thought$", "$~dev$", "$~somebody$"]
|
| 9 |
replaced special tokens = {
|
|
|
|
| 4 |
---
|
| 5 |
|
| 6 |
origin tokenizer : 42dot/42dot_LLM-PLM-1.3B
|
| 7 |
+
(42dot/42dot_LLM-PLM-1.3B 의 토크나이저와 호환됩니다)
|
| 8 |
+
|
| 9 |
```
|
| 10 |
new added special tokens = ["$~me$", "$~the_flow_of_thought$", "$~dev$", "$~somebody$"]
|
| 11 |
replaced special tokens = {
|