Mxode
/

Bilingual-Tokenizer

Model card Files Files and versions

Mxode commited on Sep 7, 2024

Commit

706a898

·

verified ·

1 Parent(s): 668aa56

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -21,7 +21,7 @@ $$
 Here is the test result:
-|                            Model                             | Tokenizer Size | Compression rate |
 | :----------------------------------------------------------: | :------------: | :------------: |
 | [deepseek-llm-7b-base](https://huggingface.co/deepseek-ai/deepseek-llm-7b-base) |     100015     |     36.63%     |
 | [deepseek-coder-33b-base](https://huggingface.co/deepseek-ai/deepseek-coder-33b-base) |     32022      |     41.75%     |

 Here is the test result:
+|                            Model                             | Tokenizer Size | Compression Rate |
 | :----------------------------------------------------------: | :------------: | :------------: |
 | [deepseek-llm-7b-base](https://huggingface.co/deepseek-ai/deepseek-llm-7b-base) |     100015     |     36.63%     |
 | [deepseek-coder-33b-base](https://huggingface.co/deepseek-ai/deepseek-coder-33b-base) |     32022      |     41.75%     |