Hugging Face's logo

gbyuvd
/
FastChemTokenizer

Feature Extraction
qwen3
chemistry
tokenizer
Model card Files
xet
Community
gbyuvd commited on
Commit
15fb43c
·
verified ·
1 Parent(s): 5bc08e8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -47,7 +47,7 @@ Core's vocab length = 781 (after pruning)
47
  ```
48
  | Metric | FastChemTokenizer-WTails | FastChemTokenizer-Core | [opti-chemfie-experiment-1](https://huggingface.co/gbyuvd/bionat-selfies-gen-tokenizer-wordlevel) |
49
  |--------------------------------|-------------------|----------------------|---------------------|
50
- | **Avg time per SMILES** | 0.1882 ± 0.0140 ms| 0.1674 ± 0.0093 ms | *0.1157 ± 0.0095 ms**|
51
  | **Avg sequence length** | **20.46 ± 1.21 tokens** | 33.41 ± 1.80 tokens | 54.29 ± 3.08 tokens |
52
  | **Throughput** | 5,313/sec | 5,973/sec | **8,642 /sec** |
53
  | **Peak memory usage** | **9.32 MB** | 20.16 MB | 490.13 MB |
 
47
  ```
48
  | Metric | FastChemTokenizer-WTails | FastChemTokenizer-Core | [opti-chemfie-experiment-1](https://huggingface.co/gbyuvd/bionat-selfies-gen-tokenizer-wordlevel) |
49
  |--------------------------------|-------------------|----------------------|---------------------|
50
+ | **Avg time per SMILES** | 0.1882 ± 0.0140 ms| 0.1674 ± 0.0093 ms | **0.1157 ± 0.0095 ms**|
51
  | **Avg sequence length** | **20.46 ± 1.21 tokens** | 33.41 ± 1.80 tokens | 54.29 ± 3.08 tokens |
52
  | **Throughput** | 5,313/sec | 5,973/sec | **8,642 /sec** |
53
  | **Peak memory usage** | **9.32 MB** | 20.16 MB | 490.13 MB |