docs(card): fix Model Description architecture mislabel and parameter count
Browse files
README.md
CHANGED
|
@@ -11,7 +11,7 @@ pipeline_tag: fill-mask
|
|
| 11 |
|
| 12 |
## Model Description
|
| 13 |
|
| 14 |
-
|
| 15 |
|
| 16 |
The tokenizer is a character-level BPE tokenizer (vocab_size=612) that encodes each SMILES character as a separate token. Input SMILES strings should be passed **without** spaces (e.g. `CC(=O)O`). The `[SEP]` token (id=13) is used as the end-of-sequence marker.
|
| 17 |
|
|
|
|
| 11 |
|
| 12 |
## Model Description
|
| 13 |
|
| 14 |
+
BERT-medium foundation model (~306M parameters, 24-layer / 1024-hidden / 16-head topology, sized to match GPT-2-medium) pre-trained on compound SMILES strings from the MolCrawl dataset.
|
| 15 |
|
| 16 |
The tokenizer is a character-level BPE tokenizer (vocab_size=612) that encodes each SMILES character as a separate token. Input SMILES strings should be passed **without** spaces (e.g. `CC(=O)O`). The `[SEP]` token (id=13) is used as the end-of-sequence marker.
|
| 17 |
|