deskull commited on
Commit
6da28a1
·
verified ·
1 Parent(s): 5313b73

docs(card): fix Model Description architecture mislabel and parameter count

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -11,7 +11,7 @@ pipeline_tag: fill-mask
11
 
12
  ## Model Description
13
 
14
- GPT-2 medium (345M parameters) foundation model pre-trained on compound SMILES strings from the MolCrawl dataset.
15
 
16
  The tokenizer is a character-level BPE tokenizer (vocab_size=612) that encodes each SMILES character as a separate token. Input SMILES strings should be passed **without** spaces (e.g. `CC(=O)O`). The `[SEP]` token (id=13) is used as the end-of-sequence marker.
17
 
 
11
 
12
  ## Model Description
13
 
14
+ BERT-medium foundation model (~306M parameters, 24-layer / 1024-hidden / 16-head topology, sized to match GPT-2-medium) pre-trained on compound SMILES strings from the MolCrawl dataset.
15
 
16
  The tokenizer is a character-level BPE tokenizer (vocab_size=612) that encodes each SMILES character as a separate token. Input SMILES strings should be passed **without** spaces (e.g. `CC(=O)O`). The `[SEP]` token (id=13) is used as the end-of-sequence marker.
17