Hugging Face's logo

jonghyunlee
/
ChemBERT_ChEMBL_pretrained

Feature Extraction
Transformers
PyTorch
bert
chemistry
text-embeddings-inference
Model card Files
xet
 Community
1
jonghyunlee commited on
Commit
9129738
·
1 Parent(s): 8d08d2f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -29,6 +29,13 @@ BertConfig(
29
  )
30
  ```
31
 
 
 
 
 
 
 
 
32
  ## Pretraining Database
33
  The model was pretrained using data from the ChEMBL database, specifically version 33. You can download the database from [ChEMBL](https://ftp.ebi.ac.uk/pub/databases/chembl/ChEMBLdb/latest/).
34
 
 
29
  )
30
  ```
31
 
32
+ - Optimizer: AdamW
33
+ - Learning rate: 1e-4
34
+ - Learning rate scheduler: False
35
+ - Epochs: 50
36
+ - AMP: True
37
+ - GPU: Single Nvidia RTX 3090
38
+
39
  ## Pretraining Database
40
  The model was pretrained using data from the ChEMBL database, specifically version 33. You can download the database from [ChEMBL](https://ftp.ebi.ac.uk/pub/databases/chembl/ChEMBLdb/latest/).
41