Commit ·
9129738
1
Parent(s): 8d08d2f
Update README.md
Browse files
README.md
CHANGED
|
@@ -29,6 +29,13 @@ BertConfig(
|
|
| 29 |
)
|
| 30 |
```
|
| 31 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
## Pretraining Database
|
| 33 |
The model was pretrained using data from the ChEMBL database, specifically version 33. You can download the database from [ChEMBL](https://ftp.ebi.ac.uk/pub/databases/chembl/ChEMBLdb/latest/).
|
| 34 |
|
|
|
|
| 29 |
)
|
| 30 |
```
|
| 31 |
|
| 32 |
+
- Optimizer: AdamW
|
| 33 |
+
- Learning rate: 1e-4
|
| 34 |
+
- Learning rate scheduler: False
|
| 35 |
+
- Epochs: 50
|
| 36 |
+
- AMP: True
|
| 37 |
+
- GPU: Single Nvidia RTX 3090
|
| 38 |
+
|
| 39 |
## Pretraining Database
|
| 40 |
The model was pretrained using data from the ChEMBL database, specifically version 33. You can download the database from [ChEMBL](https://ftp.ebi.ac.uk/pub/databases/chembl/ChEMBLdb/latest/).
|
| 41 |
|