Add the epoch-14 DrugCLIP checkpoint scored in PR 94
Browse files- README.md +32 -0
- model.pt +3 -0
- model_config.json +13 -0
- model_manifest.json +11 -0
README.md
ADDED
|
@@ -0,0 +1,32 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
tags:
|
| 4 |
+
- drug-discovery
|
| 5 |
+
- drugclip
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
# DrugCLIP epoch 14
|
| 9 |
+
|
| 10 |
+
Selected fine-tune checkpoint from the paper-scale DrugCLIP run. Held-out scores below are the corrected rescore in [this report](https://github.com/openssi-dev/ai4sci-tasks/pull/94#issuecomment-6174348916).
|
| 11 |
+
|
| 12 |
+
`model.pt` SHA-256: `bb108dcec5608b04eee546a0ed57248ab5f956cb61799a8c5611ab9c8da7c772`
|
| 13 |
+
|
| 14 |
+
Equal-target mean EF at 1% is **16.108**.
|
| 15 |
+
|
| 16 |
+
| Benchmark | Targets | ROC-AUC | BEDROC (80.5) | EF 1% |
|
| 17 |
+
| --- | ---: | ---: | ---: | ---: |
|
| 18 |
+
| DUD-E | 102 | 0.769 | 0.295 | 18.056 |
|
| 19 |
+
| LIT-PCBA | 15 | 0.577 | 0.038 | 2.861 |
|
| 20 |
+
|
| 21 |
+
Random ranking is EF 1.
|
| 22 |
+
|
| 23 |
+
The checkpoint is fine-tune epoch 14, selected by development BEDROC 0.4288. Fine-tuning stopped at epoch 34 after patience 20. The model has 95,305,418 parameters. Pocket atoms were scored with element tokens, a 511-atom test crop, and the author pooling (DUD-E median/MAD, then max; LIT-PCBA max).
|
| 24 |
+
|
| 25 |
+
Exact benchmark means from that rescore:
|
| 26 |
+
|
| 27 |
+
| Benchmark | ROC-AUC | BEDROC (80.5) | EF 1% |
|
| 28 |
+
| --- | ---: | ---: | ---: |
|
| 29 |
+
| DUD-E | 0.7686053801137084 | 0.29458757122655027 | 18.055988235981932 |
|
| 30 |
+
| LIT-PCBA | 0.5774894830416493 | 0.0381821961785978 | 2.861166091212881 |
|
| 31 |
+
|
| 32 |
+
Overall equal-target mean EF at 1% is 16.107934114857695.
|
model.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bb108dcec5608b04eee546a0ed57248ab5f956cb61799a8c5611ab9c8da7c772
|
| 3 |
+
size 381378659
|
model_config.json
ADDED
|
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"attention_heads": 64,
|
| 3 |
+
"dropout": 0.1,
|
| 4 |
+
"embedding_dim": 128,
|
| 5 |
+
"encoder_layers": 15,
|
| 6 |
+
"encoder_width": 512,
|
| 7 |
+
"ffn_width": 2048,
|
| 8 |
+
"gradient_checkpointing": true,
|
| 9 |
+
"max_molecule_atoms": 256,
|
| 10 |
+
"max_pocket_atoms": 256,
|
| 11 |
+
"molecule_vocab_size": 31,
|
| 12 |
+
"pocket_vocab_size": 10
|
| 13 |
+
}
|
model_manifest.json
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"checkpoint": {
|
| 3 |
+
"path": "model.pt",
|
| 4 |
+
"sha256": "bb108dcec5608b04eee546a0ed57248ab5f956cb61799a8c5611ab9c8da7c772"
|
| 5 |
+
},
|
| 6 |
+
"method": "paper-dual-unimol",
|
| 7 |
+
"model_config": "model_config.json",
|
| 8 |
+
"parameter_count": 95305418,
|
| 9 |
+
"schema": "target-based-drug-screening-model/v2",
|
| 10 |
+
"training_summary": "training_summary.json"
|
| 11 |
+
}
|