chromeNLP commited on
Commit
1f4e4a2
·
verified ·
1 Parent(s): 4a55646

Add the epoch-14 DrugCLIP checkpoint scored in PR 94

Browse files
Files changed (4) hide show
  1. README.md +32 -0
  2. model.pt +3 -0
  3. model_config.json +13 -0
  4. model_manifest.json +11 -0
README.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ tags:
4
+ - drug-discovery
5
+ - drugclip
6
+ ---
7
+
8
+ # DrugCLIP epoch 14
9
+
10
+ Selected fine-tune checkpoint from the paper-scale DrugCLIP run. Held-out scores below are the corrected rescore in [this report](https://github.com/openssi-dev/ai4sci-tasks/pull/94#issuecomment-6174348916).
11
+
12
+ `model.pt` SHA-256: `bb108dcec5608b04eee546a0ed57248ab5f956cb61799a8c5611ab9c8da7c772`
13
+
14
+ Equal-target mean EF at 1% is **16.108**.
15
+
16
+ | Benchmark | Targets | ROC-AUC | BEDROC (80.5) | EF 1% |
17
+ | --- | ---: | ---: | ---: | ---: |
18
+ | DUD-E | 102 | 0.769 | 0.295 | 18.056 |
19
+ | LIT-PCBA | 15 | 0.577 | 0.038 | 2.861 |
20
+
21
+ Random ranking is EF 1.
22
+
23
+ The checkpoint is fine-tune epoch 14, selected by development BEDROC 0.4288. Fine-tuning stopped at epoch 34 after patience 20. The model has 95,305,418 parameters. Pocket atoms were scored with element tokens, a 511-atom test crop, and the author pooling (DUD-E median/MAD, then max; LIT-PCBA max).
24
+
25
+ Exact benchmark means from that rescore:
26
+
27
+ | Benchmark | ROC-AUC | BEDROC (80.5) | EF 1% |
28
+ | --- | ---: | ---: | ---: |
29
+ | DUD-E | 0.7686053801137084 | 0.29458757122655027 | 18.055988235981932 |
30
+ | LIT-PCBA | 0.5774894830416493 | 0.0381821961785978 | 2.861166091212881 |
31
+
32
+ Overall equal-target mean EF at 1% is 16.107934114857695.
model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb108dcec5608b04eee546a0ed57248ab5f956cb61799a8c5611ab9c8da7c772
3
+ size 381378659
model_config.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "attention_heads": 64,
3
+ "dropout": 0.1,
4
+ "embedding_dim": 128,
5
+ "encoder_layers": 15,
6
+ "encoder_width": 512,
7
+ "ffn_width": 2048,
8
+ "gradient_checkpointing": true,
9
+ "max_molecule_atoms": 256,
10
+ "max_pocket_atoms": 256,
11
+ "molecule_vocab_size": 31,
12
+ "pocket_vocab_size": 10
13
+ }
model_manifest.json ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "checkpoint": {
3
+ "path": "model.pt",
4
+ "sha256": "bb108dcec5608b04eee546a0ed57248ab5f956cb61799a8c5611ab9c8da7c772"
5
+ },
6
+ "method": "paper-dual-unimol",
7
+ "model_config": "model_config.json",
8
+ "parameter_count": 95305418,
9
+ "schema": "target-based-drug-screening-model/v2",
10
+ "training_summary": "training_summary.json"
11
+ }