super-dainiu commited on
Commit
b7d1baf
·
verified ·
1 Parent(s): d294de1

Update model card

Browse files
Files changed (1) hide show
  1. README.md +18 -47
README.md CHANGED
@@ -5,61 +5,32 @@ tags:
5
  - protein-ligand
6
  - drug-target-interaction
7
  - contrastive-learning
8
- - esm2
9
- - selformer
10
- - logica
11
  ---
12
 
13
- # LogiCA — pretrained proteinligand backbones
14
 
15
- Pretrained checkpoints for **LogiCA** (*Contextualizing Biological Language Models
16
- across Modalities via Logit-Space Contrastive Alignment*). Each checkpoint is a
17
- bidirectional ESM-2 (protein) + SELFormer (ligand) model with a cross-attention
18
- adapter, pretrained on BindingDB with the logit-space contrastive objective
19
- (`--mode logicl`, 40-epoch `logicl40_clean` track).
20
 
21
- Code: **https://github.com/Yale-CompBio/logica**
 
 
 
 
 
22
 
23
- | Size | Protein backbone | File | Weights | Epoch | Val loss |
24
- | --- | --- | --- | --- | --- | --- |
25
- | 8M | `esm2_t6_8M_UR50D` | `checkpoints/8m/best.pt` | 19 MB | 100 | 1.8036 |
26
- | 35M | `esm2_t12_35M_UR50D` | `checkpoints/35m/best.pt` | 38 MB | 99 | 1.6101 |
27
- | 150M | `esm2_t30_150M_UR50D` | `checkpoints/150m/best.pt` | 64 MB | 98 | 1.3963 |
28
- | 650M | `esm2_t33_650M_UR50D` | `checkpoints/650m/best.pt` | 97 MB | 92 | 1.0994 |
29
 
30
- Ligand encoder: `HUBioDataLab/SELFormer` for all sizes.
31
-
32
- ## Contents
33
-
34
- Checkpoints are **weights-only** (`trainable_only=True`): a dict with
35
- `model_state_dict` (+ `epoch`, `metrics`, `rng_state`). They load into the
36
- `BiDirectionalDrugProteinModel` with `strict=False`.
37
-
38
- ## Usage
39
 
40
  ```python
41
  from huggingface_hub import hf_hub_download
42
- ckpt = hf_hub_download("Yale-CompBio/logica", "checkpoints/150m/best.pt")
43
  ```
44
 
45
- Then fine-tune with the released code (the entry points take `--pretrained_checkpoint`):
46
-
47
- ```bash
48
- python dti.py --method logica --dataset DAVIS \
49
- --esm_model esm2_t30_150M_UR50D --pretrained_checkpoint $ckpt --output_dir runs/dti_davis
50
- python variant.py --objective pairwise --held_out EGFR --split_strategy lopo \
51
- --esm_model esm2_t30_150M_UR50D --pretrained_checkpoint $ckpt \
52
- --data_csv splits/data.csv --fasta_path data/proteins.fasta --drugs_selfies data/drugs.selfies \
53
- --use_lora --output_dir runs/variant_egfr
54
- ```
55
-
56
- ## Citation
57
-
58
- ```
59
- @inproceedings{logica2026,
60
- title = {Contextualizing Biological Language Models across Modalities via Logit-Space Contrastive Alignment},
61
- author = {anonymous},
62
- booktitle = {NeurIPS},
63
- year = {2026}
64
- }
65
- ```
 
5
  - protein-ligand
6
  - drug-target-interaction
7
  - contrastive-learning
 
 
 
8
  ---
9
 
10
+ # LogiCA — pretrained protein-ligand backbones (anonymous, under review)
11
 
12
+ Anonymous artifact for double-blind review. Pretrained checkpoints for a
13
+ logit-space contrastive alignment model: a bidirectional ESM-2 (protein) +
14
+ SELFormer (ligand) backbone with a cross-attention adapter, pretrained on
15
+ BindingDB with a token-likelihood contrastive objective (40 epochs).
 
16
 
17
+ | Size | Protein backbone | File | Weights |
18
+ | --- | --- | --- | --- |
19
+ | 8M | `esm2_t6_8M_UR50D` | `checkpoints/8m/best.pt` | 19 MB |
20
+ | 35M | `esm2_t12_35M_UR50D` | `checkpoints/35m/best.pt` | 38 MB |
21
+ | 150M | `esm2_t30_150M_UR50D` | `checkpoints/150m/best.pt` | 64 MB |
22
+ | 650M | `esm2_t33_650M_UR50D` | `checkpoints/650m/best.pt` | 97 MB |
23
 
24
+ Ligand encoder: `HUBioDataLab/SELFormer` (all sizes).
 
 
 
 
 
25
 
26
+ Checkpoints are weights-only (`model_state_dict` + `epoch` + `metrics`); load with
27
+ `strict=False` into the bidirectional model. Download the size you need and pass it
28
+ to the training code as the pretrained checkpoint:
 
 
 
 
 
 
29
 
30
  ```python
31
  from huggingface_hub import hf_hub_download
32
+ ckpt = hf_hub_download(REPO_ID, "checkpoints/150m/best.pt") # REPO_ID withheld for review
33
  ```
34
 
35
+ Training and fine-tuning code is provided as an anonymized supplement with the
36
+ submission. Repository, authors, and citation are withheld for double-blind review.