File size: 918 Bytes
c0909aa 67b0f26 e0e0b86 97a47f0 f047318 c0909aa e0e0b86 abfa96c c0909aa ad4a63f c0909aa 55dfec6 c0909aa |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 |
---
license: mit
---
**Base model:** [westlake-repl/SaProt_650M_AF2](https://huggingface.co/westlake-repl/SaProt_650M_AF2)
**Task type:** residue-level classification
Label 1 means a protein residue belongs to a small molecule binding cavity, 0 means it doesn't.
**Dataset:** [SaProtHub/Dataset-Binding_Site_Detection-ProteinShake](https://huggingface.co/datasets/SaProtHub/Dataset-Binding_Site_Detection-ProteinShake)
**Model input type:** SA(Structure-aware) sequence
**Performance (on test set):** 0.603 Mcc
**LoRA config:**
- **r:** 8
- **lora_dropout:** 0
- **lora_alpha:** 16
- **target_modules:** ["query", "key", "value", "intermediate.dense", "output.dense"]
- **modules_to_save:** ["classifier"]
**Training config:**
- **optimizer:**
- **class:** AdamW
- **betas:** (0.9, 0.98)
- **weight_decay:** 0.01
- **learning rate:** 5e-4
- **epoch:** 100
- **batch size:** 64
- **precision:** 16-mixed |