File size: 826 Bytes
1b309a4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 |
---
base_model: ProTrekHub/Protein_Encoder_35M
library_name: peft
---
# Model Card for Model-Demo-ProTrek-35M
## Base model
[ProTrekHub/Protein_Encoder_35M](https://huggingface.co/ProTrekHub/Protein_Encoder_35M)
## Task description
The task is to predict the protein solubility.
## Label meaning
Label 1 - soluble
Lable 0 - unsoluble
## Task type
Protein-level Classification
## Model input type
AA Sequence
## LoRA config
- **r:** 8
- **lora_dropout:** 0.0
- **lora_alpha:** 16
- **target_modules:** ['value', 'intermediate.dense', 'query', 'output.dense', 'key']
- **modules_to_save:** ['classifier']
## Training config
- **optimizer:**
- **class:** AdamW
- **betas:** (0.9, 0.98)
- **weight_decay:** 0.01
- **learning rate:** 0.0005
- **epoch:** 5
- **batch size:** 1
- **precision:** 16-mixed
|