Update README.md
Browse files
README.md
CHANGED
|
@@ -17,7 +17,7 @@ This model is a fine-tuned version of ESM2-3B for paired antibody sequences (hea
|
|
| 17 |
|
| 18 |
**Key Features:**
|
| 19 |
- Trained on paired antibody sequences
|
| 20 |
-
- 15% WC followed by 50% CDR fine-tuning
|
| 21 |
- Input format: Heavy-Light chains separated by "-"
|
| 22 |
- Output: 2560-dimensional embeddings
|
| 23 |
- Optimized for antibody CDR region understanding
|
|
@@ -59,7 +59,7 @@ light_chain = (
|
|
| 59 |
paired_sequence = f"{heavy_chain}{SEP_TOKEN}{light_chain}"
|
| 60 |
|
| 61 |
# Tokenize
|
| 62 |
-
inputs = tokenizer(
|
| 63 |
|
| 64 |
# Extract embeddings
|
| 65 |
with torch.no_grad():
|
|
@@ -93,17 +93,34 @@ sequence = "EVQLVESGGGLVQPGGSLRLSCAASGFTFSSYAMS...-DIQMTQSPSSLSASVGDRVTITCRASQSI
|
|
| 93 |
- **Sequence length:** Variable (up to ~1024 tokens including special tokens)
|
| 94 |
- **Format:** PyTorch tensor
|
| 95 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 96 |
## Citation
|
| 97 |
|
| 98 |
-
If you use this model, please cite:
|
| 99 |
|
| 100 |
```bibtex
|
| 101 |
-
@article{
|
| 102 |
-
|
| 103 |
-
|
| 104 |
-
journal={
|
| 105 |
-
|
| 106 |
-
|
|
|
|
|
|
|
| 107 |
}
|
| 108 |
```
|
| 109 |
|
|
@@ -112,7 +129,7 @@ If you use this model, please cite:
|
|
| 112 |
- **Maintainer:** Network Optimization & Control (NOC) Lab
|
| 113 |
- **Email:** mtalaei@bu.edu
|
| 114 |
- **GitHub:** [https://github.com/noc-lab/AbCDR-ESM](https://github.com/noc-lab/AbCDR-ESM)
|
| 115 |
-
- **Paper:** [
|
| 116 |
|
| 117 |
## License
|
| 118 |
|
|
|
|
| 17 |
|
| 18 |
**Key Features:**
|
| 19 |
- Trained on paired antibody sequences
|
| 20 |
+
- 15% whole-chain (WC) masking followed by 50% CDR masking during fine-tuning
|
| 21 |
- Input format: Heavy-Light chains separated by "-"
|
| 22 |
- Output: 2560-dimensional embeddings
|
| 23 |
- Optimized for antibody CDR region understanding
|
|
|
|
| 59 |
paired_sequence = f"{heavy_chain}{SEP_TOKEN}{light_chain}"
|
| 60 |
|
| 61 |
# Tokenize
|
| 62 |
+
inputs = tokenizer(paired_sequence, return_tensors="pt", add_special_tokens=True)
|
| 63 |
|
| 64 |
# Extract embeddings
|
| 65 |
with torch.no_grad():
|
|
|
|
| 93 |
- **Sequence length:** Variable (up to ~1024 tokens including special tokens)
|
| 94 |
- **Format:** PyTorch tensor
|
| 95 |
|
| 96 |
+
## Publication
|
| 97 |
+
|
| 98 |
+
**Preferential CDR masking in paired antibody language models improves binding affinity prediction**
|
| 99 |
+
|
| 100 |
+
Mahtab Talaei, Kenji C. Walker, Boran Hao, Eliot Jolley, Yeping Jin, Dima Kozakov, John Misasi, Sandor Vajda, Ioannis Ch. Paschalidis, Diane Joseph-McCarthy.
|
| 101 |
+
|
| 102 |
+
*Communications AI & Computing* **1**, 7 (2026).
|
| 103 |
+
|
| 104 |
+
**DOI:** https://doi.org/10.1038/s44488-026-00010-2
|
| 105 |
+
|
| 106 |
+
**Published:** August 13, 2026
|
| 107 |
+
|
| 108 |
+
[Read the published article](https://www.nature.com/articles/s44488-026-00010-2)
|
| 109 |
+
|
| 110 |
+
|
| 111 |
## Citation
|
| 112 |
|
| 113 |
+
If you use this model, please cite the published paper:
|
| 114 |
|
| 115 |
```bibtex
|
| 116 |
+
@article{Talaei2026,
|
| 117 |
+
author = {Talaei, Mahtab and Walker, Kenji C. and Hao, Boran and Jolley, Eliot and Jin, Yeping and Kozakov, Dima and Misasi, John and Vajda, Sandor and Paschalidis, Ioannis Ch. and Joseph-McCarthy, Diane},
|
| 118 |
+
title = {Preferential {CDR} masking in paired antibody language models improves binding affinity prediction},
|
| 119 |
+
journal = {Communications AI \& Computing},
|
| 120 |
+
volume = {1},
|
| 121 |
+
pages = {7},
|
| 122 |
+
year = {2026},
|
| 123 |
+
doi = {10.1038/s44488-026-00010-2}
|
| 124 |
}
|
| 125 |
```
|
| 126 |
|
|
|
|
| 129 |
- **Maintainer:** Network Optimization & Control (NOC) Lab
|
| 130 |
- **Email:** mtalaei@bu.edu
|
| 131 |
- **GitHub:** [https://github.com/noc-lab/AbCDR-ESM](https://github.com/noc-lab/AbCDR-ESM)
|
| 132 |
+
- **Paper:** [Communications AI & Computing](https://doi.org/10.1038/s44488-026-00010-2)
|
| 133 |
|
| 134 |
## License
|
| 135 |
|