Instructions to use Synthyra/DPLM2-650M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Synthyra/DPLM2-650M with Transformers:
# Load model directly from transformers import EsmForDPLM2 model = EsmForDPLM2.from_pretrained("Synthyra/DPLM2-650M", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -67,3 +67,43 @@ model.attn_backend = "flex" # propagates to all attention layers in-place
|
|
| 67 |
|
| 68 |
## Embed datasets
|
| 69 |
All DPLM2 models inherit `EmbeddingMixin`, so you can call `model.embed_dataset(...)` directly.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 67 |
|
| 68 |
## Embed datasets
|
| 69 |
All DPLM2 models inherit `EmbeddingMixin`, so you can call `model.embed_dataset(...)` directly.
|
| 70 |
+
|
| 71 |
+
## Citations
|
| 72 |
+
|
| 73 |
+
```bibtex
|
| 74 |
+
@article{wang2024dplm2,
|
| 75 |
+
title={DPLM-2: A Multimodal Diffusion Protein Language Model},
|
| 76 |
+
author={Wang, Xinyou and Ye, Zaixiang and Huang, Fei and Cao, Dongyan and Liang, Shujian and Huang, Liang},
|
| 77 |
+
journal={arXiv preprint arXiv:2410.13782},
|
| 78 |
+
year={2024}
|
| 79 |
+
}
|
| 80 |
+
```
|
| 81 |
+
|
| 82 |
+
```bibtex
|
| 83 |
+
@misc{FastPLMs,
|
| 84 |
+
author={Hallee, Logan and Bichara, David and Gleghorn, Jason P.},
|
| 85 |
+
title={FastPLMs: Fast, efficient, protein language model inference from Huggingface AutoModel.},
|
| 86 |
+
year={2024},
|
| 87 |
+
url={https://huggingface.co/Synthyra/ESMplusplus_small},
|
| 88 |
+
DOI={10.57967/hf/3726},
|
| 89 |
+
publisher={Hugging Face}
|
| 90 |
+
}
|
| 91 |
+
```
|
| 92 |
+
|
| 93 |
+
```bibtex
|
| 94 |
+
@article{dong2024flexattention,
|
| 95 |
+
title={Flex Attention: A Programming Model for Generating Optimized Attention Kernels},
|
| 96 |
+
author={Dong, Juechu and Feng, Boyuan and Guessous, Driss and Liang, Yanbo and He, Horace},
|
| 97 |
+
journal={arXiv preprint arXiv:2412.05496},
|
| 98 |
+
year={2024}
|
| 99 |
+
}
|
| 100 |
+
```
|
| 101 |
+
|
| 102 |
+
```bibtex
|
| 103 |
+
@inproceedings{paszke2019pytorch,
|
| 104 |
+
title={PyTorch: An Imperative Style, High-Performance Deep Learning Library},
|
| 105 |
+
author={Paszke, Adam and Gross, Sam and Massa, Francisco and Lerer, Adam and Bradbury, James and Chanan, Gregory and Killeen, Trevor and Lin, Zeming and Gimelshein, Natalia and Antiga, Luca and Desmaison, Alban and K{\"o}pf, Andreas and Yang, Edward and DeVito, Zach and Raison, Martin and Tejani, Alykhan and Chilamkurthy, Sasank and Steiner, Benoit and Fang, Lu and Bai, Junjie and Chintala, Soumith},
|
| 106 |
+
booktitle={Advances in Neural Information Processing Systems 32},
|
| 107 |
+
year={2019}
|
| 108 |
+
}
|
| 109 |
+
```
|