update to TriProRep title + arXiv citation
Browse files
README.md
CHANGED
|
@@ -11,26 +11,27 @@ tags:
|
|
| 11 |
# triprorep-35M
|
| 12 |
|
| 13 |
Structure-aware protein encoder, 35M parameters. ELECTRA-style corrective
|
| 14 |
-
MLM pre-training on
|
| 15 |
-
|
| 16 |
-
|
| 17 |
|
| 18 |
Architecture: `embed_dim=480`, `encoder_depth=10`, `encoder_heads=20`.
|
| 19 |
|
| 20 |
-
Part of the [
|
|
|
|
| 21 |
|
| 22 |
## Files
|
| 23 |
|
| 24 |
- `35M.ckpt`: full Lightning checkpoint.
|
| 25 |
- `config.yaml`: model + data config. The path fields are placeholders, point them at your local data.
|
| 26 |
-
- `backbone_tokenizer.pt`, `fullatom_tokenizer.pt`: structure tokenizers (PDB
|
| 27 |
|
| 28 |
## Usage
|
| 29 |
|
| 30 |
```bash
|
| 31 |
pip install torch huggingface_hub omegaconf numpy lmdb biotite
|
| 32 |
-
git clone https://github.com/
|
| 33 |
-
cd
|
| 34 |
```
|
| 35 |
|
| 36 |
```python
|
|
@@ -44,7 +45,7 @@ print(features.shape) # (L, 480) fp16
|
|
| 44 |
```
|
| 45 |
|
| 46 |
`embed_pdb` downloads the bundled tokenizers from this repo on first call,
|
| 47 |
-
then runs PDB
|
| 48 |
IDs (e.g. from `k-fold-structure/repsp-triprorep-tokens`), call
|
| 49 |
`encode(encoder, seq, bb, fa)` directly. For CPU, pass `device="cpu"` to
|
| 50 |
`load_encoder`.
|
|
@@ -57,11 +58,14 @@ IDs (e.g. from `k-fold-structure/repsp-triprorep-tokens`), call
|
|
| 57 |
## Citation
|
| 58 |
|
| 59 |
```bibtex
|
| 60 |
-
@misc{
|
| 61 |
-
title = {
|
| 62 |
-
author = {
|
| 63 |
year = {2026},
|
| 64 |
-
|
|
|
|
|
|
|
|
|
|
| 65 |
}
|
| 66 |
```
|
| 67 |
|
|
|
|
| 11 |
# triprorep-35M
|
| 12 |
|
| 13 |
Structure-aware protein encoder, 35M parameters. ELECTRA-style corrective
|
| 14 |
+
MLM pre-training on protein structures. The encoder reads three per-residue
|
| 15 |
+
token streams (seq / bb / fa) and outputs a per-residue embedding of
|
| 16 |
+
dimension `480` (fp16).
|
| 17 |
|
| 18 |
Architecture: `embed_dim=480`, `encoder_depth=10`, `encoder_heads=20`.
|
| 19 |
|
| 20 |
+
Part of the [TriProRep release](https://github.com/hsjang0/TriProRep).
|
| 21 |
+
Paper: [Atom-level Protein Representation Learning Improves Protein Structure Prediction](https://arxiv.org/abs/2605.22133) (arXiv:2605.22133).
|
| 22 |
|
| 23 |
## Files
|
| 24 |
|
| 25 |
- `35M.ckpt`: full Lightning checkpoint.
|
| 26 |
- `config.yaml`: model + data config. The path fields are placeholders, point them at your local data.
|
| 27 |
+
- `backbone_tokenizer.pt`, `fullatom_tokenizer.pt`: structure tokenizers (PDB to token IDs). See Acknowledgements.
|
| 28 |
|
| 29 |
## Usage
|
| 30 |
|
| 31 |
```bash
|
| 32 |
pip install torch huggingface_hub omegaconf numpy lmdb biotite
|
| 33 |
+
git clone https://github.com/hsjang0/TriProRep.git
|
| 34 |
+
cd TriProRep
|
| 35 |
```
|
| 36 |
|
| 37 |
```python
|
|
|
|
| 45 |
```
|
| 46 |
|
| 47 |
`embed_pdb` downloads the bundled tokenizers from this repo on first call,
|
| 48 |
+
then runs PDB to (seq, bb, fa) tokens to encoder. If you already have token
|
| 49 |
IDs (e.g. from `k-fold-structure/repsp-triprorep-tokens`), call
|
| 50 |
`encode(encoder, seq, bb, fa)` directly. For CPU, pass `device="cpu"` to
|
| 51 |
`load_encoder`.
|
|
|
|
| 58 |
## Citation
|
| 59 |
|
| 60 |
```bibtex
|
| 61 |
+
@misc{triprorep,
|
| 62 |
+
title = {Atom-level Protein Representation Learning Improves Protein Structure Prediction},
|
| 63 |
+
author = {Kim, Taewon and Jang, Hyosoon and Seo, Hyunjin and Seo, Seonghwan and Kim, Hyeongwoo and Zhung, Wonho and Shin, Mingyeong and Kim, Wooyoun and Ahn, Sungsoo},
|
| 64 |
year = {2026},
|
| 65 |
+
eprint = {2605.22133},
|
| 66 |
+
archivePrefix = {arXiv},
|
| 67 |
+
primaryClass = {cs.LG},
|
| 68 |
+
url = {https://arxiv.org/abs/2605.22133}
|
| 69 |
}
|
| 70 |
```
|
| 71 |
|