hyosoon0 commited on
Commit
1009efb
·
verified ·
1 Parent(s): c41921d

update to TriProRep title + arXiv citation

Browse files
Files changed (1) hide show
  1. README.md +16 -12
README.md CHANGED
@@ -11,26 +11,27 @@ tags:
11
  # triprorep-35M
12
 
13
  Structure-aware protein encoder, 35M parameters. ELECTRA-style corrective
14
- MLM pre-training on 83.6M ATLAS + PDB structures. The encoder reads three
15
- per-residue token streams (seq / bb / fa) and outputs a per-residue embedding
16
- of dimension `480` (fp16).
17
 
18
  Architecture: `embed_dim=480`, `encoder_depth=10`, `encoder_heads=20`.
19
 
20
- Part of the [k-fold-structure release](https://github.com/<github-org>/k-fold-structure-release).
 
21
 
22
  ## Files
23
 
24
  - `35M.ckpt`: full Lightning checkpoint.
25
  - `config.yaml`: model + data config. The path fields are placeholders, point them at your local data.
26
- - `backbone_tokenizer.pt`, `fullatom_tokenizer.pt`: structure tokenizers (PDB token IDs). See Acknowledgements.
27
 
28
  ## Usage
29
 
30
  ```bash
31
  pip install torch huggingface_hub omegaconf numpy lmdb biotite
32
- git clone https://github.com/<github-org>/k-fold-structure-release.git
33
- cd k-fold-structure-release
34
  ```
35
 
36
  ```python
@@ -44,7 +45,7 @@ print(features.shape) # (L, 480) fp16
44
  ```
45
 
46
  `embed_pdb` downloads the bundled tokenizers from this repo on first call,
47
- then runs PDB (seq, bb, fa) tokens encoder. If you already have token
48
  IDs (e.g. from `k-fold-structure/repsp-triprorep-tokens`), call
49
  `encode(encoder, seq, bb, fa)` directly. For CPU, pass `device="cpu"` to
50
  `load_encoder`.
@@ -57,11 +58,14 @@ IDs (e.g. from `k-fold-structure/repsp-triprorep-tokens`), call
57
  ## Citation
58
 
59
  ```bibtex
60
- @misc{kfoldstructure,
61
- title = {K-Fold Structure: Structure-Aware Protein Encoders and a Per-Residue Representation Benchmark},
62
- author = {<authors>},
63
  year = {2026},
64
- url = {https://huggingface.co/k-fold-structure}
 
 
 
65
  }
66
  ```
67
 
 
11
  # triprorep-35M
12
 
13
  Structure-aware protein encoder, 35M parameters. ELECTRA-style corrective
14
+ MLM pre-training on protein structures. The encoder reads three per-residue
15
+ token streams (seq / bb / fa) and outputs a per-residue embedding of
16
+ dimension `480` (fp16).
17
 
18
  Architecture: `embed_dim=480`, `encoder_depth=10`, `encoder_heads=20`.
19
 
20
+ Part of the [TriProRep release](https://github.com/hsjang0/TriProRep).
21
+ Paper: [Atom-level Protein Representation Learning Improves Protein Structure Prediction](https://arxiv.org/abs/2605.22133) (arXiv:2605.22133).
22
 
23
  ## Files
24
 
25
  - `35M.ckpt`: full Lightning checkpoint.
26
  - `config.yaml`: model + data config. The path fields are placeholders, point them at your local data.
27
+ - `backbone_tokenizer.pt`, `fullatom_tokenizer.pt`: structure tokenizers (PDB to token IDs). See Acknowledgements.
28
 
29
  ## Usage
30
 
31
  ```bash
32
  pip install torch huggingface_hub omegaconf numpy lmdb biotite
33
+ git clone https://github.com/hsjang0/TriProRep.git
34
+ cd TriProRep
35
  ```
36
 
37
  ```python
 
45
  ```
46
 
47
  `embed_pdb` downloads the bundled tokenizers from this repo on first call,
48
+ then runs PDB to (seq, bb, fa) tokens to encoder. If you already have token
49
  IDs (e.g. from `k-fold-structure/repsp-triprorep-tokens`), call
50
  `encode(encoder, seq, bb, fa)` directly. For CPU, pass `device="cpu"` to
51
  `load_encoder`.
 
58
  ## Citation
59
 
60
  ```bibtex
61
+ @misc{triprorep,
62
+ title = {Atom-level Protein Representation Learning Improves Protein Structure Prediction},
63
+ author = {Kim, Taewon and Jang, Hyosoon and Seo, Hyunjin and Seo, Seonghwan and Kim, Hyeongwoo and Zhung, Wonho and Shin, Mingyeong and Kim, Wooyoun and Ahn, Sungsoo},
64
  year = {2026},
65
+ eprint = {2605.22133},
66
+ archivePrefix = {arXiv},
67
+ primaryClass = {cs.LG},
68
+ url = {https://arxiv.org/abs/2605.22133}
69
  }
70
  ```
71