Hugging Face's logo

ethanarnold
/
esm-bind

PyTorch
protein-rna-binding
foundation-models
frozen-encoders
esm2
rna-fm
Model card Files
xet
 Community
esm-bind / README.md
ethanarnold's picture
ethanarnold
Upload README.md with huggingface_hub
6541ce3 verified
preview code
|
Raw
History Blame Contribute Delete
1.04 kB
metadata 
license: mit
library_name: pytorch
tags:
  - protein-rna-binding
  - foundation-models
  - frozen-encoders
  - esm2
  - rna-fm

esm-bind (head-only checkpoint)

A ~7.8M-parameter bidirectional cross-attention head over frozen ESM-2 650M and RNA-FM for protein--RNA binding prediction. This repo holds only the trainable head (fp32, ~31 MB); the two frozen encoders are rebuilt from the Hub at load time at the exact revisions the head was trained against:

  • protein encoder: facebook/esm2_t33_650M_UR50D @ 08e4846e537177426273712802403f7ba8261b6c
  • RNA encoder: multimolecule/rnafm @ bcf7cc6e8f4385449c0288b3e1f41f21d68f1be3

Zero-shot AUROC 0.840 [0.832, 0.848] on RPI7317 (protein-disjoint), obtained without any supervised training on that benchmark.

Loading

See the reproduction instructions and loading code at https://github.com/ethanarnold/esm-bind (make bench reproduces the 0.840 number end-to-end).

File

  • s2_ep04.head_only.pt -- production S2 epoch-04 head weights + ESMBindConfig.