esm-bind (head-only checkpoint)

A ~7.8M-parameter bidirectional cross-attention head over frozen ESM-2 650M and RNA-FM for protein--RNA binding prediction. This repo holds only the trainable head (fp32, ~31 MB); the two frozen encoders are rebuilt from the Hub at load time at the exact revisions the head was trained against:

• protein encoder: facebook/esm2_t33_650M_UR50D @ 08e4846e537177426273712802403f7ba8261b6c
• RNA encoder: multimolecule/rnafm @ bcf7cc6e8f4385449c0288b3e1f41f21d68f1be3

Zero-shot AUROC 0.840 [0.832, 0.848] on RPI7317 (protein-disjoint), obtained without any supervised training on that benchmark.

Loading

See the reproduction instructions and loading code at https://github.com/ethanarnold/esm-bind (make bench reproduces the 0.840 number end-to-end).

File

• s2_ep04.head_only.pt -- production S2 epoch-04 head weights + ESMBindConfig.