---
language:
- en
base_model:
- facebook/esm2_t6_8M_UR50D
---
This repository contains models from the paper "Protein Circuit Tracing via Cross-Layer Transcoders" by Darin Tsui, Kunal Talreja, Danial Saeedi, and Amirali Aghazadeh,to be presented at ICML 2026. You can find the preprint [here](https://arxiv.org/abs/2602.12026).

# ProtoMech Models
1. `CLT_L{num_layers}_D{clt_dim}`: CLT model with checkpoints. Can be loaded with `CLT_L{num_layers}_D{clt_dim}/checkpoints/last.ckpt`
2. `PLT_L{num_layers}_D{plt_dim}`: PLT model with checkpoints. Can be loaded with `PLT_L{num_layers}_D{clt_dim}/checkpoints/last.ckpt`
3. `esm2_t6_8M_UR50D.pt`: Base ESM model used for experiments (same for `esm2_t12_35M_UR50D.pt`)
4. `eval_models`: CNN evaluation models used for probe steering, one per DMS assay (same for `eval_models_35M`)
5. `probe`: probe evaluation models for function circuit, one per DMS assay and split configuration