Fill-Mask
Transformers
Safetensors
ESMplusplus
custom_code
lhallee commited on
Commit
fbb45d0
·
verified ·
1 Parent(s): b7e37b1

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +38 -8
README.md CHANGED
@@ -31,14 +31,44 @@ config = AutoConfig.from_pretrained('Synthyra/ESMplusplus_small', trust_remote_c
31
  config.attn_backend = "flex" # or "kernels_flash", "sdpa", "auto"
32
  model = AutoModelForMaskedLM.from_pretrained('Synthyra/ESMplusplus_small', config=config, trust_remote_code=True)
33
  ```
34
-
35
- `torch.compile(model)` is heavily recommended for sustained throughput, especially with Flex Attention.
36
-
37
-
38
- ## Use with Hugging Face Transformers
39
- ```python
40
- from transformers import AutoModelForMaskedLM
41
- model = AutoModelForMaskedLM.from_pretrained('Synthyra/ESMplusplus_small', trust_remote_code=True)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
42
  tokenizer = model.tokenizer
43
 
44
  sequences = ['MPRTEIN', 'MSEQWENCE']
 
31
  config.attn_backend = "flex" # or "kernels_flash", "sdpa", "auto"
32
  model = AutoModelForMaskedLM.from_pretrained('Synthyra/ESMplusplus_small', config=config, trust_remote_code=True)
33
  ```
34
+
35
+ `torch.compile(model)` is heavily recommended for sustained throughput, especially with Flex Attention.
36
+
37
+ ## Binder Design Regularizer
38
+
39
+ The FastPLMs binder design tutorial uses the ESM++ model family as the
40
+ masked-LM pseudoperplexity regularizer while FastPLMs ESMFold2 experimental
41
+ models provide differentiable folding losses and final critics. The verified
42
+ EGFR example defaults to `Synthyra/ESMplusplus_6B`; this 300M checkpoint exposes
43
+ the same `AutoModelForMaskedLM` API and can be used as a lower-memory
44
+ regularizer by editing `FastPLMsBinderDesign.lm_name` in
45
+ `cookbook/tutorials/binder_design_fastplms.py`.
46
+
47
+ Default verified run:
48
+
49
+ ```bash
50
+ python cookbook/tutorials/binder_design_fastplms.py \
51
+ --backend local \
52
+ --target-name egfr \
53
+ --binder-sequence '################################################################################################################################' \
54
+ --not-antibody \
55
+ --steps 150 \
56
+ --batch-size 1 \
57
+ --seed 103 \
58
+ --output-dir binder_design_egfr_len128_seed103
59
+ ```
60
+
61
+ The verified 6B-regularized result had hero mean iPTM `0.913870`, hero min iPTM
62
+ `0.904600`, and all four ESMFold2 hero critics above `0.9`.
63
+
64
+ See [`docs/binder_design.md`](https://github.com/Synthyra/FastPLMs/blob/main/docs/binder_design.md)
65
+ for the complete workflow, output files, metrics, and Modal/local compute
66
+ options.
67
+
68
+ ## Use with Hugging Face Transformers
69
+ ```python
70
+ from transformers import AutoModelForMaskedLM
71
+ model = AutoModelForMaskedLM.from_pretrained('Synthyra/ESMplusplus_small', trust_remote_code=True)
72
  tokenizer = model.tokenizer
73
 
74
  sequences = ['MPRTEIN', 'MSEQWENCE']