File size: 1,501 Bytes
db2462a 363e4f1 db2462a 363e4f1 db2462a 363e4f1 db2462a c7cbbd2 280a94d 363e4f1 280a94d 363e4f1 db2462a c7cbbd2 db2462a c7cbbd2 363e4f1 280a94d 363e4f1 db2462a 363e4f1 db2462a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 | ---
license: mit
library_name: transformers
pipeline_tag: text-generation
base_model: UCL-CSSB/PlasmidGPT
tags:
- biology
- plasmid
- dna
- synthetic-biology
- gpt2
- grpo
- reinforcement-learning
---
# PlasmidGPT-GRPO
GRPO reinforcement-learning fine-tune of [PlasmidGPT](https://huggingface.co/UCL-CSSB/PlasmidGPT), trained against a multi-component biological reward (functional annotations, length prior, repeat penalty, cassette ordering). Camera-ready model for the ICML 2026 paper *Effects of Structural Reward Shaping on Biophysical Properties in RL-Trained Plasmid Generators*.
## Quick start
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("UCL-CSSB/PlasmidGPT-GRPO")
tokenizer = AutoTokenizer.from_pretrained("UCL-CSSB/PlasmidGPT-GRPO")
input_ids = tokenizer("ATG", return_tensors="pt").input_ids
outputs = model.generate(input_ids, max_new_tokens=512, do_sample=True, temperature=1.0)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
```
Recommended sampling: T=1.0 for direct generation, T=1.15 for rejection sampling (per the paper).
## Citation
```bibtex
@inproceedings{thiel2026plasmidrl,
title = {Effects of Structural Reward Shaping on Biophysical Properties in {RL}-Trained Plasmid Generators},
author = {Thiel, McClain and Cunningham, Angus G. and Barnes, Chris P.},
booktitle = {Proceedings of the 43rd International Conference on Machine Learning},
year = {2026}
}
```
|