RLHF Trojan Competition
Collection
Datasets and models used for the trojan detection competition co-located at SaTML 2024: https://github.com/ethz-spylab/rlhf_trojan_competition • 20 items • Updated • 4
How to use ethz-spylab/competition_reward_trojan2 with Transformers:
# Load model directly
from transformers import AutoTokenizer, LlamaModelForScore
tokenizer = AutoTokenizer.from_pretrained("ethz-spylab/competition_reward_trojan2")
model = LlamaModelForScore.from_pretrained("ethz-spylab/competition_reward_trojan2")YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
This reward model was used to align this generation model for the trojan detection competition co-located at SaTML 2024. For more information, visit the official competition website