How to use qgyd2021/reward_model_gpt2_stack_exchange with Adapters:
from adapters import AutoAdapterModel model = AutoAdapterModel.from_pretrained("undefined") model.load_adapter("qgyd2021/reward_model_gpt2_stack_exchange", set_active=True)
SFconvertbot