File size: 837 Bytes
cc7bbe4 c081146 cc7bbe4 b4b36fa cc7bbe4 b4b36fa cc7bbe4 3e877f3 cc7bbe4 b4b36fa cc7bbe4 b4b36fa | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 | ---
library_name: transformers
datasets:
- nvidia/Aegis-AI-Content-Safety-Dataset-2.0
language:
- en
base_model:
- openai-community/gpt2
---
### How to use
```py
from transformers import AutoTokenizer
from trl import AutoModelForCausalLMWithValueHead
import torch
tokenizer = AutoTokenizer.from_pretrained("entfane/gpt2_constitutional_classifier_with_value_head")
model = AutoModelForCausalLMWithValueHead.from_pretrained("entfane/gpt2_constitutional_classifier_with_value_head", device_map = "cuda")
messages = [{"role":"system", "content": ""},
{"role":"user", "content": "How are you doing?"},
{"role":"assistant", "content": "I am good"}]
input = tokenizer.apply_chat_template(messages, tokenize = True, return_tensors = "pt").to('cuda')
_, _, values = model(**input)
print(torch.sigmoid(values))
``` |