I asked it how many R in strawberry
#29
by SomePersonAlt - opened
It answered 'rhododendron'. what?
lol What... try to play with these # Generate response
with torch.no_grad():
outputs = model.generate(inputs["input_ids"], max_length=200, temperature=0.7, top_k=50, top_p=0.95)
im on mobile using hf inference widget :/