How to prevent hallucinations
#2
by JLouisBiz - opened
Updated Settings:
Predictions: 2048
Temperature: 0.5
Penalize Repeat Sequence: 1.1
Consider N Tokens for Penalize: 256
Top-K Sampling: 50
Top-P Sampling: 0.9
Min-P Sampling: 1
I have tried updating those settings, but is not good. I wish to prevent hallucinations. All I need is text summary. But I get good begin of summary followed by large number of repetitive single words, or something.