Loves to leak prompt at Q5_K_M
#1
by BingoBird - opened
With an extended directional prompt, it can do little else but regurgitate the prompt.
llama-server -m Trinity-Nano-Preview.i1-Q5_K_M.gguf -t 5 -c 4096 -fa auto --context-shift --jinja -ngl 99
Without the custom system prompt it is bright, sharp but squirrely.
I'm going to need a llm to evaluate llms.