Spaces:

Elijahbodden
/

llama.cpp

Runtime error

Elijahbodden commited on May 26, 2024

Commit

31e2bd9

verified ·

1 Parent(s): e0f5396

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -101,7 +101,7 @@ def respond(
         temperature=temperature,
         stream=True,
         stop=["<|im_end|>"],
-        mirostat_mode=1,
         mirostat_tau=mirostat_tau,
         mirostat_eta=mirostat_eta,
         max_tokens=max_tokens,

         temperature=temperature,
         stream=True,
         stop=["<|im_end|>"],
+        mirostat_mode=2,
         mirostat_tau=mirostat_tau,
         mirostat_eta=mirostat_eta,
         max_tokens=max_tokens,