Spaces:

matthoffner
/

serp-chat

Paused

matthoffner commited on May 26, 2023

Commit

9c61a23

1 Parent(s): f18c295

Update llm.py

Files changed (1) hide show

llm.py CHANGED Viewed

@@ -186,7 +186,7 @@ def ask_ai(
         -20000
     )
     llm = LlamaCpp(model_path=model_path,
-        n_ctx=4096,
         use_mlock=True,
         n_parts=-1,
         temperature=temprature,

         -20000
     )
     llm = LlamaCpp(model_path=model_path,
+        n_ctx=2048,
         use_mlock=True,
         n_parts=-1,
         temperature=temprature,