Spaces:

Elijahbodden
/

llama.cpp

Runtime error

Elijahbodden commited on May 27, 2024

Commit

3bb24fe

verified ·

1 Parent(s): dcf50a3

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -96,7 +96,7 @@ def respond(
     response = ""
-    print(messages)
     convo = tokenizer.apply_chat_template(messages, tokenize=True)
     for message in model.create_completion(

     response = ""
+    print(tokenizer.apply_chat_template(messages, tokenize=False))
     convo = tokenizer.apply_chat_template(messages, tokenize=True)
     for message in model.create_completion(