Mistral-7B-OpenOrca-GGUF

Runtime error

limcheekin commited on Dec 8, 2023

Commit

b27b821

1 Parent(s): 94e3839

chore: added chat_format

Files changed (1) hide show

main.py CHANGED Viewed

@@ -6,7 +6,8 @@ app = create_app(
     Settings(
         n_threads=2,  # set to number of cpu cores
         model="model/gguf-model.bin",
-        embedding=True
     )
 )

     Settings(
         n_threads=2,  # set to number of cpu cores
         model="model/gguf-model.bin",
+        embedding=True,
+        chat_format="chatml"
     )
 )