future-html

Build error

aadya1762 commited on Mar 22, 2025

Commit

e96d38d

1 Parent(s): 603cefc

bug fixes

Files changed (1) hide show

gemmademo/_model.py CHANGED Viewed

@@ -111,7 +111,7 @@ class LlamaCppGemmaModel:
             n_gpu_layers=n_gpu_layers,
             n_batch=8,
             verbose=False,
-            chat_format="chatml",
         )
         self.messages.append(_sys_prompt)

             n_gpu_layers=n_gpu_layers,
             n_batch=8,
             verbose=False,
+            chat_format="gemma",
         )
         self.messages.append(_sys_prompt)