Spaces:

Ankitajadhav
/

Whats_Cooking

Runtime error

Ankitajadhav commited on Jul 8, 2024

Commit

4dde30e

verified ·

1 Parent(s): c4d11f6

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -15,7 +15,7 @@ try:
     llm = Llama(
         # model_path="./models/Phi-3-mini-4k-instruct-gguf",
         # model_path = "./models/Phi-3-mini-4k-instruct-q4.gguf",
-        model_path = "microsoft/Phi-3-mini-4k-instruct-gguf"
         n_ctx=2048,
         n_gpu_layers=50,  # Adjust based on your VRAM
     )

     llm = Llama(
         # model_path="./models/Phi-3-mini-4k-instruct-gguf",
         # model_path = "./models/Phi-3-mini-4k-instruct-q4.gguf",
+        model_path = "microsoft/Phi-3-mini-4k-instruct-gguf",
         n_ctx=2048,
         n_gpu_layers=50,  # Adjust based on your VRAM
     )