Spaces:

madox81
/

Small_Cyber

Sleeping

madox81 commited on Apr 1

Commit

0fca75a

verified ·

1 Parent(s): a0aecff

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -67,7 +67,7 @@ class LLM:
         # 3. Load Base Model
         self.model = AutoModelForCausalLM.from_pretrained(
             model_id,
-            gguf_file=filename
             torch_dtype=dtype,
             device_map=device_map
         )

         # 3. Load Base Model
         self.model = AutoModelForCausalLM.from_pretrained(
             model_id,
+            gguf_file=filename,
             torch_dtype=dtype,
             device_map=device_map
         )