Spaces:

arshitmalik
/

yt-flow

Sleeping

Arshit Malik commited on May 6

Commit

caed18e

1 Parent(s): f9f72e5

fix: force --only-binary for llama-cpp-python on Kaggle Python 3.12

Files changed (1) hide show

kaggle_llm_template.py CHANGED Viewed

@@ -61,7 +61,7 @@ llm = Llama(
     n_batch=256,
     n_ubatch=256,
     flash_attn=False,
-    offload_kqv=False  # CPU mode,
     type_k="q4_0",
     type_v="q4_0",
     verbose=False)

     n_batch=256,
     n_ubatch=256,
     flash_attn=False,
+    offload_kqv=False  # CPU mode  # CPU mode,
     type_k="q4_0",
     type_v="q4_0",
     verbose=False)