Spaces:

2012hhh2012
/

SmolLM2-135M-Instruct

Sleeping

2012hhh2012 commited on Jun 11

Commit

5d09706

verified ·

1 Parent(s): 7f05c49

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -5,6 +5,7 @@ llm = Llama.from_pretrained(
     repo_id="HackNetAyush/smollm2-135M-instruct-gguf-q8",
     filename="smollm2-135m-instruct-q8_0.gguf",
     n_ctx=8192,
     n_threads=2,
     verbose=False,
 )

     repo_id="HackNetAyush/smollm2-135M-instruct-gguf-q8",
     filename="smollm2-135m-instruct-q8_0.gguf",
     n_ctx=8192,
+    n_batch=1024,
     n_threads=2,
     verbose=False,
 )