Hugging Face's logo

Spaces:
ujalaarshad17
/
SQLGPT
Sleeping

App Files Community
ujalaarshad17 commited on
Commit
19767b2
·
1 Parent(s): cf589b2

increased worker threads

Browse files
Files changed (1) hide show
  1. main.py +0 -1
main.py CHANGED
@@ -6,7 +6,6 @@ import logging
6
  llm = Llama(
7
  model_path="./quantized_model/sql_gpt_quantized.gguf",
8
  n_ctx=512,
9
- n_threads=2,
10
  n_gpu_layers=-1
11
  )
12
 
 
6
  llm = Llama(
7
  model_path="./quantized_model/sql_gpt_quantized.gguf",
8
  n_ctx=512,
 
9
  n_gpu_layers=-1
10
  )
11