Spaces:

Sumkh
/

AgenticRAG

Sleeping

Sumkh commited on Feb 24, 2025

Commit

f625bfd

verified ·

1 Parent(s): 0ab44fe

Update start.sh

Files changed (1) hide show

start.sh CHANGED Viewed

@@ -15,7 +15,6 @@ vllm serve unsloth/llama-3-8b-Instruct-bnb-4bit \
   --quantization bitsandbytes \
   --load-format bitsandbytes \
   --dtype half \
-  --ipc=host \
   --max-model-len 8192 &
 # Wait to ensure the vLLM server is fully started (adjust if needed)

   --quantization bitsandbytes \
   --load-format bitsandbytes \
   --dtype half \
   --max-model-len 8192 &
 # Wait to ensure the vLLM server is fully started (adjust if needed)