Update MODEL_PATH to Q8_K_P, add threading + reasoning flags c9e75fc verified NanoBotAIAgent commited on 6 days ago
Use local pre-downloaded model and start uvicorn proxy 86793e1 verified NanoBotAIAgent commited on 26 days ago