runtime error
Exit code: 1. Reason: = 248044 '<|endoftext|>' print_info: LF token = 198 'Ċ' print_info: FIM PRE token = 248060 '<|fim_prefix|>' print_info: FIM SUF token = 248062 '<|fim_suffix|>' print_info: FIM MID token = 248061 '<|fim_middle|>' print_info: FIM PAD token = 248063 '<|fim_pad|>' print_info: FIM REP token = 248064 '<|repo_name|>' print_info: FIM SEP token = 248065 '<|file_sep|>' print_info: EOG token = 248044 '<|endoftext|>' print_info: EOG token = 248046 '<|im_end|>' print_info: EOG token = 248063 '<|fim_pad|>' print_info: EOG token = 248064 '<|repo_name|>' print_info: EOG token = 248065 '<|file_sep|>' print_info: max token length = 256 load_tensors: loading model tensors, this can take a while... (mmap = true, direct_io = false) llama_model_load: error loading model: missing tensor 'blk.24.ssm_conv1d.weight' llama_model_load_from_file_impl: failed to load model common_init_from_params: failed to load model '/home/user/.cache/llama.cpp/bartowski_Qwen_Qwen3.5-0.8B-GGUF_Qwen_Qwen3.5-0.8B-Q4_K_M.gguf' srv load_model: failed to load model, '/home/user/.cache/llama.cpp/bartowski_Qwen_Qwen3.5-0.8B-GGUF_Qwen_Qwen3.5-0.8B-Q4_K_M.gguf' srv operator(): operator(): cleaning up before exit... main: exiting due to model loading error [32m2026-05-30 14:34:27.281[0m | [31m[1mERROR [0m | [36mllama_cpp_py.server.sync[0m:[36mwait_for_server_ready[0m:[36m132[0m - [31m[1mllama.cpp process exited unexpectedly with code 1[0m [32m2026-05-30 14:34:27.281[0m | [1mINFO [0m | [36mllama_cpp_py.server.sync[0m:[36mstop[0m:[36m115[0m - [1mllama.cpp server stopped[0m Traceback (most recent call last): File "/app/app.py", line 18, in <module> llama_server.start() File "/usr/local/lib/python3.12/site-packages/llama_cpp_py/server/sync.py", line 102, in start raise TimeoutError('Server did not start within the allotted time') TimeoutError: Server did not start within the allotted time
Container logs:
Fetching error logs...