Doesn't work - should wait for PR #19283
#2
by
ddh0
- opened
These GGUFs no longer work - we should wait for the PR to be officially merged, and then need to reconvert: https://github.com/ggml-org/llama.cpp/pull/19283
llama_model_load: error loading model: error loading model hyperparameters: key not found in model: step35.swiglu_clamp_exp
llama_model_load_from_file_impl: failed to load model
common_init_from_params: failed to load model '/media/T9/gguf/Step-3.5-Flash-Q4_K_S-00001-of-00003.gguf'
srv load_model: failed to load model, '/media/T9/gguf/Step-3.5-Flash-Q4_K_S-00001-of-00003.gguf'
srv operator(): operator(): cleaning up before exit...
main: exiting due to model loading error