This model is converted from zai-org/AutoGLM-Phone-9B to GGUF using convert_hf_to_gguf.py
convert_hf_to_gguf.py
To use it:
llama-server -hf ggml-org/AutoGLM-Phone-9B-GGUF
Chat template
4-bit
Base model