This model was converted and quantized using the official tools provided by llama.cpp.
Serving:
./build/bin/llama-server -m /models/AutoGLM-Phone-9B-Q4_K_M.gguf -ngl 999
- Downloads last month
- 48
Hardware compatibility
Log In to add your hardware
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for yeahdongcn/AutoGLM-Phone-9B-Q4_K_M-GGUF
Base model
zai-org/GLM-4-9B-0414
Finetuned
zai-org/GLM-4.1V-9B-Base
Finetuned
zai-org/AutoGLM-Phone-9B