Glm 4 9B

Forkjoin.ai conversion of glm-4-9b-gguf to GGUF format for edge deployment.

Model Details

Usage

With llama.cpp

./llama-cli -m glm-4-9b-gguf.gguf -p "Your prompt here" -n 256

With Ollama

Create a Modelfile:

FROM ./glm-4-9b-gguf.gguf
ollama create glm-4-9b-gguf -f Modelfile
ollama run glm-4-9b-gguf

About Forkjoin.ai

Forkjoin.ai runs AI models at the edge -- in-browser, on-device, zero cloud cost. These converted models power real-time inference, speech recognition, and natural language capabilities.

All conversions are optimized for edge deployment within browser and mobile memory constraints.

License

Apache 2.0 (follows upstream model license)

Downloads last month
48
GGUF
Model size
9B params
Architecture
chatglm
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support