Glm 4 9B
Forkjoin.ai conversion of glm-4-9b-gguf to GGUF format for edge deployment.
Model Details
- Source Model: See upstream
- Format: GGUF
- Converted by: Forkjoin.ai
Usage
With llama.cpp
./llama-cli -m glm-4-9b-gguf.gguf -p "Your prompt here" -n 256
With Ollama
Create a Modelfile:
FROM ./glm-4-9b-gguf.gguf
ollama create glm-4-9b-gguf -f Modelfile
ollama run glm-4-9b-gguf
About Forkjoin.ai
Forkjoin.ai runs AI models at the edge -- in-browser, on-device, zero cloud cost. These converted models power real-time inference, speech recognition, and natural language capabilities.
All conversions are optimized for edge deployment within browser and mobile memory constraints.
License
Apache 2.0 (follows upstream model license)
- Downloads last month
- 48
Hardware compatibility
Log In to add your hardware
4-bit