Gemma 3 4B It
Forkjoin.ai conversion of google/gemma-3-4b-it to GGUF format for edge deployment.
Model Details
- Source Model: google/gemma-3-4b-it
- Format: GGUF
- Converted by: Forkjoin.ai
Usage
With llama.cpp
./llama-cli -m gemma-3-4b-it-gguf.gguf -p "Your prompt here" -n 256
With Ollama
Create a Modelfile:
FROM ./gemma-3-4b-it-gguf.gguf
ollama create gemma-3-4b-it-gguf -f Modelfile
ollama run gemma-3-4b-it-gguf
About Forkjoin.ai
Forkjoin.ai runs AI models at the edge -- in-browser, on-device, zero cloud cost. These converted models power real-time inference, speech recognition, and natural language capabilities.
All conversions are optimized for edge deployment within browser and mobile memory constraints.
License
Apache 2.0 (follows upstream model license)
- Downloads last month
- 105
Hardware compatibility
Log In to add your hardware
4-bit