This repo collects GGUF models which are converted from Qwen/Qwen3-4B-Instruct-2507 with llama.cpp and ggml-org/gguf-my-repo
- Downloads last month
- 10
Hardware compatibility
Log In to add your hardware
3-bit
4-bit
5-bit
6-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support