fraQtl/qwen3-4b-instruct-2507-kv-sidecars
Updated • 28 • 1
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
22
Active filters: fraqtl
fraQtl/Qwen3.8-27B-Hi-Fi-GGUF
Text Generation • 27B • Updated • 298 • 2
qualcomm-ai-hub-community/Qwen3-4B-Instruct-2507-Hi-Fi-fraQtl
Text Generation • 4B • Updated • 121 • 1
mradermacher/Mistral-7B-compressed-GGUF
7B • Updated • 131
mradermacher/Mistral-7B-compressed-i1-GGUF
7B • Updated • 205
fraQtl/Qwen3.6-35B-A3B-compressed
Text Generation • 2B • Updated • 370 • 6
mradermacher/TinyLlama-1.1B-optimized-GGUF
1B • Updated • 72
mradermacher/TinyLlama-1.1B-optimized-i1-GGUF
1B • Updated • 229
mradermacher/Qwen-2.5-3B-optimized-GGUF
3B • Updated • 108
mradermacher/Llama-3.2-3B-optimized-GGUF
3B • Updated • 40
mradermacher/Qwen-2.5-3B-optimized-i1-GGUF
3B • Updated • 134
mradermacher/Llama-3.2-3B-optimized-i1-GGUF
3B • Updated • 211 • 1
fraQtl/Qwen3.6-35B-A3B-Hi-Fi-GGUF
Text Generation • 35B • Updated • 1.97k • 4
fraQtl/mistral-7b-instruct-v0.3-kv-sidecars
Updated • 15
fraQtl/fraqtl-sm80-runtime
Updated • 11
fraQtl/Gemma-4-E2B-it-Hi-Fi-GGUF
Text Generation • 5B • Updated • 7.8k • 18
fraQtl/Gemma-4-26B-A4B-it-Hi-Fi-GGUF
Text Generation • 25B • Updated • 261 • 1
fraQtl/Llama-3.2-1B-Instruct-Hi-Fi-GGUF
Text Generation • 1B • Updated • 150
fraQtl/Llama-3.1-8B-Instruct-Hi-Fi-GGUF
Text Generation • 8B • Updated • 164
fraQtl/Qwen3-4B-Instruct-2507-Hi-Fi-GGUF
Text Generation • 4B • Updated • 90
fraQtl/fraqtl-membrane-llamacpp-runtime
Updated
fraQtl/mistral-nemo-instruct-2407-kv-sidecars
Updated