QuantFactory/OpenCoder-8B-Instruct-GGUF
Text Generation • 8B • Updated • 800 • 6
Ollama-ready Coding Models
For inference. CPU is enough for both quantization and inference.
-
-
QuantFactory/OpenCoder-8B-Base-GGUF
Text Generation • 8B • Updated • 423 • 4 -
bartowski/starcoder2-15b-instruct-GGUF
Text Generation • 16B • Updated • 583 • 5 -
QuantFactory/starcoder2-15b-GGUF
Text Generation • 16B • Updated • 1.41k • 2 -
bartowski/starcoder2-15b-instruct-v0.1-GGUF
Text Generation • 16B • Updated • 1.46k • 9 -
bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF
Text Generation • 16B • Updated • 52.5k • 201 -
QuantFactory/starcoder2-7b-instruct-GGUF
Text Generation • 7B • Updated • 2.14k • 2 -
QuantFactory/starcoder2-7b-GGUF
Text Generation • 7B • Updated • 2.09k • 4 -
QuantFactory/starcoder2-3b-instruct-v0.1-GGUF
3B • Updated • 1.89k • 1 -
QuantFactory/starcoder2-3b-instruct-GGUF
Text Generation • 3B • Updated • 1.32k • 1 -
QuantFactory/starcoder2-3b-GGUF
Text Generation • 3B • Updated • 1.66k • 3 -
Qwen/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation • 33B • Updated • 44.7k • 238 -
bartowski/Qwen2.5-Coder-32B-GGUF
Text Generation • 33B • Updated • 5.32k • 18 -
Qwen/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation • 15B • Updated • 193k • 269 -
mradermacher/Qwen2.5-14B-Coder-Merge-GGUF
15B • Updated • 408 • 2 -
Qwen/Qwen2.5-7B-Instruct-GGUF
Text Generation • 8B • Updated • 692k • 207 -
QuantFactory/Qwen2.5-Coder-7B-GGUF
Text Generation • 8B • Updated • 3.38k • 10 -
Qwen/Qwen2.5-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 426k • 191 -
QuantFactory/Qwen2.5-Coder-1.5B-GGUF
Text Generation • 2B • Updated • 2.48k • 2 -
QuantFactory/DeepSeek-Coder-V2-Lite-Base-GGUF
Text Generation • 16B • Updated • 2.08k • 1 -
ibm-granite/granite-34b-code-instruct-8k-GGUF
Text Generation • 34B • Updated • 214 • 8 -
ibm-granite/granite-34b-code-base-8k-GGUF
Text Generation • 34B • Updated • 196 • 3 -
ibm-granite/granite-20b-code-instruct-8k-GGUF
Text Generation • 20B • Updated • 207 • 6 -
ibm-granite/granite-20b-code-base-8k-GGUF
Text Generation • 20B • Updated • 190 • 5 -
QuantFactory/granite-8b-code-instruct-128k-GGUF
Text Generation • 8B • Updated • 472 • 3 -
RichardErkhov/ibm-granite_-_granite-8b-code-base-128k-gguf
8B • Updated • 4.12k -
ibm-granite/granite-8b-code-instruct-4k-GGUF
Text Generation • 8B • Updated • 3.25k • 12 -
ibm-granite/granite-8b-code-base-4k-GGUF
Text Generation • 8B • Updated • 166 • 3 -
mradermacher/granite-3b-code-instruct-128k-GGUF
3B • Updated • 256 • 1 -
QuantFactory/granite-3b-code-base-128k-GGUF
Text Generation • 3B • Updated • 2.21k • 2 -
ibm-granite/granite-3b-code-instruct-2k-GGUF
Text Generation • 3B • Updated • 251 • 8 -
ibm-granite/granite-3b-code-base-2k-GGUF
Text Generation • 3B • Updated • 218 • 3