These models are specifically quantized for CPU optimization you can use this on a docker space up to the speed of 9 token per second
Vedika AI
Vedika-AI
·
AI & ML interests
None yet
Recent Activity
liked a Space 1 day ago
Monster/gemma-4-E2B-it-GGUF updated a model 2 days ago
Vedika-AI/Qwen2.5-Math-1.5B-Q3_K_M-GGUF published a model 2 days ago
Vedika-AI/Qwen2.5-Math-1.5B-Q3_K_M-GGUFOrganizations
models 9
Vedika-AI/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF
Text Generation • 0.5B • Updated • 302
Vedika-AI/Qwen2.5-Math-1.5B-Q3_K_M-GGUF
Text Generation • 2B • Updated • 112
Vedika-AI/Qwen2.5-Math-1.5B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 85
Vedika-AI/DeepSeek-R1-Distill-Qwen-1.5B-Q3_K_M-GGUF
2B • Updated • 131
Vedika-AI/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-GGUF
2B • Updated • 133
Vedika-AI/deepseek-coder-1.3b-instruct-Q4_K_M-GGUF
1B • Updated • 124
Vedika-AI/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation • 0.5B • Updated • 160
Vedika-AI/Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF
Text Generation • 2B • Updated • 135
Vedika-AI/gemma-3-1b-it-qat-Q4_K_M-GGUF
Image-Text-to-Text • 1.0B • Updated • 236