Kimari-compatible GGUF models - a Smouj013 Collection

Smouj013 's Collections

Kimari-compatible GGUF models

Kimari-compatible GGUF models

updated 18 days ago

Community/reference GGUF models for local inference on consumer GPUs. Compatible with Kimari Local AI v0.1.83-alpha.

TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF

1B • Updated Dec 31, 2023 • 198k • 227

Note Reference/community GGUF model for Kimari smoke testing. Not an official Kimari model.
bartowski/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 19, 2024 • 19.1k • 13

Note Reference/community GGUF model for small Kimari local testing. Not an official Kimari model.
bartowski/SmolLM2-1.7B-Instruct-GGUF

Text Generation • 2B • Updated Oct 31, 2024 • 54.7k • 20

Note Reference/community GGUF model for Kimari testing. Not an official Kimari model.
bartowski/Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Oct 8, 2024 • 111k • 164

Note Reference/community GGUF model for Kimari testing. Not an official Kimari model.
bartowski/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 19, 2024 • 23.4k • 22

Note Reference/community GGUF model for GTX 1060/1080 Kimari testing. Not an official Kimari model.