Local Inference - a dejongj Collection

dejongj 's Collections

Local Inference

Local Inference

updated Aug 27, 2025

Collection to be used for local inference.

bartowski/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 39.1k • 35
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Dec 1, 2024 • 283k • 324
bartowski/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 47.3k • 46
bartowski/gemma-2-9b-it-GGUF

Text Generation • 9B • Updated Jul 15, 2024 • 24.7k • 226