Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,682

Full-text search

Active filters: imatrix

mradermacher/Infinity-Instruct-7M-0729-mistral-7B-i1-GGUF

7B • Updated Dec 16, 2024 • 200 • 1

mradermacher/Nemo-12B-Marlin-v2-i1-GGUF

12B • Updated Aug 3, 2024 • 158 • 1

mradermacher/Meltemi-7B-v1.5-i1-GGUF

7B • Updated Aug 3, 2024 • 208

mradermacher/LocalAI-Llama3.1-8b-Function-Call-v0.3-i1-GGUF

8B • Updated Aug 3, 2024 • 142

mradermacher/lama-2-7b-chat-hf-playbooks-finetuned-i1-GGUF

7B • Updated Aug 3, 2024 • 76

mradermacher/tamilan-2-27b-i1-GGUF

27B • Updated Aug 3, 2024 • 58

kaetemi/falcon-11B-Q4_K_M-GGUF-its-garbage

11B • Updated Aug 3, 2024 • 3

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-4lc

Text Generation • 8B • Updated Aug 3, 2024 • 8

polyverse/Meta-Llama-3.1-8B-Q5_K_M-GGUF

Text Generation • 8B • Updated Aug 3, 2024 • 9

mradermacher/Mistral-Large-218B-Instruct-i1-GGUF

218B • Updated Aug 1, 2025 • 17 • 3

mradermacher/Waie1-i1-GGUF

71B • Updated Aug 3, 2024 • 78

mradermacher/Gemma-2-27B-Chinese-Chat-i1-GGUF

27B • Updated Aug 3, 2024 • 223

mradermacher/FinChat298B_Llama-3.1-8Bi-i1-GGUF

8B • Updated Aug 3, 2024 • 42

mradermacher/Evolved-Llama3-ELYZA-Uncensored-8B-i1-GGUF

8B • Updated Aug 4, 2024 • 51

polyverse/Meta-Llama-3-8B-Q5_K_M-GGUF

Text Generation • 8B • Updated Aug 3, 2024 • 4

mradermacher/Med-Llama3-0.5-i1-GGUF

8B • Updated Aug 3, 2024 • 167

bartowski/Llama-3.1-70B-Instruct-lorablated-GGUF

Text Generation • 71B • Updated Aug 5, 2024 • 871 • 19

mradermacher/Yi-34B-200K-HESOYAM-TURTLE-0208-i1-GGUF

34B • Updated Apr 28, 2025 • 64

duyntnet/TableLLM-13b-imatrix-GGUF

Text Generation • 13B • Updated Aug 3, 2024 • 64

Reiterate3680/MN-12B-Lyra-v1-GGUF

Text Generation • 12B • Updated Aug 6, 2024 • 53

mradermacher/US-mag-mini-21b-i1-GGUF

20B • Updated Aug 3, 2024 • 30

mradermacher/Infinity-Instruct-7M-0729-Llama3_1-70B-i1-GGUF

71B • Updated Dec 16, 2024 • 214

mradermacher/csg-wukong-1B-i1-GGUF

1B • Updated Aug 3, 2024 • 110

mradermacher/MN-12B-Lyra-v1-i1-GGUF

12B • Updated Aug 3, 2024 • 173 • 8

mradermacher/Humanish-Roleplay-Llama-3.1-8B-i1-GGUF

8B • Updated Aug 4, 2024 • 971 • 8

mradermacher/DA-MG-NeMoist-21b-v1.2-i1-GGUF

20B • Updated Aug 4, 2024

CISCai/Mistral-Nemo-Instruct-2407-SOTA-GGUF

Text Generation • 12B • Updated Aug 16, 2024 • 42

mradermacher/MN-12B-Starsong-v1-i1-GGUF

12B • Updated Jan 25, 2025 • 256 • 4

mradermacher/YetAnotherMerge-v0.1-i1-GGUF

12B • Updated Aug 4, 2024 • 43 • 1

mradermacher/WibbleWobble-i1-GGUF

8B • Updated Aug 4, 2024 • 91