Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,617

Full-text search

Active filters: imatrix

mradermacher/Kitsunebi-v1-Gemma2-8k-9B-i1-GGUF

9B • Updated Aug 12, 2024 • 178 • 1

mradermacher/Bio-Medical-Llama-3-8B-i1-GGUF

8B • Updated Nov 9, 2024 • 133 • 1

mradermacher/Hypernova-experimental-i1-GGUF

13B • Updated Aug 12, 2024 • 56

mradermacher/Cathallama-70B-i1-GGUF

71B • Updated Aug 12, 2024 • 77 • 3

mradermacher/Infinity-Instruct-7M-Gen-Llama3_1-70B-i1-GGUF

71B • Updated Aug 12, 2024 • 218 • 3

mradermacher/NemoDori-v0.2.1-12B-MN-BT-i1-GGUF

12B • Updated Aug 12, 2024 • 48 • 1

grapevine-AI/Llama-3.1-70B-Japanese-Instruct-2407-GGUF

71B • Updated Aug 13, 2024 • 11 • 2

mradermacher/NemoDori-v0.2.2-12B-MN-ties-i1-GGUF

12B • Updated Aug 12, 2024 • 206 • 2

mradermacher/gemma2-gutenberg-9B-i1-GGUF

9B • Updated Aug 12, 2024 • 134 • 1

mradermacher/mistral-nemo-gutenberg-12B-i1-GGUF

12B • Updated Aug 12, 2024 • 88 • 2

Nexesenex/Meta_Llama-3.1-8b-it_iMat_Custom_Quant_Stategies-GGUF

8B • Updated Aug 20, 2024 • 22 • 2

mradermacher/NemoDori-v0.5-12B-MN-BT-i1-GGUF

12B • Updated Dec 16, 2024 • 99 • 4

mradermacher/Theia-21B-v1_pretrained-i1-GGUF

20B • Updated Aug 12, 2024 • 47 • 1

bartowski/calme-2.3-rys-78b-GGUF

Text Generation • 78B • Updated Aug 13, 2024 • 112 • 2

mradermacher/L3-Deluxe-Smurge_l3-12B-i1-GGUF

24B • Updated Aug 12, 2024 • 78 • 1

grapevine-AI/Llama-3.1-70B-EZO-1.1-it-GGUF

71B • Updated Aug 13, 2024 • 7 • 2

mradermacher/Pleiades-12B-v1-i1-GGUF

12B • Updated Aug 13, 2024 • 29 • 2

mradermacher/MN-12B-Estrella-v1-i1-GGUF

12B • Updated Sep 16, 2024 • 182 • 2

mradermacher/Berry-Spark-7B-i1-GGUF

7B • Updated Aug 13, 2024 • 65

mradermacher/NemoDori-v0.2-Upscaled.1-14B-i1-GGUF

14B • Updated Aug 13, 2024 • 192 • 2

mradermacher/TypeI-12B-i1-GGUF

12B • Updated Aug 13, 2024 • 62 • 1

mradermacher/mistral-nemo-wissenschaft-12B-i1-GGUF

12B • Updated Aug 13, 2024 • 7

mradermacher/L3-Boshima-a-i1-GGUF

8B • Updated Aug 13, 2024 • 49 • 1

ar08/Indic-gemma-7b-finetuned-sft-Navarasa-2.0-IQ3_M-GGUF

Text Generation • 9B • Updated Aug 13, 2024 • 10

mradermacher/calme-2.4-rys-78b-i1-GGUF

78B • Updated Sep 16, 2024 • 144 • 2

mradermacher/32K_Selfbot-i1-GGUF

7B • Updated Aug 13, 2024 • 44 • 1

mradermacher/SaulLM-141B-Instruct-i1-GGUF

141B • Updated Aug 17, 2024 • 68

ClaudioItaly/TopEvolutionWiz-Q4_K_M-GGUF

7B • Updated Aug 13, 2024 • 2

mradermacher/Llama-3.1-8B-Pruned-4-Layers_LoRA-PEFT-DPO-i1-GGUF

7B • Updated Aug 14, 2024 • 79

lmstudio-community/internlm2_5-1_8b-chat-GGUF

Text Generation • 2B • Updated Aug 13, 2024 • 554 • 3