Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,638

Full-text search

Active filters: imatrix

mradermacher/Theia-21B-v1-i1-GGUF

20B • Updated Aug 10, 2024 • 506 • 3

duyntnet/gemma-2-2b-it-imatrix-GGUF

Text Generation • 3B • Updated Aug 10, 2024 • 63 • 1

mradermacher/L3.1-Siithamo-v0.2-8B-i1-GGUF

8B • Updated Dec 16, 2024 • 52 • 1

mradermacher/Llama-3-8B-Stroganoff-3.0-i1-GGUF

8B • Updated Aug 11, 2024 • 51 • 2

ar08/Llama-2-7b-chat-hf-IQ3_M-GGUF

Text Generation • 7B • Updated Aug 11, 2024 • 6

mradermacher/Danish-Mistral-Nemo-Base-i1-GGUF

12B • Updated Aug 11, 2024 • 84 • 1

jsfs11/L3-SaoMerge-Della-v1-Q5_K_M-GGUF

8B • Updated Aug 11, 2024 • 1

mradermacher/DoubleBagel-57B-v1.0-i1-GGUF

57B • Updated Aug 11, 2024 • 169

Cran-May/Infinity-Instruct-3M-0625-Yi-1.5-9B-Q4_K_M-GGUF

9B • Updated Aug 11, 2024 • 9

n3shelter/Peach-9B-8k-Roleplay-IQ4_XS-GGUF

Text Generation • 9B • Updated Aug 11, 2024 • 4 • 1

mradermacher/2B_or_not_2B-i1-GGUF

3B • Updated Jan 26, 2025 • 739 • 1

wiktorwojcik112/Qwen2-1.5b-GGUF

0.5B • Updated Aug 11, 2024 • 2

tHottie/NeuralDaredevil-8B-abliterated-Q4_K_M-GGUF

8B • Updated Aug 11, 2024 • 3

mradermacher/Starlight-V3-12B-i1-GGUF

12B • Updated Aug 11, 2024 • 139 • 1

FredZhang7/claudegpt-code-logic-debugger-v0.1

Text Generation • 33B • Updated Sep 23, 2024 • 130 • 8

mradermacher/MN-LooseCannon-12B-v1-i1-GGUF

12B • Updated Aug 12, 2024 • 68 • 2

mradermacher/Alpaca-Llama3.1-8B-i1-GGUF

8B • Updated Sep 16, 2024 • 88 • 2

mradermacher/Infinity-Instruct-7M-Gen-mistral-7B-i1-GGUF

7B • Updated Aug 12, 2024 • 290

mradermacher/Kitsunebi-v1-Gemma2-8k-9B-i1-GGUF

9B • Updated Aug 12, 2024 • 178 • 1

mradermacher/Bio-Medical-Llama-3-8B-i1-GGUF

8B • Updated Nov 9, 2024 • 133 • 1

mradermacher/Hypernova-experimental-i1-GGUF

13B • Updated Aug 12, 2024 • 56

mradermacher/Cathallama-70B-i1-GGUF

71B • Updated Aug 12, 2024 • 77 • 3

mradermacher/Infinity-Instruct-7M-Gen-Llama3_1-70B-i1-GGUF

71B • Updated Aug 12, 2024 • 218 • 3

mradermacher/NemoDori-v0.2.1-12B-MN-BT-i1-GGUF

12B • Updated Aug 12, 2024 • 48 • 1

grapevine-AI/Llama-3.1-70B-Japanese-Instruct-2407-GGUF

71B • Updated Aug 13, 2024 • 11 • 2

mradermacher/NemoDori-v0.2.2-12B-MN-ties-i1-GGUF

12B • Updated Aug 12, 2024 • 206 • 2

mradermacher/gemma2-gutenberg-9B-i1-GGUF

9B • Updated Aug 12, 2024 • 134 • 1

mradermacher/mistral-nemo-gutenberg-12B-i1-GGUF

12B • Updated Aug 12, 2024 • 88 • 2

Nexesenex/Meta_Llama-3.1-8b-it_iMat_Custom_Quant_Stategies-GGUF

8B • Updated Aug 20, 2024 • 22 • 2

mradermacher/NemoDori-v0.5-12B-MN-BT-i1-GGUF

12B • Updated Dec 16, 2024 • 99 • 4