Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,565

Full-text search

Active filters: imatrix

mradermacher/Fireball-3.1-8B-ORPO-i1-GGUF

8B • Updated Sep 9, 2024 • 76 • 1

mradermacher/gemma-2-2b-dunsany-i1-GGUF

3B • Updated Aug 27, 2024 • 29

OmnicromsBrain/NeuralStar_Fusion-7B-IQ3_M-GGUF

7B • Updated Aug 30, 2024 • 1

anthracite-org/magnum-v3-9b-customgemma2-gguf

9B • Updated Sep 7, 2024 • 19 • 4

mradermacher/Athene-codegemma-2-7b-it-alpaca-v1.2-i1-GGUF

9B • Updated Aug 27, 2024 • 458 • 1

mradermacher/MagnumChronos-i1-GGUF

12B • Updated Aug 27, 2024 • 95 • 2

mradermacher/CestLumi-v2-i1-GGUF

12B • Updated Aug 27, 2024 • 7 • 1

a8nova/Phi-3-mini-4k-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Aug 28, 2024 • 1

mradermacher/YiSM-blossom5.1-34B-SLERP-i1-GGUF

34B • Updated Sep 22, 2024 • 169

secretmoon/WoonaV1.2-9b-GGUF-Imatrix

Text Generation • 9B • Updated Aug 28, 2024 • 262 • 6

mradermacher/Miquaurelian-i1-GGUF

69B • Updated Aug 28, 2024 • 16

mradermacher/aurelian-v0.5-70b-rope8-32K-fp16-i1-GGUF

69B • Updated Aug 28, 2024 • 93 • 1

duyntnet/Tiamat-7b-1.1-DPO-imatrix-GGUF

Text Generation • 7B • Updated Aug 28, 2024 • 59

mradermacher/Fireball-12B-v1.2-i1-GGUF

12B • Updated Aug 28, 2024 • 42

mradermacher/Duet_Minitron8b_v0.5-i1-GGUF

8B • Updated Aug 28, 2024 • 33

mradermacher/L3.1-Sthenorm-8B-i1-GGUF

8B • Updated Sep 8, 2024 • 118 • 4

mradermacher/armaGPT-i1-GGUF

9B • Updated Sep 8, 2024 • 94

mradermacher/L3.1-12B-Celeste-V1.5-i1-GGUF

12B • Updated Sep 8, 2024 • 7 • 1

mradermacher/kainaticulous-rp-7b-i1-GGUF

7B • Updated Sep 8, 2024 • 64 • 2

mradermacher/OpenCrystal-12B-L3.1-128K-i1-GGUF

12B • Updated Aug 28, 2024 • 1 • 1

mradermacher/MN-12B-Estrella-v2.2-i1-GGUF

12B • Updated Sep 16, 2024 • 68 • 2

DarwinAnim8or/mergekit-model_stock-ffibbcs-IQ4_XS-GGUF

3B • Updated Aug 28, 2024 • 3 • 1

mradermacher/ChatWaifu_v1.3.1-i1-GGUF

12B • Updated Feb 12, 2025 • 53 • 4

anthracite-org/magnum-v3-9b-chatml-gguf

9B • Updated Sep 10, 2024 • 37 • 7

mradermacher/ClimateChat-i1-GGUF

8B • Updated Jan 15, 2025 • 67

mradermacher/L3.1-12B-Niitama-v1.1-i1-GGUF

12B • Updated Aug 28, 2024 • 15 • 1

venketh/Mistral-7B-Instruct-v0.3-gguf

7B • Updated Aug 29, 2024

mradermacher/WoonaV1.2-9b-i1-GGUF

9B • Updated Jun 22, 2025 • 327 • 2

mradermacher/MagnumRPMerge-i1-GGUF

34B • Updated Aug 29, 2024 • 95

mradermacher/lemone-12b-v0.1-i1-GGUF

12B • Updated Aug 28, 2024 • 35