Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,598

Full-text search

Active filters: imatrix

mradermacher/T-III-12B-i1-GGUF

12B • Updated Aug 24, 2024 • 64 • 1

mradermacher/Nemo-12B-Marlin-v8-i1-GGUF

12B • Updated Aug 24, 2024 • 265 • 3

mradermacher/Instant-RP-Noodles-12B-i1-GGUF

12B • Updated Aug 24, 2024 • 2 • 1

hellork/chatglm3-6b-IQ4_NL-GGUF

6B • Updated Sep 17, 2024 • 2

hellork/SmolLM-1.7B-Instruct-Q5_K_M-GGUF

2B • Updated Sep 17, 2024 • 5

hellork/chatglm3-6b-128k-IQ4_NL-GGUF

6B • Updated Sep 17, 2024

Reiterate3680/Soliloquy-7B-v3-GGUF

Text Generation • 8B • Updated Aug 24, 2024 • 1 • 1

Reiterate3680/nemo-12b-hiwaifu-GGUF

Text Generation • 12B • Updated Aug 25, 2024 • 1 • 1

mradermacher/T-IIIa-12B-i1-GGUF

12B • Updated Aug 25, 2024 • 68 • 1

hellork/falcon-mamba-7b-instruct-IQ4_NL-GGUF

7B • Updated Sep 17, 2024 • 20 • 1

hellork/LongWriter-llama3.1-8b-IQ3_M-GGUF

8B • Updated Sep 17, 2024 • 7 • 1

Cran-May/Phi-3.5-mini-instruct-Q5_K_M-GGUF

Text Generation • 4B • Updated Aug 25, 2024 • 1

mradermacher/openbuddy-llama3.1-70b-v22.2-131k-i1-GGUF

71B • Updated Jan 22, 2025 • 58

legraphista/unsloth-Phi-3.5-mini-instruct-IMat-GGUF

Text Generation • 4B • Updated Aug 25, 2024 • 102

anthracite-org/magnum-v3-34b-gguf

Text Generation • 34B • Updated Aug 28, 2024 • 400 • 12

mradermacher/OpenCrystal-12B-L3-i1-GGUF

12B • Updated Sep 8, 2024 • 22 • 2

ijohn07/aya-23-8B-IQ3_M-GGUF

8B • Updated Aug 25, 2024

mradermacher/SageLlama-3.1-8B-v3-i1-GGUF

8B • Updated Aug 26, 2024 • 58

hellork/Phi-3-mini-4k-geminified-IQ4_NL-GGUF

Text Generation • 4B • Updated Sep 17, 2024 • 11

bartowski/glm-4-9b-chat-GGUF

Text Generation • 9B • Updated Aug 26, 2024 • 2.67k • 4

mradermacher/Type-IV-Last-12B-i1-GGUF

12B • Updated Aug 26, 2024 • 43 • 2

mradermacher/L3-SthenoMaidBlackroot-12.2B-V1-INSTRUCT-16fp-i1-GGUF

12B • Updated Jan 22, 2025 • 23 • 1

mradermacher/L3-Lumimaid-12.2B-v0.1-OAS-Instruct-i1-GGUF

12B • Updated Aug 26, 2024 • 120 • 1

mradermacher/L3-Stheno-v3.2-12.2B-Instruct-i1-GGUF

12B • Updated Aug 26, 2024 • 194 • 1

mradermacher/L3-SMB-Instruct-12.2B-F32-i1-GGUF

12B • Updated Aug 26, 2024 • 114 • 1

mradermacher/L3-12B-Celeste-V1.2-i1-GGUF

12B • Updated Aug 26, 2024 • 37 • 1

Dampfinchen/Llama-3.1-8B-Ultra-Instruct-Q4_K_S-GGUF

8B • Updated Aug 26, 2024 • 10 • 1

mradermacher/L3-SMB-Grand-Story-The-Reaper-20.7B-i1-GGUF

21B • Updated Aug 26, 2024 • 133

mradermacher/llama-3-12b-Instruct-i1-GGUF

12B • Updated Aug 26, 2024 • 62

Cran-May/Phi-3.5-Chinese-Q5_K_M-GGUF

4B • Updated Aug 26, 2024