Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,622

Base only

Active filters: imatrix

mradermacher/Nemomix-v1.0-12B-i1-GGUF

12B • Updated Jul 31, 2024 • 183 • 1

mradermacher/Role_LLM_Cube-i1-GGUF

8B • Updated Jul 2, 2025 • 214 • 1

mradermacher/Loki-v2.2-i1-GGUF

8B • Updated Jul 31, 2024 • 50 • 1

mradermacher/SchizoGPT-123B-i1-GGUF

123B • Updated Aug 1, 2024 • 6 • 2

mradermacher/Nemomix-v0.1-12B-i1-GGUF

12B • Updated Dec 16, 2024 • 416 • 2

mradermacher/Nemomix-v2.0-12B-i1-GGUF

12B • Updated Jul 31, 2024 • 31

mradermacher/Nemomix-v3.0-12B-i1-GGUF

12B • Updated Aug 2, 2024 • 744 • 1

mradermacher/Nemomix-v4.0-12B-i1-GGUF

12B • Updated Jul 31, 2024 • 206 • 6

mmnga/Llama-3.1-8B-EZO-1.1-it-gguf

8B • Updated Jul 31, 2024 • 1.24k • 7

mmnga/Llama-3.1-70B-EZO-1.1-it-gguf

71B • Updated Jul 31, 2024 • 607

tannedbum/L3-Rhaenys-8B-GGUF

8B • Updated Aug 3, 2024 • 41 • 6

mradermacher/Gemmasutra-Pro-27B-v1-i1-GGUF

27B • Updated Aug 2, 2024 • 123 • 1

legraphista/gemma-2-2b-it-IMat-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 696 • 1

legraphista/gemma-2-2b-IMat-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 839 • 1

mradermacher/L3-Rhaenys-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 57 • 3

mradermacher/Llama3.1-elm-turbo-6B-instruct-i1-GGUF

6B • Updated Mar 29, 2025 • 293

mradermacher/Lumimaid-Magnum-12B-i1-GGUF

12B • Updated Aug 1, 2024 • 404 • 5

mradermacher/L3.1-8B-sunfall-v0.6.1-dpo-i1-GGUF

8B • Updated Aug 1, 2024 • 315 • 3

YukiTomita-CC/Llama-3-Swallow-8B-Instruct-v0.1-IMat-GGUF_dolly-15k-ja

8B • Updated Jul 31, 2024 • 54

mradermacher/Llama3.1-elm-turbo-4B-instruct-i1-GGUF

4B • Updated Aug 1, 2024 • 27

mradermacher/Llama3.1-elm-turbo-3B-instruct-i1-GGUF

3B • Updated Aug 1, 2024 • 72

Reiterate3680/LumiHathor-GGUF

Text Generation • 8B • Updated Aug 5, 2024

mradermacher/llama3-8b-cpt-sea-lionv2-base-i1-GGUF

8B • Updated Apr 14, 2025 • 403

mradermacher/OLMo-1B-0724-hf-i1-GGUF

1B • Updated Aug 1, 2024 • 363

mradermacher/Bioinspired-Llama-3-1-70B-128k-alpha-i1-GGUF

71B • Updated Aug 1, 2024 • 242

mradermacher/Rude-Assistant-Mistral-Nemo-2407-SFT-i1-GGUF

12B • Updated Jan 22, 2025 • 41 • 2

mradermacher/MN-12B-Celeste-V1.9-i1-GGUF

12B • Updated Aug 1, 2024 • 793 • 4

mradermacher/LumiHathor-i1-GGUF

8B • Updated Aug 1, 2024 • 260 • 1

mradermacher/Yamase-12B-i1-GGUF

12B • Updated Aug 1, 2024 • 537 • 1

mradermacher/llama3-8b-cpt-sea-lionv2-instruct-i1-GGUF

8B • Updated Apr 14, 2025 • 544 • 1