Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,132

Full-text search

Active filters: imatrix

mradermacher/dolphin-2.9-llama3-70b-i1-GGUF

71B • Updated Jul 15, 2025 • 115

mradermacher/Llama-3-70b-Uncensored-Lumi-Tess-gradient-i1-GGUF

71B • Updated May 16, 2024 • 289 • 3

Felladrin/gguf-sharded-Mistral-7B-OpenOrca

7B • Updated May 15, 2024

duyntnet/MiniMA-3B-imatrix-GGUF

Text Generation • 3B • Updated May 15, 2024 • 42

adhityaprimandhika/Mistral-Categorization-IQ1

7B • Updated May 15, 2024

bartowski/dolphin-2.9.1-qwen-110b-GGUF

Text Generation • 111B • Updated May 15, 2024 • 89 • 2

duyntnet/Einstein-v6-7B-imatrix-GGUF

Text Generation • 7B • Updated May 15, 2024 • 10

cgus/MiniChat-2-3B-iMat-GGUF

3B • Updated May 17, 2024 • 14

mradermacher/UnFimbulvetr-20B-V2-i1-GGUF

21B • Updated Mar 5, 2025 • 90 • 4

mradermacher/Eurux-8x22b-nca-i1-GGUF

141B • Updated May 19, 2024 • 64

backyardai/Chaifighter-20B-GGUF

21B • Updated May 22, 2024 • 51 • 3

bartowski/llama-3-70B-Instruct-abliterated-GGUF

Text Generation • 71B • Updated May 16, 2024 • 524 • 6

mradermacher/Franziska-Maxtral-8x22B-v1-i1-GGUF

141B • Updated May 19, 2024 • 15

mradermacher/dolphin-2.9-mixtral-8x22b-i1-GGUF

141B • Updated Jul 15, 2025 • 49

qwp4w3hyb/SFR-Iterative-DPO-LLaMA-3-8B-R-iMat-GGUF

Text Generation • 8B • Updated May 16, 2024 • 5 • 2

duyntnet/UNA-TheBeagle-7b-v1-imatrix-GGUF

Text Generation • 7B • Updated May 16, 2024 • 26

duyntnet/Blue-Orchid-2x7b-imatrix-GGUF

Text Generation • 13B • Updated May 16, 2024 • 90

willbeez/Phi-3-mini-128k-instruct-IQ1_S-no_robots_only_coding

4B • Updated May 16, 2024 • 5

mradermacher/Mixtral-8x22B-Capyboros-v1-i1-GGUF

141B • Updated May 19, 2024 • 51

duyntnet/Dr_Samantha-7b-imatrix-GGUF

Text Generation • 7B • Updated May 17, 2024 • 7

bartowski/airoboros-dpo-110b-3.3-GGUF

Text Generation • 111B • Updated May 17, 2024 • 52

thesven/Falcon-11B-GGUF-iq4_xss.gguf

11B • Updated May 17, 2024 • 20

duyntnet/SlimHercules-4.0-Mistral-7B-v0.2-imatrix-GGUF

Text Generation • 7B • Updated May 17, 2024 • 37

mmnga/stockmark-100b-gguf

96B • Updated May 18, 2024 • 68 • 4

mradermacher/Llama-3-8B-Synthia-v3.5-i1-GGUF

8B • Updated May 19, 2024 • 94

mradermacher/Mahou-1.2-llama3-8B-i1-GGUF

8B • Updated May 19, 2024 • 163 • 3

mradermacher/Mahou-1.2-mistral-7B-i1-GGUF

7B • Updated May 19, 2024 • 67

mradermacher/Deita-34b-i1-GGUF

34B • Updated May 24, 2024 • 229

backyardai/Dark-Miqu-103B-GGUF

103B • Updated May 22, 2024 • 235

duyntnet/neural-chat-7b-v3-3-imatrix-GGUF

Text Generation • 7B • Updated May 18, 2024 • 48