Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,236

Full-text search

Active filters: imatrix

mradermacher/Gemma-2-9B-It-SPPO-Iter3-i1-GGUF

9B • Updated Oct 20, 2024 • 189 • 3

MarsupialAI/MG-FinalMix-72B_iMatrix_GGUF

Text Generation • 73B • Updated Jul 10, 2024 • 31 • 1

utterlygreat/omost-dolphin-2.9-llama3-8b-IQ4_XS-GGUF

8B • Updated Jul 10, 2024 • 6

mradermacher/Mistral7B-PairRM-SPPO-i1-GGUF

7B • Updated Aug 2, 2024 • 145

mradermacher/granite-8b-code-instruct-i1-GGUF

8B • Updated Dec 16, 2024 • 335 • 1

mradermacher/L3-Umbral-Mind-RP-v3.0-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 443 • 16

mradermacher/Spicy-Tied-EMaid-13Bv0.1-i1-GGUF

13B • Updated Aug 2, 2024 • 19 • 1

mradermacher/llama-3-70b-songa_v2-final-i1-GGUF

71B • Updated Aug 2, 2024 • 15

NikolayKozloff/ArliAI-Llama-3-8B-Formax-v1.0-IQ4_XS-GGUF

8B • Updated Jul 10, 2024 • 1

NikolayKozloff/ArliAI-Llama-3-8B-Formax-v1.0-IQ4_NL-GGUF

8B • Updated Jul 10, 2024 • 1 • 1

mradermacher/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-i1-GGUF

71B • Updated Aug 2, 2024 • 60 • 2

mradermacher/DeepSeek-V2-i1-GGUF

236B • Updated Aug 2, 2024 • 12

mradermacher/LLama3-8B-FunStock-i1-GGUF

8B • Updated Aug 2, 2024 • 21

NikolayKozloff/NuminaMath-7B-TIR-IQ4_NL-GGUF

Text Generation • 7B • Updated Jul 10, 2024 • 4 • 1

genevera/mistral-orthogonalized-Q5_K_S-GGUF

7B • Updated Jul 11, 2024 • 6

mradermacher/Unholy-Thoth-8B-v2-i1-GGUF

8B • Updated Aug 2, 2024 • 36

mradermacher/L3-Tyche-8B-v1.0-i1-GGUF

8B • Updated Aug 2, 2024 • 135

mradermacher/llama3-8B-Special-Dark-v2-i1-GGUF

8B • Updated Aug 2, 2024 • 10

mradermacher/Fiction-Writer-6-i1-GGUF

8B • Updated Aug 2, 2024 • 42

mradermacher/NuminaMath-7B-TIR-i1-GGUF

7B • Updated Aug 2, 2024 • 266 • 1

mradermacher/SeaLLM-7B-v2-i1-GGUF

7B • Updated Aug 2, 2024 • 137

mradermacher/SeaLLM-7B-v2.5-i1-GGUF

9B • Updated Aug 2, 2024 • 37

Fizzarolli/writer-8b-Q4_K_S-GGUF

8B • Updated Jul 11, 2024 • 1

mradermacher/ArliAI-Llama-3-8B-Formax-v1.0-i1-GGUF

8B • Updated Dec 16, 2024 • 46 • 1

duyntnet/zephyr-7b-sft-full-SPIN-iter3-imatrix-GGUF

Text Generation • 7B • Updated Jul 11, 2024 • 40 • 1

mradermacher/MysticGem-v1.3-Guanaco-L2-13B-i1-GGUF

13B • Updated Aug 2, 2024 • 6 • 1

mradermacher/TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2-i1-GGUF

8B • Updated Aug 2, 2024 • 11

mradermacher/L3-8B-Stheno-v3.2-abliterated-i1-GGUF

8B • Updated Aug 2, 2024 • 392 • 4

mradermacher/danube2-1.8b-Synthia-v1.3-i1-GGUF

2B • Updated Aug 2, 2024 • 150

mradermacher/stable-code-instruct-3b-i1-GGUF

3B • Updated Aug 2, 2024 • 204 • 1