Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,711

Full-text search

Active filters: imatrix

AI-Engine/gemma-2-27b-it-GGUF

27B • Updated Jul 24, 2024 • 49

legraphista/Mistral-Large-Instruct-2407-IMat-GGUF

Text Generation • 123B • Updated Jul 25, 2024 • 218 • 29

bartowski/Mistral-Large-Instruct-2407-GGUF

Text Generation • 123B • Updated Aug 27, 2024 • 1.38k • 35

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • 123B • Updated Jul 26, 2024 • 409 • 21

mradermacher/Meta-Llama-3-8B-Instruct-function-calling-i1-GGUF

8B • Updated Aug 2, 2024 • 4.66k

mradermacher/fusion-9b-i1-GGUF

9B • Updated Aug 2, 2024 • 56

mradermacher/not-your-advisor-9b-i1-GGUF

9B • Updated Aug 2, 2024 • 288

mradermacher/Hathor_Sofit-L3-8B-v1-i1-GGUF

8B • Updated Aug 2, 2024 • 74 • 2

mmnga/Mistral-Large-Instruct-2407-gguf

123B • Updated Jul 26, 2024 • 181

mradermacher/Llama-3-8B-Stroganoff-2.0-i1-GGUF

8B • Updated Aug 2, 2024 • 15 • 1

InferenceIllusionist/Mistral-Large-Instruct-2407-iMat-GGUF

123B • Updated Aug 4, 2024 • 454 • 3

aifeifei798/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 2

mradermacher/Honey-Yuzu-13B-i1-GGUF

12B • Updated Aug 2, 2024 • 471 • 3

mradermacher/NieR-Automata-Chatbot-none-V4-Mid-i1-GGUF

7B • Updated Aug 2, 2024 • 30

mradermacher/NieR-Automata-Chatbot-none-V5-i1-GGUF

7B • Updated Feb 12, 2025 • 295 • 1

Reiterate3680/Sekhmet_Aleph-L3.1-8B-v0.1-GGUF

Text Generation • 8B • Updated Aug 5, 2024 • 6 • 1

mradermacher/L3-Stheno-Maid-Blackroot-Grand-HORROR-16B-i1-GGUF

17B • Updated Aug 2, 2024 • 62

Felladrin/gguf-sharded-wavecoder-ultra-6.7b

7B • Updated Jul 25, 2024

qwp4w3hyb/Meta-Llama-3.1-8B-Instruct-iMat-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 158 • 6

mradermacher/Mistral-Large-Instruct-2407-i1-GGUF

123B • Updated Jul 26, 2025 • 266 • 10

qwp4w3hyb/Meta-Llama-3.1-70B-Instruct-iMat-GGUF

Text Generation • 71B • Updated Aug 6, 2024 • 318 • 8

Reiterate3680/L3-Super-Nova-RP-8B-GGUF

Text Generation • 8B • Updated Aug 6, 2024

mradermacher/L3-Horizon-Anteros-v0.1-13B-i1-GGUF

13B • Updated Dec 16, 2024 • 21

mradermacher/Llama-7B-rollercoaster_v2-i1-GGUF

7B • Updated Aug 2, 2024 • 240

etemiz/Llama-3.1-405B-Inst-GGUF

410B • Updated Dec 19, 2024 • 141 • 4

mradermacher/Meta-Llama-3-70B-Instruct-function-calling-i1-GGUF

71B • Updated Aug 2, 2024 • 116

mradermacher/pstella-16b-i1-GGUF

8B • Updated Aug 2, 2024 • 106

mradermacher/L3-Super-Nova-RP-8B-i1-GGUF

Summarization • 8B • Updated Aug 2, 2024 • 52 • 2

lmstudio-community/Mistral-Large-Instruct-2407-GGUF

Text Generation • 123B • Updated Aug 29, 2024 • 276 • 13

Felladrin/gguf-sharded-h2o-danube3-500m-chat

0.5B • Updated Aug 6, 2024