Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,665

Full-text search

Active filters: imatrix

Vdr1/nemo-sunfall-v0.6.1-GGUF-IQ

12B • Updated Aug 2, 2024 • 39 • 3

mradermacher/shieldgemma-27b-i1-GGUF

27B • Updated Aug 1, 2024 • 2.22k

mmnga/gemma-2-2b-it-gguf

3B • Updated Aug 1, 2024 • 1.97k • 1

mmnga/HODACHI-EZO-Common-T2-2B-gemma-2-it-gguf

3B • Updated Aug 1, 2024 • 319 • 5

mradermacher/Hansoldeco-Gemma-2-9b-it-v0.2-i1-GGUF

9B • Updated Aug 1, 2024 • 32

mradermacher/Nemo-12B-Marlin-v1-i1-GGUF

12B • Updated Aug 1, 2024 • 174 • 1

mradermacher/Mixnu-i1-GGUF

20B • Updated Aug 1, 2024 • 86

kaetemi/Meta-Llama-3-8B-Q4_K_M-GGUF-c3o12

Text Generation • 8B • Updated Aug 1, 2024

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o12

Text Generation • 8B • Updated Aug 1, 2024

MugenYume/elm-turbo-0.25-instruct-Q4_K_M-GGUF

2B • Updated Aug 1, 2024 • 5

mradermacher/Llama-Phi-3_DoRA-i1-GGUF

4B • Updated Aug 1, 2024 • 66

MugenYume/elm-turbo-0.50-instruct-Q4_K_M-GGUF

2B • Updated Aug 1, 2024 • 6

ngxson/wllama-split-models

3B • Updated Aug 1, 2024 • 143

kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o14

Text Generation • 8B • Updated Aug 1, 2024

mradermacher/MN-12B-Starcannon-v2-i1-GGUF

12B • Updated Dec 16, 2024 • 133 • 8

Reiterate3680/MN-12B-Starcannon-v2-GGUF

Text Generation • 12B • Updated Aug 5, 2024 • 3 • 2

mradermacher/SaulLM-54B-Instruct-i1-GGUF

47B • Updated Aug 2, 2024 • 210 • 3

MaziyarPanahi/calme-2.2-qwen2-72b-GGUF

Text Generation • 73B • Updated Aug 6, 2024 • 31 • 2

Mihaiii/shieldgemma-2b-Q5_K_M-GGUF

Text Generation • 3B • Updated Aug 2, 2024 • 5

mradermacher/Bioinspired-Llama-3-1-8B-128k-alpha-i1-GGUF

8B • Updated Aug 2, 2024 • 314

Felladrin/gguf-sharded-gemma-2-2b-it-abliterated

3B • Updated Aug 2, 2024

legraphista/Palmyra-Fin-70B-32K-IMat-GGUF

Text Generation • 71B • Updated Aug 2, 2024 • 261 • 10

bartowski/Palmyra-Med-70B-32K-GGUF

Text Generation • 71B • Updated Aug 5, 2024 • 231 • 3

matrixportalx/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • 8B • Updated Aug 2, 2024 • 105

Felladrin/gguf-sharded-Qwen2-1.5B-Instruct-imat

Text Generation • 2B • Updated Aug 2, 2024 • 22

Reiterate3680/Sekhmet_Gimmel-L3.1-8B-v0.3-GGUF

Text Generation • 8B • Updated Aug 6, 2024 • 32

bartowski/Palmyra-Fin-70B-32K-GGUF

Text Generation • 71B • Updated Aug 5, 2024 • 342 • 5

mradermacher/Nous-Hermes-2-Mistral-7B-DPO-prune-i1-GGUF

7B • Updated Aug 3, 2024 • 160

mradermacher/Evolved-Llama3-8B-i1-GGUF

7B • Updated Aug 2, 2024 • 67 • 1

mradermacher/Bioinspired-Llama-3-1-8B-128k-gamma-i1-GGUF

8B • Updated Aug 3, 2024 • 353