Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,243

Full-text search

Active filters: imatrix

backyardai/Bionic-Vaquita-13B-GGUF

13B • Updated Jul 2, 2024 • 61 • 3

mradermacher/Hansoldeco-Gemma-2-9b-it-v0.1-i1-GGUF

9B • Updated Aug 2, 2024 • 16

mradermacher/gemma-2-27b-i1-GGUF

27B • Updated Aug 2, 2024 • 97 • 2

mradermacher/gemma-2-9b-it-i1-GGUF

9B • Updated Aug 2, 2024 • 188

Cran-May/Gemma-2-9B-Chinese-Chat-Q4_K_M-GGUF

Text Generation • 9B • Updated Jul 2, 2024 • 4

RachidAR/Phi-3-mini-4k-ins-June2024-Q5_K_M-imat-GGUF

Text Generation • 4B • Updated Jul 2, 2024 • 7

duyntnet/Silicon-Maid-7B-imatrix-GGUF

Text Generation • 7B • Updated Jul 2, 2024 • 42 • 6

bartowski/Tess-v2.5-Gemma-2-27B-alpha-GGUF

Text Generation • 27B • Updated Jul 2, 2024 • 68 • 6

mradermacher/gemma-2-9b-nopcsa-finetune-i1-GGUF

9B • Updated Aug 2, 2024

mradermacher/Llama-3-Swallow-70B-v0.1-i1-GGUF

71B • Updated Aug 2, 2024 • 64 • 2

mradermacher/Qwen-IronMan-i1-GGUF

8B • Updated Aug 2, 2024 • 25

mradermacher/Sydney-i1-GGUF

8B • Updated Aug 2, 2024 • 13

mradermacher/Noromaid-7B-0.4-DPO-i1-GGUF

7B • Updated Aug 2, 2024 • 101 • 1

mradermacher/blossom-v5-32b-i1-GGUF

33B • Updated Aug 2, 2024 • 339

mradermacher/Swallow-13b-instruct-v0.1-i1-GGUF

13B • Updated Aug 2, 2024 • 23

mradermacher/Yi-9B-200K-i1-GGUF

9B • Updated Dec 27, 2024 • 60

mradermacher/Matter-0.2-8x22B-i1-GGUF

141B • Updated Aug 2, 2024 • 11

lmstudio-community/Phi-3.1-mini-4k-instruct-GGUF

Text Generation • 4B • Updated Aug 1, 2024 • 1.64k • 23

mradermacher/X-NoroChronos-13B-i1-GGUF

13B • Updated Aug 2, 2024

NikolayKozloff/Llama-3-Instruct-Neurona-8b-v2-IQ4_NL-GGUF

Text Generation • 8B • Updated Jul 2, 2024 • 17 • 1

mradermacher/Llama-3-Swallow-70B-Instruct-v0.1-i1-GGUF

71B • Updated Aug 2, 2024 • 4.66k

qwp4w3hyb/Gemma-2-9B-It-SPPO-Iter3-iMat-GGUF

Text Generation • 9B • Updated Jul 3, 2024 • 14

mradermacher/Nethena-20B-i1-GGUF

20B • Updated Aug 2, 2024 • 58

BoscoTheDog/Phi-3.1-mini-4k-instruct-Q4_K_M_gguf_chunked

4B • Updated Jul 2, 2024 • 15

mradermacher/Berry_v2_7B-i1-GGUF

8B • Updated Aug 2, 2024 • 24

mradermacher/Qwen2-7B-Merged-Einstein-v7-Arcee-Spark-i1-GGUF

8B • Updated Aug 2, 2024 • 1

mradermacher/InternLM2-Chat-20B-ToxicRP-i1-GGUF

20B • Updated Aug 2, 2024 • 56

duyntnet/Jellyfish-13B-imatrix-GGUF

Text Generation • 13B • Updated Jul 3, 2024 • 9 • 1

mradermacher/yo-Llama-3-8B-Instruct-i1-GGUF

8B • Updated Aug 2, 2024 • 59

mradermacher/L3-8B-Everything-COT-i1-GGUF

8B • Updated Aug 2, 2024 • 87 • 2