Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,787

Base only

Active filters: imatrix

Felladrin/gguf-sharded-Qwen1.5-0.5B-Chat_llamafy

0.6B • Updated Aug 8, 2024 • 79

mradermacher/huskylm-2.5-8b-i1-GGUF

8B • Updated Aug 2, 2024 • 658

mradermacher/L3-Inca-8B-v0.8-i1-GGUF

8B • Updated Aug 2, 2024 • 54

mradermacher/New-Dawn-Llama-3-70B-32K-v1.0-i1-GGUF

71B • Updated Aug 2, 2024 • 272 • 10

mradermacher/miquplus-xwin-70b-i1-GGUF

69B • Updated Aug 2, 2024 • 977 • 2

mradermacher/Templar_v1_8B-i1-GGUF

8B • Updated Aug 2, 2024 • 594

bartowski/Replete-Coder-Qwen2-1.5b-GGUF

Text Generation • 2B • Updated Jun 23, 2024 • 582 • 14

markhneedham/Mistral-7B-v0.3-IQ4_NL-GGUF

7B • Updated Jun 23, 2024 • 10

mradermacher/Qwen2-57B-A14B-i1-GGUF

57B • Updated Aug 2, 2024 • 181

mradermacher/Qwen2-57B-A14B-Instruct-i1-GGUF

57B • Updated Aug 2, 2024 • 207 • 2

mradermacher/L3-Stur-v1-15B-i1-GGUF

15B • Updated Aug 2, 2024 • 76

mradermacher/Hathor_Gamma-L3-8B-0.6-i1-GGUF

8B • Updated Dec 16, 2024 • 453

mradermacher/Llama3-Sophie-i1-GGUF

8B • Updated Dec 16, 2024 • 199 • 2

NikolayKozloff/tabula-8b-IQ4_NL-GGUF

8B • Updated Jun 23, 2024 • 11 • 1

mradermacher/Symbol-LLM-7B-Instruct-i1-GGUF

7B • Updated Aug 2, 2024 • 203

mradermacher/L3-Stur-v1-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 144

mradermacher/L3-Sophie-improved-v1-i1-GGUF

8B • Updated Aug 2, 2024 • 77

mradermacher/AceGPT-v2-32B-i1-GGUF

33B • Updated Aug 2, 2024 • 107

legraphista/RoLlama3-8b-Instruct-IMat-GGUF

Text Generation • 8B • Updated Jun 23, 2024 • 1.89k • 3

mradermacher/Symbol-LLM-13B-Instruct-i1-GGUF

13B • Updated Aug 2, 2024 • 54

mradermacher/L3-sophie-improved-v2-i1-GGUF

8B • Updated Aug 2, 2024 • 86

mradermacher/AceGPT-v2-32B-Chat-i1-GGUF

33B • Updated Aug 2, 2024 • 171

mradermacher/L3-UI-v1-8B-i1-GGUF

8B • Updated Aug 2, 2024 • 184

duyntnet/Karen_TheEditor_V2_CREATIVE_Mistral_7B-imatrix-GGUF

Text Generation • 7B • Updated Jun 24, 2024 • 91

Tilo15/cosmic-2

Text Generation • 7B • Updated Aug 5, 2024 • 80 • 1

arcee-ai/Arcee-Spark-GGUF

8B • Updated Jun 24, 2024 • 242 • 27

DavidAU/Command-R-01-Ultra-NEO-V1-35B-IMATRIX-GGUF

Text Generation • 35B • Updated May 21 • 1.67k • 25

bartowski/dolphin-2.9.3-Yi-1.5-34B-32k-GGUF

Text Generation • 34B • Updated Jun 24, 2024 • 1.38k • 25

mradermacher/SthenoBu8bl3-32K-i1-GGUF

8B • Updated Aug 2, 2024 • 109

NikolayKozloff/Morfoz-LLM-8b-v1.0-IQ4_NL-GGUF

8B • Updated Jun 24, 2024 • 9 • 1