Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32,638

Base only

Active filters: imatrix

mradermacher/llama3-8B-DarkIdol-2.3-Uncensored-32K-i1-GGUF

8B • Updated Aug 2, 2024 • 697 • 10

mradermacher/Samantha-roleplay-ptbr-v2-i1-GGUF

13B • Updated Aug 2, 2024 • 205

mradermacher/Cerebro_BM_solar_v01-i1-GGUF

11B • Updated Aug 2, 2024 • 314

mradermacher/NieR-Automata-Chatbot-int4-V1-1-0-i1-GGUF

7B • Updated Aug 2, 2024 • 68

mradermacher/L3-Himerus-Basis.C-13B-i1-GGUF

13B • Updated Dec 16, 2024 • 102 • 1

mradermacher/NieR-Automata-Chatbot-none-V1-2-i1-GGUF

7B • Updated Aug 2, 2024 • 109

mmnga/Mistral-Nemo-Instruct-2407-gguf

12B • Updated Jul 22, 2024 • 100 • 2

mradermacher/L3-Intermix-v0.1-i1-GGUF

8B • Updated Aug 2, 2024 • 50 • 1

mradermacher/NieR-Automata-Chatbot-int4-V3-i1-GGUF

7B • Updated Aug 2, 2024 • 88

duyntnet/Nous-Hermes-Llama2-13b-imatrix-GGUF

Text Generation • 13B • Updated Jul 23, 2024 • 1.2k • 1

backyardai/Chaifighter-20B-v2.1-GGUF

Text Generation • 19B • Updated Jul 23, 2024 • 104 • 1

snakeying/Gemma2-9B

9B • Updated Jul 23, 2024 • 4

dineshjain/Qwen-2-gguf

8B • Updated Jul 23, 2024 • 1

dineshjain/Gemma-2-gguf

9B • Updated Jul 23, 2024 • 2

Niansuh/Llama-3-Groq-8B-Tool-Use-IQ4_NL-GGUF

8B • Updated Jul 23, 2024 • 47

mradermacher/Gemmoy-9B-G2-MK.3-i1-GGUF

9B • Updated Aug 2, 2024 • 7

legraphista/Mistral-Nemo-Instruct-2407-IMat-GGUF

Text Generation • 12B • Updated Jul 23, 2024 • 310 • 2

mradermacher/L3-Intermix-v0.2-i1-GGUF

8B • Updated Feb 21, 2025 • 73 • 1

mradermacher/Symbol-LLM-8B-Instruct-i1-GGUF

8B • Updated Aug 2, 2024 • 30

mradermacher/Llama-3-8B-ProLong-64k-Base-i1-GGUF

8B • Updated Oct 11, 2024 • 521

mradermacher/L3-8B-Intermix-v0.3-i1-GGUF

8B • Updated Dec 18, 2024 • 179

mradermacher/cydinfo-llama3-8b-lora-v01-i1-GGUF

8B • Updated Aug 2, 2024 • 81

bartowski/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 29, 2024 • 42.1k • 73

legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 1.23k • 6

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 177k • 38

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 29, 2024 • 173k • 41

mmnga/Llama-3.1-8B-Instruct-gguf

8B • Updated Jul 24, 2024 • 1.62k • 8

mradermacher/L3-8B-Tamamo-v1-i1-GGUF

8B • Updated Aug 2, 2024 • 111 • 2

legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF

Text Generation • 71B • Updated Jul 27, 2024 • 624 • 11

mradermacher/ghost-8b-beta-i1-GGUF

8B • Updated Aug 2, 2024 • 360 • 1