Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,727

Full-text search

Active filters: imatrix

mradermacher/cydinfo-llama3-8b-lora-v01-i1-GGUF

8B • Updated Aug 2, 2024 • 80

bartowski/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 29, 2024 • 18.9k • 69

legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 4.7k • 6

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 104k • 33

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 29, 2024 • 103k • 40

lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 21.5k • 256

mmnga/Llama-3.1-8B-Instruct-gguf

8B • Updated Jul 24, 2024 • 764 • 8

mradermacher/L3-8B-Tamamo-v1-i1-GGUF

8B • Updated Aug 2, 2024 • 81 • 2

legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF

Text Generation • 71B • Updated Jul 27, 2024 • 435 • 11

mradermacher/ghost-8b-beta-i1-GGUF

8B • Updated Aug 2, 2024 • 231 • 1

mmnga/Llama-3.1-70B-Instruct-gguf

71B • Updated Jul 24, 2024 • 859 • 2

duyntnet/Mistral-Nemo-Instruct-2407-imatrix-GGUF

Text Generation • 12B • Updated Jul 24, 2024 • 52

nisten/meta-405b-instruct-cpu-optimized-gguf

410B • Updated Jul 24, 2024 • 156 • 40

legraphista/Llama-Guard-3-8B-IMat-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 626 • 5

MugenYume/phi-3.1-abliterated-Q4_K_M-GGUF

4B • Updated Jul 23, 2024 • 5

MugenYume/phi-3.1-abliterated-Q5_K_M-GGUF

4B • Updated Jul 23, 2024 • 5

MugenYume/phi-3.1-abliterated-Q5_K_S-GGUF

4B • Updated Jul 23, 2024 • 2

backyardai/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 24, 2024 • 79 • 3

MugenYume/Meta-Llama-3.1-8B-Instruct-Q4_K_S-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 9

lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 28, 2024 • 1.77k • 36

Reiterate3680/Hathor_Sofit-L3-8B-v1-GGUF

Text Generation • 8B • Updated Aug 5, 2024 • 8

backyardai/L3-Horizon-Anteros-v0.1-13B-GGUF

13B • Updated Jul 24, 2024 • 29 • 1

backyardai/L3-Stheno-Maid-Blackroot-Grand-HORROR-16B-GGUF

17B • Updated Jul 24, 2024 • 106 • 2

herrkobold/SauerkrautLM-1.5b-IQ4_XS-GGUF

2B • Updated Jul 24, 2024 • 2

Reiterate3680/mini-magnum-12b-v1.1-GGUF

Text Generation • 12B • Updated Aug 6, 2024 • 154 • 3

herrkobold/Wiedervereinigung-7b-dpo-laser-IQ3_M-GGUF

7B • Updated Jul 24, 2024 • 1

AI-Engine/gemma-2-27b-it-GGUF

27B • Updated Jul 24, 2024 • 49

legraphista/Mistral-Large-Instruct-2407-IMat-GGUF

Text Generation • 123B • Updated Jul 25, 2024 • 218 • 29

bartowski/Mistral-Large-Instruct-2407-GGUF

Text Generation • 123B • Updated Aug 27, 2024 • 1.38k • 35

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • 123B • Updated Jul 26, 2024 • 409 • 21