Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,560

Base only

Active filters: instruct

mradermacher/GLM-Tulu-ChatML-i1-GGUF

33B • Updated Jul 12, 2025 • 2.14k

mradermacher/Qwen3-8B-ShiningValiant3-GGUF

8B • Updated Jul 8, 2025 • 661 • 2

mradermacher/Qwen3-8B-ShiningValiant3-i1-GGUF

8B • Updated Jul 11, 2025 • 289 • 2

ValiantLabs/Qwen3-1.7B-ShiningValiant3

Text Generation • 2B • Updated Dec 9, 2025 • 24 • • 5

mradermacher/Qwen3-1.7B-ShiningValiant3-GGUF

2B • Updated Jul 11, 2025 • 110

mradermacher/Qwen3-1.7B-ShiningValiant3-i1-GGUF

2B • Updated Jul 11, 2025 • 251

crazymaker1122/Llama-3.3-8B-Instruct-awq-direct

Text Generation • 8B • Updated Jul 9, 2025 • 51

mradermacher/sokol-1.5b-02-GGUF

2B • Updated Jul 10, 2025 • 196

mradermacher/sokol-1.5b-02-i1-GGUF

2B • Updated Jul 10, 2025 • 116

mradermacher/GLM-4-32B-Tulu-Instruct-GGUF

33B • Updated Jul 31, 2025 • 79

mradermacher/GLM-4-32B-Tulu-Instruct-i1-GGUF

33B • Updated Jul 12, 2025 • 144

ValiantLabs/Qwen3-4B-ShiningValiant3

Text Generation • 4B • Updated Dec 9, 2025 • 58 • • 7

sequelbox/Qwen3-8B-PlumEsper

Text Generation • 8B • Updated Jul 14, 2025 • 5

sequelbox/Qwen3-4B-PlumEsper

Text Generation • 4B • Updated Jul 15, 2025 • 5

PJEDeveloper/Mistral-Nemo-Instruct-2407-4bit-20250714_213418

13B • Updated Jul 15, 2025 • 2

Pingsz/pruned

Text Generation • Updated Jul 15, 2025

PJEDeveloper/Mistral-7B-Instruct-v0.3-4bit-20250716_003938

Text Generation • 7B • Updated Jul 16, 2025 • 7

PJEDeveloper/Mistral-7B-Instruct-v0.2-4bit-20250716_010928

Text Generation • 7B • Updated Jul 16, 2025 • 3

aipib/Pentest_AI-IQ3_XXS-GGUF

7B • Updated Jul 17, 2025 • 19 • 1

PJEDeveloper/Mistral_Nemo_Instruct_2407-F16.gguf-Q4_K_M

12B • Updated Jul 23, 2025 • 2

isetnefret/Codex-24B-Small-3.2-mlx-4Bit

4B • Updated Jul 21, 2025 • 297

isetnefret/Mistral-Small-Instruct-2409-abliterated-mlx-4Bit

Text Generation • 3B • Updated Jul 21, 2025 • 14

PJEDeveloper/mistralai_Mistral-7B-Instruct-v0.3-F16.gguf-Q5_K_M

7B • Updated Jul 23, 2025 • 34

Polygl0t/portuguese-qwen3-4b-instruct-quality-classifier

Text Classification • 4B • Updated Mar 5 • 10

PJEDeveloper/mistralai_Mistral-7B-Instruct-v0.2-Q5_K_M

7B • Updated Jul 23, 2025 • 2

ThePegasusGroup/LunarAI

Text Generation • 16B • Updated Jul 24, 2025 • 34

mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-128k-ctx-GGUF

6B • Updated Jul 24, 2025 • 79 • 1

mradermacher/LunarAI-GGUF

Text Generation • 16B • Updated Jul 31, 2025 • 46

mradermacher/LunarAI-i1-GGUF

Text Generation • 16B • Updated Dec 18, 2025 • 44 • 1

mradermacher/Qwen3-Esper3-Reasoning-Instruct-6B-Brainstorm20x-Enhanced-E32-128k-ctx-i1-GGUF

6B • Updated Dec 18, 2025 • 251 • 1