Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,957

Full-text search

Active filters: 3-bit

Alissonerdx/YuE-s2-1B-general-exl2-3.0bpw

Text Generation • Updated Feb 6, 2025 • 2

OPEA/Llama-3.3-70B-Instruct-int3-sym-inc

66B • Updated Apr 30, 2025 • 2

beezu/Anubis-Pro-105B-v1-MLX-3Bit

13B • Updated Feb 7, 2025 • 6

CuckmeisterFuller/Dolphin3.0-Mistral-24B-Q3-mlx

Text Generation • 3B • Updated Feb 8, 2025 • 14

mlx-community/Hunyuan-7B-Instruct-3bit

Text Generation • 0.9B • Updated Feb 8, 2025 • 3

MaziyarPanahi/Sqweeks-7B-Instruct-GGUF

Text Generation • 8B • Updated Feb 8, 2025 • 1

MaziyarPanahi/Qwen2.5-14B-Instruct-1M-GGUF

Text Generation • 15B • Updated Feb 8, 2025 • 17 • 2

AlfRjw/DeepSeek-R1-ReDistill-Llama3-8B-v1.1-Q3-mlx

Text Generation • 1B • Updated Feb 9, 2025 • 5

MaziyarPanahi/IFeelSoSprunki-8B-Llama3.1-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 3

MaziyarPanahi/DeepSeek-Grand-Horror-SMB-R1-Distill-Llama-3.1-16B-GGUF

Text Generation • 16B • Updated Feb 10, 2025 • 16

MaziyarPanahi/Captain-Eris_Violet_Toxic-Magnum-12B-GGUF

Text Generation • 12B • Updated Feb 10, 2025 • 94 • 4

MaziyarPanahi/Qwen-2.5-7B-Exp-Sce-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 18

MaziyarPanahi/Slush-ChatWaifu-Chronos-GGUF

Text Generation • 12B • Updated Feb 10, 2025 • 5 • 1

MaziyarPanahi/Qwen2.5-7B-Gordion-v0.1-Prose-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 7

MaziyarPanahi/Llama-Krikri-8B-Instruct-GGUF

Text Generation • 8B • Updated Feb 10, 2025 • 4

roleplaiapp/mistralai_Mistral-Small-Instruct-2409-exl2-3.0bpw

Updated Feb 11, 2025

MaziyarPanahi/DarkIdol-LongWriter-8B-Uncensored-1048k-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 41 • 1

MaziyarPanahi/QVikhr-2.5-1.5B-Instruct-r-GGUF

Text Generation • 2B • Updated Feb 12, 2025 • 2

MaziyarPanahi/S1_4o_mini-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 13

MaziyarPanahi/Intelligence-Agent-7B-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 68

MaziyarPanahi/german-r1-GGUF

Text Generation • 3B • Updated Feb 12, 2025 • 23 • 1

MaziyarPanahi/SAXON-0-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 6

MaziyarPanahi/Gemma-9B-Base-GGUF

Text Generation • 9B • Updated Feb 12, 2025 • 5

SicariusSicariiStuff/Phi-lthy4-3.0bpw

Text Generation • Updated Jul 26, 2025 • 2

numen-tech/Dolphin3.0-Llama3.1-8B-w3a16g40sym

Text Generation • Updated Feb 13, 2025

LLMJapan/nvidia_AceInstruct-72B-exl2-3.0bpw

Text Generation • Updated Feb 14, 2025 • 1

MaziyarPanahi/Hiber-Multi-10B-Instruct-GGUF

Text Generation • 11B • Updated Feb 14, 2025 • 8

MaziyarPanahi/LlamaThink-8B-instruct-GGUF

Text Generation • 8B • Updated Feb 14, 2025 • 14

MaziyarPanahi/MT-Merge6-gemma-2-9B-GGUF

Text Generation • 9B • Updated Feb 14, 2025 • 4 • 1

MaziyarPanahi/Korean-QWEN-Coder2.5-14B-GGUF

Text Generation • 15B • Updated Feb 14, 2025 • 72