Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,957

Full-text search

Active filters: 3-bit

ubaitur5/Qwen2.5-32B-Instruct-Q3-mlx

Text Generation • Updated Apr 28, 2025 • 28

mlx-community/DeepSeek-V2.5-1210-3bit-32

Text Generation • 37B • Updated Jan 22, 2025 • 13

mlx-community/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview-3bit

4B • Updated Jan 23, 2025 • 42 • 2

MaziyarPanahi/SuperThoughts-CoT-14B-16k-o1-QwQ-GGUF

Text Generation • 15B • Updated Jan 24, 2025 • 3

MaziyarPanahi/Phi-4-Empathetic-GGUF

Text Generation • 15B • Updated Jan 24, 2025 • 10

MaziyarPanahi/Phi-4-QwQ-GGUF

Text Generation • 15B • Updated Jan 24, 2025 • 5

MaziyarPanahi/Llama-8B-Distill-CoT-GGUF

Text Generation • 8B • Updated Jan 24, 2025 • 1

MaziyarPanahi/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • 8B • Updated Jan 24, 2025 • 45

MaziyarPanahi/xLAM-7b-fc-r-GGUF

Text Generation • 7B • Updated Jan 24, 2025 • 15

MaziyarPanahi/xLAM-1b-fc-r-GGUF

Text Generation • 1B • Updated Jan 24, 2025 • 6

mlx-community/Evathene-v1.3-MLX-3Bit

Text Generation • 9B • Updated Jan 25, 2025 • 1

mlx-community/Nova-Tempus-70B-v0.1-MLX-3Bit

Text Generation • Updated Jan 26, 2025

mlx-community/Qwen2.5-7B-Instruct-1M-3bit

Text Generation • Updated Jan 26, 2025 • 11

mlx-community/Qwen2.5-14B-Instruct-1M-3bit

Text Generation • Updated Jan 26, 2025 • 6

roleplaiapp/Fimbulvetr-11B-v2-i1-Q3_K_S-GGUF

Text Generation • 11B • Updated Jan 27, 2025 • 3

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q3_K_L-GGUF

Text Generation • 8B • Updated Jan 27, 2025

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q3_K_M-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 14

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q3_K_S-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 4

roleplaiapp/QwQ-32B-Preview-abliterated-Q3_K_L-GGUF

Text Generation • 33B • Updated Jan 27, 2025 • 5

roleplaiapp/MN-12B-Mag-Mell-R1-Q3_K_L-GGUF

Text Generation • 12B • Updated Jan 27, 2025 • 2

roleplaiapp/MN-12B-Mag-Mell-R1-Q3_K_M-GGUF

Text Generation • 12B • Updated Jan 27, 2025

roleplaiapp/MN-12B-Mag-Mell-R1-Q3_K_S-GGUF

Text Generation • 12B • Updated Jan 27, 2025 • 1

beezu/Nova-Tempus-70B-v0.2-MLX-3Bit

Text Generation • 9B • Updated Feb 2, 2025 • 1

beezu/Anubis-70B-v1-MLX-3Bit

9B • Updated Jan 27, 2025 • 1

altomek/RE-70B-AS3D-3.5bpw-EXL2

Updated Jan 29, 2025 • 3

altomek/RE-70B-AS3D-3.75bpw-EXL2

Updated Jan 29, 2025

roleplaiapp/Midnight-Miqu-70B-v1.5-i1-Q3_K_L-GGUF

Text Generation • 69B • Updated Jan 28, 2025 • 5

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q3_K_L-GGUF

Text Generation • 3B • Updated Jan 28, 2025

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q3_K_M-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 9

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q3_K_S-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 5