Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,493

Base only

Active filters: 3-bit

roleplaiapp/AceInstruct-72B-Q3_K_M-GGUF

Text Generation • 73B • Updated Jan 19, 2025 • 10

roleplaiapp/AceInstruct-72B-Q3_K_L-GGUF

Text Generation • 73B • Updated Jan 19, 2025 • 5

roleplaiapp/Wayfarer-12B-Q3_K_S-GGUF

Text Generation • 12B • Updated Jan 19, 2025 • 3

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 26

roleplaiapp/Wayfarer-12B-Q3_K_L-GGUF

Text Generation • 12B • Updated Jan 19, 2025 • 5

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 13

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 5

roleplaiapp/Codestral-22B-v0.1-Q3_K_S-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 5

roleplaiapp/Codestral-22B-v0.1-Q3_K_M-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 7

roleplaiapp/Codestral-22B-v0.1-Q3_K_L-GGUF

Text Generation • 22B • Updated Jan 19, 2025

roleplaiapp/AceInstruct-7B-Q3_K_S-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 5

roleplaiapp/AceInstruct-7B-Q3_K_M-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 3

roleplaiapp/AceInstruct-1.5B-Q3_K_S-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 4

roleplaiapp/AceInstruct-1.5B-Q3_K_M-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 14

roleplaiapp/AceInstruct-1.5B-Q3_K_L-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 6

roleplaiapp/AceInstruct-7B-Q3_K_L-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 4

mlx-community/DeepSeek-R1-Distill-Qwen-1.5B-3bit

0.2B • Updated Feb 26, 2025 • 181 • 1

mlx-community/DeepSeek-R1-Distill-Qwen-7B-3bit

1.0B • Updated Feb 26, 2025 • 902

mlx-community/DeepSeek-R1-3bit

105B • Updated Feb 26, 2025 • 313 • 15

mlx-community/DeepSeek-R1-Distill-Qwen-14B-3bit

2B • Updated Feb 26, 2025 • 4.03k • 7

mlx-community/DeepSeek-R1-Distill-Qwen-32B-3bit

4B • Updated Feb 26, 2025 • 147 • 4

mlx-community/DeepSeek-R1-Distill-Llama-8B-3bit

1B • Updated Feb 26, 2025 • 56

adamo1139/DeepSeek-R1-Distill-Qwen-1.5B-3bpw-exl2

Updated Jan 20, 2025 • 4

mlx-community/DeepSeek-R1-Distill-Llama-70B-3bit

Text Generation • 9B • Updated Feb 26, 2025 • 299 • 5

ubaitur5/DeepSeek-R1-Distill-Qwen-14B-Q3-mlx

Text Generation • 2B • Updated Jan 22, 2025 • 10

ubaitur5/Qwen2.5-32B-Instruct-Q3-mlx

Text Generation • 4B • Updated Apr 28, 2025 • 24

mlx-community/DeepSeek-V2.5-1210-3bit-32

Text Generation • 37B • Updated Jan 22, 2025 • 20

mlx-community/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview-3bit

4B • Updated May 7 • 511 • 2

MaziyarPanahi/SuperThoughts-CoT-14B-16k-o1-QwQ-GGUF

Text Generation • 15B • Updated Jan 24, 2025 • 20

MaziyarPanahi/Phi-4-Empathetic-GGUF

Text Generation • 15B • Updated Jan 24, 2025 • 74