Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,957

Full-text search

Active filters: 3-bit

roleplaiapp/Dria-Agent-a-7B-Q3_K_S-GGUF

Text Generation • Updated Jan 19, 2025 • 1

roleplaiapp/Dria-Agent-a-7B-Q3_K_M-GGUF

Text Generation • Updated Jan 19, 2025 • 1

roleplaiapp/Dria-Agent-a-7B-Q3_K_L-GGUF

Text Generation • Updated Jan 19, 2025 • 1

Statuo/Allura-Qwen2.5-32b-RP-Ink-EXL2-3bpw

Updated Jan 19, 2025 • 1

roleplaiapp/AceInstruct-72B-Q3_K_S-GGUF

Text Generation • Updated Jan 19, 2025 • 1

roleplaiapp/AceInstruct-72B-Q3_K_M-GGUF

Text Generation • 73B • Updated Jan 19, 2025 • 5

roleplaiapp/AceInstruct-72B-Q3_K_L-GGUF

Text Generation • 73B • Updated Jan 19, 2025 • 1

roleplaiapp/Wayfarer-12B-Q3_K_S-GGUF

Text Generation • 12B • Updated Jan 19, 2025

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 7

roleplaiapp/Wayfarer-12B-Q3_K_L-GGUF

Text Generation • 12B • Updated Jan 19, 2025 • 1

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 13

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF

Text Generation • 71B • Updated Jan 19, 2025 • 16

roleplaiapp/Codestral-22B-v0.1-Q3_K_S-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 2

roleplaiapp/Codestral-22B-v0.1-Q3_K_M-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 4

roleplaiapp/Codestral-22B-v0.1-Q3_K_L-GGUF

Text Generation • 22B • Updated Jan 19, 2025 • 1

roleplaiapp/AceInstruct-7B-Q3_K_S-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 1

roleplaiapp/AceInstruct-7B-Q3_K_M-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 9

roleplaiapp/AceInstruct-1.5B-Q3_K_S-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 9

roleplaiapp/AceInstruct-1.5B-Q3_K_M-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 2

roleplaiapp/AceInstruct-1.5B-Q3_K_L-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 2

roleplaiapp/AceInstruct-7B-Q3_K_L-GGUF

Text Generation • 8B • Updated Jan 19, 2025 • 6

mlx-community/DeepSeek-R1-Distill-Qwen-1.5B-3bit

0.2B • Updated Feb 26, 2025 • 205 • 1

mlx-community/DeepSeek-R1-Distill-Qwen-7B-3bit

1.0B • Updated Feb 26, 2025 • 22

mlx-community/DeepSeek-R1-3bit

105B • Updated Feb 26, 2025 • 143 • 15

mlx-community/DeepSeek-R1-Distill-Qwen-14B-3bit

2B • Updated Feb 26, 2025 • 150 • 7

mlx-community/DeepSeek-R1-Distill-Qwen-32B-3bit

4B • Updated Feb 26, 2025 • 56 • 4

mlx-community/DeepSeek-R1-Distill-Llama-8B-3bit

1B • Updated Feb 26, 2025 • 15

adamo1139/DeepSeek-R1-Distill-Qwen-1.5B-3bpw-exl2

Updated Jan 20, 2025 • 1

mlx-community/DeepSeek-R1-Distill-Llama-70B-3bit

Text Generation • 9B • Updated Feb 26, 2025 • 105 • 5

ubaitur5/DeepSeek-R1-Distill-Qwen-14B-Q3-mlx

Text Generation • Updated Jan 22, 2025 • 19