Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

10,567

Base only

Active filters: reasoning

ubitus/Mistral-24B-Reasoning-zhTW

Text Generation • 24B • Updated Mar 10, 2025 • 2

mradermacher/FluentlyLM-Prinum-GGUF

33B • Updated Sep 8, 2025 • 211 • 8

Lucy-in-the-Sky/Mistral-Small-24B-Instruct-2501-reasoning-Q2_K-GGUF

Text Generation • 24B • Updated Feb 17, 2025 • 19

Lucy-in-the-Sky/Mistral-Small-24B-Instruct-2501-reasoning-Q4_K_M-GGUF

Text Generation • 24B • Updated Feb 17, 2025 • 147 • 1

matrixportalx/Deep-Reasoning-Llama-3.2-Dolphin3.0-3B-Q4_K_M-GGUF

3B • Updated Feb 17, 2025 • 15

YeonwooSung/DeepHermes-3-Llama-3-8B-Preview-Q4_K_M-GGUF

8B • Updated Feb 17, 2025 • 27

matrixportalx/Deep-Reasoning-Llama-3.2-Enigma-3B-GGUF

3B • Updated Feb 17, 2025 • 18

Lucy-in-the-Sky/Mistral-Small-24B-Instruct-2501-reasoning-Q6_K-GGUF

Text Generation • 24B • Updated Feb 17, 2025 • 27 • 1

Lucy-in-the-Sky/Mistral-Small-24B-Instruct-2501-reasoning-Q8_0-GGUF

Text Generation • 24B • Updated Feb 17, 2025 • 15

brittlewis12/Mistral-Small-24B-Instruct-2501-reasoning-GGUF

Text Generation • 24B • Updated Feb 17, 2025 • 309 • 3

mradermacher/Deep-Reasoning-Llama-3.2-Hermes-3-3B-GGUF

3B • Updated May 28, 2025 • 209 • 1

mradermacher/Deep-Reasoning-Llama-3.2-COT-3B-GGUF

3B • Updated May 28, 2025 • 166

mradermacher/Deep-Reasoning-Llama-3.2-BlackSheep-3B-GGUF

3B • Updated May 28, 2025 • 101 • 1

mradermacher/Deep-Reasoning-Llama-3.2-Overthinker-3B-GGUF

3B • Updated May 28, 2025 • 23

Lucy-in-the-Sky/Deep-Reasoning-Llama-3.2-Overthinker-3B-Q8_0-GGUF

3B • Updated Feb 17, 2025 • 26

mradermacher/Deep-Reasoning-Llama-3.2-Enigma-3B-GGUF

3B • Updated May 28, 2025 • 103

mradermacher/Deep-Reasoning-Llama-3.2-Instruct-uncensored-3B-GGUF

3B • Updated May 28, 2025 • 57 • 1

mradermacher/Deep-Reasoning-Llama-3.2-Korean-Bllossom-3B-GGUF

3B • Updated May 28, 2025 • 176 • 1

Lucy-in-the-Sky/Deep-Reasoning-Llama-3.2-Overthinker-3B-Q6_K-GGUF

3B • Updated Feb 17, 2025 • 11

Lucy-in-the-Sky/Deep-Reasoning-Llama-3.2-Overthinker-3B-Q4_K_M-GGUF

3B • Updated Feb 17, 2025 • 24

mradermacher/Deep-Reasoning-Llama-3.2-Dolphin3.0-3B-GGUF

3B • Updated May 28, 2025 • 199

mradermacher/Deep-Reasoning-Llama-3.2-ShiningValiant2-3B-GGUF

3B • Updated May 28, 2025 • 156

mradermacher/Deep-Reasoning-Llama-3.2-Hermes-3-3B-i1-GGUF

3B • Updated May 28, 2025 • 123 • 1

mradermacher/Mistral-Small-24B-Instruct-2501-reasoning-GGUF

24B • Updated Feb 23, 2025 • 159 • 1

mradermacher/Deep-Reasoning-Llama-3.2-Overthinker-3B-i1-GGUF

3B • Updated May 28, 2025 • 124

mradermacher/Deep-Reasoning-Llama-3.2-JametMini-3B-MK.III-GGUF

3B • Updated May 28, 2025 • 119 • 1

mradermacher/Deep-Reasoning-Llama-3.2-Korean-Bllossom-3B-i1-GGUF

3B • Updated May 28, 2025 • 243 • 1

mradermacher/Deep-Reasoning-Llama-3.2-BlackSheep-3B-i1-GGUF

3B • Updated May 28, 2025 • 130 • 1

mradermacher/Deep-Reasoning-Llama-3.2-COT-3B-i1-GGUF

3B • Updated May 28, 2025 • 131

CharanSaiVaddi/gsm8k-gemma-2

Text Generation • Updated Feb 21, 2025