Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,038

Base only

Active filters: uk

async0x42/Magistral-Small-2506-exl3_4.0bpw

Text Generation • 6B • Updated Jun 26, 2025 • 14

FluidInference/phi-4-mini-instruct-fp16-ov-npu

Text Generation • Updated Jun 26, 2025 • 8

async0x42/Magistral-Small-2506-exl3_4.5bpw

Text Generation • 7B • Updated Jun 26, 2025 • 9

DavidAU/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-II-Instruct-2506

Text Generation • 46B • Updated Jun 29, 2025 • 38 • 9

mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-i1-GGUF

45B • Updated Jul 11, 2025 • 250 • 3

Jellon/Mistral-Small-3.2-24B-Instruct-2506-exl3-4bpw

Image-Text-to-Text • 7B • Updated Jun 26, 2025 • 18

mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-II-Instruct-2506-GGUF

45B • Updated Jul 31, 2025 • 824 • 6

mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-II-Instruct-2506-i1-GGUF

45B • Updated Jul 11, 2025 • 240 • 4

Grace-Zhang48/Phi-4-mini-instruct-Q2_K-GGUF

Text Generation • 4B • Updated Jun 26, 2025 • 7

async0x42/Mistral-Small-3.2-24B-Instruct-2506-exl3_4.0bpw

Image-Text-to-Text • 7B • Updated Jun 27, 2025 • 11

Grace-Zhang48/Phi-4-mini-instruct-Q3_K_M-GGUF

Text Generation • 4B • Updated Jun 26, 2025 • 1

Grace-Zhang48/Phi-4-mini-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Jun 26, 2025 • 4

async0x42/Mistral-Small-3.2-24B-Instruct-2506-exl3_4.5bpw

Image-Text-to-Text • 8B • Updated Jun 26, 2025 • 15

lewishamilton21/Qwen_1.5B_multilingual_Fine-Tuned_LLM

Text Generation • 2B • Updated Jul 1, 2025 • 9 • 3

tripolskypetr/magistral-24b

Text Generation • 24B • Updated Jun 27, 2025 • 14

shethjenil/argostranslate

Translation • Updated Jun 28, 2025 • 1

muranAI/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Text Generation • 24B • Updated Jun 28, 2025 • 216 • 1

xelcior/piper-tts-gpu

Updated Jun 30, 2025 • 2

Grace-Zhang48/Phi-4-mini-instruct-Q4_0-GGUF

Text Generation • 4B • Updated Jun 30, 2025 • 7

enacimie/madlad400-10b-mt-Q4_K_M-GGUF

Translation • 11B • Updated Jul 2, 2025 • 6

enacimie/madlad400-7b-mt-Q4_K_M-GGUF

Translation • 8B • Updated Jul 2, 2025 • 32

enacimie/madlad400-3b-mt-Q4_K_M-GGUF

Translation • 3B • Updated Jul 2, 2025 • 50

huihui-ai/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated

Image-Text-to-Text • 24B • Updated Jul 3, 2025 • 1.67k • • 19

Dyna-99/local-st-model

Sentence Similarity • 0.3B • Updated Jul 3, 2025 • 31

webnn/whisper-base-webnn

Automatic Speech Recognition • Updated Dec 12, 2025

Prince-1/Devstral-Small-2505

Text Generation • Updated Jul 23, 2025

Prince-1/Llama-OuteTTS-1.0-1B

Text-to-Speech • Updated Jul 4, 2025 • 1

Prince-1/Llama-OuteTTS-1.0-1B-RKllm

Text-to-Speech • Updated Jul 4, 2025 • 4 • 1

mistralai/Devstral-Small-2507

24B • Updated Aug 18, 2025 • 84k • 368

crassusad44/EuroLLM-9B-Instruct-Q8_0-GGUF

9B • Updated Jul 4, 2025 • 2