Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,045

Base only

Active filters: ro

async0x42/Magistral-Small-2506-exl3_4.5bpw

Text Generation • 7B • Updated Jun 26, 2025 • 6

DavidAU/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-II-Instruct-2506

Text Generation • 46B • Updated Jun 29, 2025 • 71 • 9

mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-i1-GGUF

45B • Updated Jul 11, 2025 • 151 • 3

Jellon/Mistral-Small-3.2-24B-Instruct-2506-exl3-4bpw

Image-Text-to-Text • 7B • Updated Jun 26, 2025 • 12

streamalpha/flan-t5-large-Q4_K_M-GGUF

0.8B • Updated Jun 26, 2025

mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-II-Instruct-2506-GGUF

45B • Updated Jul 31, 2025 • 871 • 6

mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-II-Instruct-2506-i1-GGUF

45B • Updated Jul 11, 2025 • 312 • 4

async0x42/Mistral-Small-3.2-24B-Instruct-2506-exl3_4.0bpw

Image-Text-to-Text • 7B • Updated Jun 27, 2025 • 12

async0x42/Mistral-Small-3.2-24B-Instruct-2506-exl3_4.5bpw

Image-Text-to-Text • 8B • Updated Jun 26, 2025 • 14

tripolskypetr/magistral-24b

Text Generation • 24B • Updated Jun 27, 2025 • 17

shethjenil/argostranslate

Translation • Updated Jun 28, 2025 • 1

muranAI/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Text Generation • 24B • Updated Jun 28, 2025 • 164 • 1

DUTAOZHANG/flan-t5-small-Q4_K_M-GGUF

77M • Updated Jun 28, 2025 • 7

DUTAOZHANG/flan-t5-base-Q4_K_M-GGUF

0.2B • Updated Jun 28, 2025 • 3

xelcior/piper-tts-gpu

Updated Jun 30, 2025 • 2

drwlf/Medra4b-65424

Text Generation • Updated Jul 2, 2025 • 13

enacimie/madlad400-10b-mt-Q4_K_M-GGUF

Translation • 11B • Updated Jul 2, 2025 • 9

enacimie/madlad400-7b-mt-Q4_K_M-GGUF

Translation • 8B • Updated Jul 2, 2025 • 40

enacimie/madlad400-3b-mt-Q4_K_M-GGUF

Translation • 3B • Updated Jul 2, 2025 • 47

Dyna-99/local-st-model

Sentence Similarity • 0.3B • Updated Jul 3, 2025 • 19

IoanaLiviaPopescu/real-data-synth-data-2000-1-Emil-Neural-whisper-medium-v1

Automatic Speech Recognition • 0.8B • Updated Jul 3, 2025 • 4

IoanaLiviaPopescu/real-data-synth-data-800-1-Emil-Neural-whisper-medium-v1

Automatic Speech Recognition • 0.8B • Updated Jul 3, 2025 • 5

webnn/whisper-base-webnn

Automatic Speech Recognition • Updated Dec 12, 2025

IoanaLiviaPopescu/real-data-whisper-medium-v1

Automatic Speech Recognition • 0.8B • Updated Jul 3, 2025 • 4

mradermacher/Medra4b-65424-GGUF

Summarization • 5B • Updated Jul 31, 2025 • 160

mradermacher/Medra4b-65424-i1-GGUF

Summarization • 5B • Updated Jul 11, 2025 • 251

Prince-1/Devstral-Small-2505

Text Generation • Updated Jul 23, 2025

mistralai/Devstral-Small-2507

24B • Updated Aug 18, 2025 • 17k • 368

crassusad44/EuroLLM-9B-Instruct-Q8_0-GGUF

9B • Updated Jul 4, 2025 • 8

crassusad44/EuroLLM-1.7B-Instruct-Q8_0-GGUF

2B • Updated Jul 4, 2025 • 5