Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,082

Base only

Active filters: fa

lmstudio-community/Devstral-Small-2505-MLX-4bit

Text Generation • 4B • Updated May 19, 2025 • 10.4k • 7

lmstudio-community/Devstral-Small-2505-MLX-6bit

Text Generation • 5B • Updated May 19, 2025 • 239 • 7

matrixportalx/lenML-aya-expanse-8b-abliterated-GGUF

8B • Updated May 20, 2025 • 17 • 2

nezamisafa/whisper-large-v3-turbo-fa-c13-avs

Automatic Speech Recognition • 0.8B • Updated May 21, 2025 • 3 • 1

Jarbas/m2v-256-bert-base-multilingual-cased

30.6M • Updated May 20, 2025 • 14

Jarbas/m2v-256-multilingual-e5-small

64M • Updated May 20, 2025 • 45

Jarbas/m2v-256-multilingual-e5-base

64M • Updated May 20, 2025 • 13

Jarbas/m2v-256-multilingual-e5-large

64M • Updated May 20, 2025 • 15

Jarbas/m2v-256-multilingual-e5-large-instruct

64M • Updated May 20, 2025 • 14

ysn-rfd/Athena-R3-1.5B-Q8_0-GGUF

2B • Updated May 21, 2025 • 1 • 2

unsloth/Devstral-Small-2505

Text Generation • 24B • Updated May 24, 2025 • 86 • • 21

bartowski/mistralai_Devstral-Small-2505-GGUF

Text Generation • 24B • Updated May 21, 2025 • 3.61k • 19

chutesai/Devstral-Small-2505

Text Generation • 24B • Updated Aug 7, 2025 • 16 •

reach-vb/Devstral-Small-2505

Text Generation • 24B • Updated May 21, 2025 • 11

guysh-dev/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M-GGUF

Image-Text-to-Text • 24B • Updated May 21, 2025 • 24

mlx-community/Devstral-Small-2505-3bit

Text Generation • 3B • Updated May 21, 2025 • 52 • 1

mlx-community/Devstral-Small-2505-6bit

Text Generation • 5B • Updated May 21, 2025 • 35 • 1

mlx-community/Devstral-Small-2505-4bit

Text Generation • 4B • Updated May 21, 2025 • 130k • 2

mlx-community/Devstral-Small-2505-8bit

Text Generation • 7B • Updated May 21, 2025 • 69 • 2

mlx-community/Devstral-Small-2505-bf16

Text Generation • 24B • Updated May 21, 2025 • 24 • 1

Derur/ggml-whisper_faster-whisper_models

Automatic Speech Recognition • Updated Jul 7, 2025 • 1

bullerwins/Devstral-Small-2505-fp8

Text Generation • 24B • Updated May 21, 2025 • 70 • 5

unsloth/Devstral-Small-2505-unsloth-bnb-4bit

Text Generation • Updated May 24, 2025 • 386 • 5

Abdoul-AI/Devstral-Small-2505-GGUF

Text Generation • Updated May 21, 2025

unsloth/Devstral-Small-2505-bnb-4bit

Text Generation • 24B • Updated May 24, 2025 • 292 • 3

matatonic/Devstral-Small-2505-4.25bpw-exl2

Text Generation • Updated May 21, 2025 • 13 • 2

matatonic/Devstral-Small-2505-5.0bpw-exl2

Text Generation • Updated May 21, 2025 • 10 • 1

matatonic/Devstral-Small-2505-6.5bpw-h8-exl2

Text Generation • Updated May 21, 2025 • 8

lucyknada/unsloth_Devstral-Small-2505-exl3

Text Generation • Updated May 21, 2025 • 1

ArtusDev/mistralai_Devstral-Small-2505_EXL3_3.0bpw_H6

Text Generation • 5B • Updated May 21, 2025 • 10