Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,038

Base only

Active filters: uk

crassusad44/EuroLLM-1.7B-Instruct-Q8_0-GGUF

2B • Updated Jul 4, 2025 • 5

zouharvi/COMET-poly-cand1-wmt25

Translation • Updated 18 days ago • 9 • 1

AndreiWTP/Mistral-Small-3.1-24B-Base-2503-Q4_K_M-GGUF

24B • Updated Jul 5, 2025 • 18

Downtown-Case/c4ai-command-a-03-2025-exl3-3.12bpw-hb6

Text Generation • 25B • Updated Jul 6, 2025 • 6 • 2

LangTech-MT/salamandraTA-7b-instruct-WMT25

Translation • 8B • Updated Sep 18, 2025 • 30

mistralai/Devstral-Small-2507_gguf

Text Generation • 24B • Updated Jul 23, 2025 • 4.42k • 49

nicoboss/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed

Image-Text-to-Text • 24B • Updated Jul 7, 2025 • 19 • • 1

mradermacher/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed-GGUF

24B • Updated Jul 31, 2025 • 2.09k • 5

mradermacher/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed-i1-GGUF

24B • Updated Jul 11, 2025 • 1.15k • 4

TheStageAI/Elastic-whisper-large-v3

Automatic Speech Recognition • Updated Jun 4 • 20 • 2

zouharvi/COMET-poly-base-wmt25

Translation • Updated 18 days ago • 8

PatrickHaller/snowflake-arctic-embed-m-v2.0

Sentence Similarity • 0.3B • Updated Jul 10, 2025 • 54

lmstudio-community/Devstral-Small-2507-MLX-bf16

Text Generation • 24B • Updated Jul 10, 2025 • 15.3k •

lmstudio-community/Devstral-Small-2507-MLX-4bit

Text Generation • 24B • Updated Jul 10, 2025 • 15.7k • 4

lmstudio-community/Devstral-Small-2507-MLX-6bit

Text Generation • 24B • Updated Jul 10, 2025 • 15.6k

lmstudio-community/Devstral-Small-2507-MLX-8bit

Text Generation • 24B • Updated Jul 10, 2025 • 16.2k • 1

AzrilFahmiardi/persona-fit-embedding

Sentence Similarity • 0.1B • Updated Jul 9, 2025 • 81

tensorblock/utter-project_EuroMoE-2.6B-A0.6B-Instruct-Preview-GGUF

3B • Updated Jan 27 • 13

unsloth/Devstral-Small-2507

Text Generation • 24B • Updated Jul 10, 2025 • 537 • • 3

unsloth/Devstral-Small-2507-GGUF

24B • Updated Dec 10, 2025 • 6.52k • 80

unsloth/Devstral-Small-2507-unsloth-bnb-4bit

Text Generation • 24B • Updated Jul 10, 2025 • 190 • 5

bartowski/mistralai_Devstral-Small-2507-GGUF

Image-Text-to-Text • 24B • Updated Jul 12, 2025 • 1.93k • 9

mlx-community/Devstral-Samll-2507-bf16

Text Generation • 24B • Updated Jul 10, 2025 • 31 • 1

gabriellarson/Devstral-Small-2507-GGUF

Text Generation • 24B • Updated Jul 10, 2025 • 85

ArtusDev/mistralai_Devstral-Small-2507-EXL3

Text Generation • Updated Jul 10, 2025 • 34 • 6

zouharvi/COMET-poly-cand2-wmt25

Translation • Updated 18 days ago • 10

zouharvi/COMET-poly-ic1-wmt25

Translation • Updated 18 days ago • 8

stelterlab/Devstral-Small-2507-FP8

Text Generation • Updated Jul 11, 2025 • 622 • 2

mlx-community/Devstral-Small-2507-5bit

Text Generation • 24B • Updated Jul 11, 2025 • 25 • 1

mlx-community/Devstral-Small-2507-4bit

Text Generation • 24B • Updated Jul 11, 2025 • 182 • 1