Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,655

Base only

Active filters: ro

stelterlab/Devstral-Small-2507-FP8

Text Generation • Updated Jul 11, 2025 • 2.25k • 2

mlx-community/Devstral-Small-2507-5bit

Text Generation • 24B • Updated Jul 11, 2025 • 37 • 1

mlx-community/Devstral-Small-2507-4bit

Text Generation • 24B • Updated Jul 11, 2025 • 232 • 1

mlx-community/Devstral-Small-2507-6bit

Text Generation • 24B • Updated Jul 11, 2025 • 37 • 1

mlx-community/Devstral-Small-2507-8bit

Text Generation • 24B • Updated Jul 11, 2025 • 51 • 1

mlx-community/Devstral-Small-2507-4bit-DWQ

Text Generation • 24B • Updated Jul 12, 2025 • 179 • 12

cyankiwi/Devstral-Small-2507-AWQ-4bit

24B • Updated Jan 13 • 5.46k • 9

shtilev/medical_embedded_v5

Sentence Similarity • 0.3B • Updated Jul 12, 2025 • 7

zouharvi/COMET-poly-ic3-wmt25

Translation • Updated Jul 13, 2025 • 1

drwlf/Medra4b-abliterated

Text Generation • Updated Jul 16, 2025 • 3 • 4

klusai/tf2-1b-gguf

Translation • 1.0B • Updated Jul 17, 2025 • 2 • 2

mradermacher/Medra4b-abliterated-GGUF

Summarization • 5B • Updated Jul 31, 2025 • 25

mradermacher/Medra4b-abliterated-i1-GGUF

Summarization • 5B • Updated Jul 16, 2025 • 73

apolloparty/Devstral-Small-2507-NVFP4A16

14B • Updated Jul 18, 2025 • 237 • 1

mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF

44B • Updated Jul 31, 2025 • 217 • 1

SreeniHF1/madlad400-3b-mt-Q2_K-GGUF

Translation • 3B • Updated Jul 15, 2025 • 3

lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-MLX-6bit

Image-Text-to-Text • Updated Jul 15, 2025 • 26k

lmstudio-community/Mistral-Small-3.2-24B-Instruct-2506-MLX-8bit

Image-Text-to-Text • Updated Jul 15, 2025 • 20.6k • 1

Dav66/Te

Text Generation • 8B • Updated Jul 15, 2025 • 5

mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-i1-GGUF

44B • Updated Jul 16, 2025 • 411 • 1

linhha2705/multilingual-e5-nutrition

Sentence Similarity • 0.3B • Updated Jul 16, 2025 • 111

tensorblock/kyutai_helium-1-2b-GGUF

Text Generation • 2B • Updated Jan 27 • 15 • 2

ByteDance-Seed/Seed-X-PPO-7B

Translation • 8B • Updated Jul 28, 2025 • 9.2k • 302

ByteDance-Seed/Seed-X-Instruct-7B

Translation • 8B • Updated Jul 28, 2025 • 137 • 128

Loom-Labs/Apollo-1-4B

Text Generation • 4B • Updated Aug 31, 2025 • 10 • 5

mradermacher/Nous-V1-4B-GGUF

4B • Updated Sep 27, 2025 • 40 • 1

mradermacher/Nous-V1-4B-i1-GGUF

4B • Updated Sep 24, 2025 • 246

Loom-Labs/Apollo-1-8B

Text Generation • 8B • Updated Aug 31, 2025 • 26 • • 8

Loom-Labs/Apollo-1-2B

Text Generation • 2B • Updated Aug 31, 2025 • 34 • • 5

mistralai/Magistral-Small-2507

24B • Updated Dec 22, 2025 • 374 • 104