Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,327

Base only

Active filters: ms

mlx-community/Llama-SEA-LION-v3-8B-IT-mlx-4bit

Text Generation • 2B • Updated Sep 10, 2025 • 12

notcaleb/Hunyuan-MT-7B-Q4_K_M-GGUF

Translation • 8B • Updated Sep 11, 2025 • 23

mistralai/Magistral-Small-2509-GGUF

24B • Updated Sep 18, 2025 • 1.15k • 73

Savyasaachin/snowflake-arctic-embed-l-v2.0-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Sep 14, 2025 • 76 • 1

illian64/madlad400-10b-mt-ct2-bfloat16

Translation • Updated Sep 15, 2025 • 5 • 1

illian64/madlad400-7b-mt-ct2-bfloat16

Translation • Updated Sep 19, 2025 • 5 • 1

Antrugos/namuywam-es-embeddings

Sentence Similarity • 0.1B • Updated Sep 17, 2025 • 2 • 1

unsloth/Magistral-Small-2509

24B • Updated Sep 29, 2025 • 39 • 10

unsloth/Magistral-Small-2509-GGUF

24B • Updated Sep 17, 2025 • 11.1k • 100

unsloth/Magistral-Small-2509-bnb-4bit

24B • Updated Sep 18, 2025 • 7 • 1

unsloth/Magistral-Small-2509-unsloth-bnb-4bit

24B • Updated Sep 29, 2025 • 294 • 6

unsloth/Magistral-Small-2509-FP8-Dynamic

24B • Updated Sep 29, 2025 • 310 • 6

unsloth/Magistral-Small-2509-FP8-torchao

Updated Sep 17, 2025 • 3 • 1

mrtoots/unsloth-Magistral-Small-2509-mlx-8Bit

24B • Updated Sep 17, 2025 • 48 • 1

Horkios/Magistral-Small-2509-mlx-4Bit

24B • Updated Sep 17, 2025 • 13

ArtusDev/mistralai_Magistral-Small-2509-EXL3

Updated Oct 13, 2025 • 6 • 5

lmstudio-community/Magistral-Small-2509-MLX-4bit

Updated Sep 17, 2025 • 28.8k

lmstudio-community/Magistral-Small-2509-MLX-5bit

Updated Sep 17, 2025 • 28.2k

lmstudio-community/Magistral-Small-2509-MLX-6bit

Updated Sep 17, 2025 • 28.2k

clapAI/mmBERT-small-multilingual-sentiment

Text Classification • 0.1B • Updated Sep 20, 2025 • 371 • 1

rubricreward/mR3-Qwen3-4B-tgt-prompt-en-thinking

Text Generation • 4B • Updated Oct 2, 2025 • 1

electroglyph/snowflake-arctic-embed-m-v2.0-ONNX-quant

Sentence Similarity • Updated Sep 19, 2025 • 9

olegshulyakov/nomic-embed-text-v2-moe-GGUF

Sentence Similarity • 0.5B • Updated Sep 19, 2025 • 113 • 1

AlexanderKyng/Devstral-Small-2507-int4-AutoRound

Text Generation • 1B • Updated Sep 19, 2025 • 13 • 1

rubricreward/mR3-Qwen3-4B-en-prompt-en-thinking

Text Generation • 4B • Updated Oct 2, 2025 • 5 • • 2

rubricreward/mR3-Qwen3-4B-tgt-prompt-tgt-thinking

Text Generation • 4B • Updated Oct 2, 2025 • 9

rubricreward/mR3-Qwen3-4B-tgt-prompt-tgt-thinking-translated

Text Generation • 4B • Updated Oct 2, 2025 • 5

rubricreward/mR3-Qwen3-8B-en-prompt-en-thinking

Text Generation • 8B • Updated Oct 2, 2025 • 5

rubricreward/mR3-Qwen3-8B-tgt-prompt-en-thinking

Text Generation • 8B • Updated Oct 2, 2025 • 2

rubricreward/mR3-Qwen3-8B-tgt-prompt-tgt-thinking

Text Generation • 8B • Updated Oct 2, 2025 • 5