Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,492

Base only

Active filters: uk

unsloth/Magistral-Small-2509-FP8-torchao

Updated Sep 17, 2025 • 3 • 1

mrtoots/unsloth-Magistral-Small-2509-mlx-8Bit

24B • Updated Sep 17, 2025 • 41 • 1

Horkios/Magistral-Small-2509-mlx-4Bit

24B • Updated Sep 17, 2025 • 12

ArtusDev/mistralai_Magistral-Small-2509-EXL3

Updated Oct 13, 2025 • 6 • 5

lmstudio-community/Magistral-Small-2509-MLX-4bit

Updated Sep 17, 2025 • 25.8k

lmstudio-community/Magistral-Small-2509-MLX-5bit

Updated Sep 17, 2025 • 25.2k

lmstudio-community/Magistral-Small-2509-MLX-6bit

Updated Sep 17, 2025 • 25.3k

rubricreward/mR3-Qwen3-4B-tgt-prompt-en-thinking

Text Generation • 4B • Updated Oct 2, 2025

electroglyph/snowflake-arctic-embed-m-v2.0-ONNX-quant

Sentence Similarity • Updated Sep 19, 2025 • 9

olegshulyakov/nomic-embed-text-v2-moe-GGUF

Sentence Similarity • 0.5B • Updated Sep 19, 2025 • 105 • 1

AlexanderKyng/Devstral-Small-2507-int4-AutoRound

Text Generation • 1B • Updated Sep 19, 2025 • 13 • 1

rubricreward/mR3-Qwen3-4B-en-prompt-en-thinking

Text Generation • 4B • Updated Oct 2, 2025 • 7 • • 2

rubricreward/mR3-Qwen3-4B-tgt-prompt-tgt-thinking

Text Generation • 4B • Updated Oct 2, 2025 • 10

rubricreward/mR3-Qwen3-4B-tgt-prompt-tgt-thinking-translated

Text Generation • 4B • Updated Oct 2, 2025 • 5

rubricreward/mR3-Qwen3-8B-en-prompt-en-thinking

Text Generation • 8B • Updated Oct 2, 2025 • 9

rubricreward/mR3-Qwen3-8B-tgt-prompt-en-thinking

Text Generation • 8B • Updated Oct 2, 2025 • 3

jukofyork/command-a-03-2025-uncut

Text Generation • 111B • Updated Sep 20, 2025 • 5 • 1

rubricreward/mR3-Qwen3-8B-tgt-prompt-tgt-thinking

Text Generation • 8B • Updated Oct 2, 2025 • 5

rubricreward/mR3-Qwen3-8B-tgt-prompt-tgt-thinking-translated

Text Generation • 8B • Updated Oct 2, 2025 • 7

electroglyph/snowflake-arctic-embed-m-v2.0-ONNX-uint8

Sentence Similarity • Updated Sep 22, 2025 • 9

deskaunedsei/Phi-4-mini-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Sep 20, 2025 • 3

cyankiwi/Magistral-Small-2509-AWQ-4bit

5B • Updated Oct 14, 2025 • 197 • 3

cyankiwi/Magistral-Small-2509-AWQ-8bit

8B • Updated Oct 14, 2025 • 20 • 1

Xlouw/jina-embeddings-v3-fixed

Feature Extraction • 0.6B • Updated Sep 20, 2025 • 49

ThiagoVsky/DeepSeek-R1-Distill-Qwen-7B-Multilingual-Q4_K_S-GGUF_split

8B • Updated Sep 21, 2025 • 4

ThiagoVsky/DeepSeek-R1-Distill-Qwen-7B-Multilingual-Q4_K_M-GGUF_split

8B • Updated Sep 21, 2025 • 1

ThiagoVsky/DeepSeek-R1-Distill-Qwen-7B-Multilingual-Q8_0-GGUF_split

8B • Updated Sep 21, 2025

ThiagoVsky/DeepSeek-R1-Distill-Qwen-7B-Multilingual-Q3_K_L-GGUF

8B • Updated Sep 21, 2025 • 4

ThiagoVsky/DeepSeek-R1-Distill-Qwen-7B-Multilingual-Q4_K_S-GGUF

8B • Updated Sep 21, 2025 • 9

ThiagoVsky/DeepSeek-R1-Distill-Qwen-7B-Multilingual-Q6_K-GGUF

8B • Updated Sep 21, 2025 • 23