Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,044

Base only

Active filters: ro

LuuNgoc2k2/RoGemma2-9b-Instruct-DPO-2025-04-23-Q8_0-GGUF

9B • Updated Jul 10, 2025 • 29

mradermacher/Falcon-H1-1.5B-Deep-Base-i1-GGUF

2B • Updated Jul 10, 2025 • 345

mradermacher/Falcon-H1-7B-Instruct-i1-GGUF

8B • Updated Jul 31, 2025 • 374 • 1

mradermacher/Falcon-H1-7B-Base-i1-GGUF

8B • Updated Jul 10, 2025 • 241

unsloth/Devstral-Small-2507

Text Generation • 24B • Updated Jul 10, 2025 • 372 • • 3

upb-nlp/rollama2_7b_article_to_search_query

7B • Updated Jul 10, 2025 • 6

mradermacher/Falcon-H1-1.5B-Base-GGUF

2B • Updated Jul 10, 2025 • 126

mradermacher/Falcon-H1-34B-Instruct-i1-GGUF

34B • Updated Jul 31, 2025 • 102

mradermacher/Falcon-H1-34B-Base-i1-GGUF

34B • Updated Jul 10, 2025 • 191

mradermacher/Falcon-H1-3B-Instruct-i1-GGUF

3B • Updated Jul 31, 2025 • 101

unsloth/Devstral-Small-2507-GGUF

24B • Updated Dec 10, 2025 • 4.62k • 80

unsloth/Devstral-Small-2507-bnb-4bit

Text Generation • 24B • Updated Jul 10, 2025 • 185 • 2

unsloth/Devstral-Small-2507-unsloth-bnb-4bit

Text Generation • 24B • Updated Jul 10, 2025 • 361 • 5

mradermacher/Falcon-H1-1.5B-Base-i1-GGUF

2B • Updated Jul 10, 2025 • 196

bartowski/mistralai_Devstral-Small-2507-GGUF

Image-Text-to-Text • 24B • Updated Jul 12, 2025 • 1.6k • 9

mlx-community/Devstral-Samll-2507-bf16

Text Generation • 24B • Updated Jul 10, 2025 • 27 • 1

gabriellarson/Devstral-Small-2507-GGUF

Text Generation • 24B • Updated Jul 10, 2025 • 222

ArtusDev/mistralai_Devstral-Small-2507-EXL3

Text Generation • Updated Jul 10, 2025 • 36 • 6

zouhar/COMET-poly-cand2-wmt25

Translation • Updated 30 days ago • 9

zouhar/COMET-poly-ic1-wmt25

Translation • Updated 30 days ago • 8

stelterlab/Devstral-Small-2507-FP8

Text Generation • Updated Jul 11, 2025 • 422 • 2

mlx-community/Devstral-Small-2507-5bit

Text Generation • 24B • Updated Jul 11, 2025 • 19 • 1

mlx-community/Devstral-Small-2507-4bit

Text Generation • 24B • Updated Jul 11, 2025 • 142 • 1

mlx-community/Devstral-Small-2507-6bit

Text Generation • 24B • Updated Jul 11, 2025 • 23 • 1

mlx-community/Devstral-Small-2507-8bit

Text Generation • 24B • Updated Jul 11, 2025 • 63 • 1

mlx-community/Devstral-Small-2507-4bit-DWQ

Text Generation • 24B • Updated Jul 12, 2025 • 164 • 12

cyankiwi/Devstral-Small-2507-AWQ-4bit

24B • Updated Jul 21 • 1.77k • 10

shtilev/medical_embedded_v5

Sentence Similarity • 0.3B • Updated Jul 12, 2025 • 26

zouhar/COMET-poly-ic3-wmt25

Translation • Updated 30 days ago • 6

drwlf/Medra4b-abliterated

Text Generation • 5B • Updated Jul 16, 2025 • 17 • 4