Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,045

Base only

Active filters: ro

zouhar/COMET-poly-cand1-wmt25

Translation • Updated about 1 month ago • 4 • 1

AndreiWTP/Mistral-Small-3.1-24B-Base-2503-Q4_K_M-GGUF

24B • Updated Jul 5, 2025 • 16

Downtown-Case/c4ai-command-a-03-2025-exl3-3.12bpw-hb6

Text Generation • 25B • Updated Jul 6, 2025 • 8 • 2

LangTech-MT/salamandraTA-7b-instruct-WMT25

Translation • 8B • Updated Sep 18, 2025 • 28

mistralai/Devstral-Small-2507_gguf

Text Generation • 24B • Updated Jul 23, 2025 • 3.72k • 49

nicoboss/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed

Image-Text-to-Text • 24B • Updated Jul 7, 2025 • 29 • • 1

mradermacher/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed-GGUF

24B • Updated Jul 31, 2025 • 3.17k • 5

mradermacher/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed-i1-GGUF

24B • Updated Jul 11, 2025 • 1.39k • 4

TheStageAI/Elastic-whisper-large-v3

Automatic Speech Recognition • Updated Jun 4 • 22 • 2

zouhar/COMET-poly-base-wmt25

Translation • Updated about 1 month ago • 8

PatrickHaller/snowflake-arctic-embed-m-v2.0

Sentence Similarity • 0.3B • Updated Jul 10, 2025 • 50

lmstudio-community/Devstral-Small-2507-MLX-bf16

Text Generation • 24B • Updated Jul 10, 2025 • 14.1k •

lmstudio-community/Devstral-Small-2507-MLX-4bit

Text Generation • 24B • Updated Jul 10, 2025 • 14.4k • 4

lmstudio-community/Devstral-Small-2507-MLX-6bit

Text Generation • 24B • Updated Jul 10, 2025 • 14.3k

lmstudio-community/Devstral-Small-2507-MLX-8bit

Text Generation • 24B • Updated Jul 10, 2025 • 14.9k • 1

AzrilFahmiardi/persona-fit-embedding

Sentence Similarity • 0.1B • Updated Jul 9, 2025 • 75

mradermacher/Medra4b-GGUF

Summarization • 4B • Updated Jul 31, 2025 • 203 • 1

mradermacher/Medra4b-i1-GGUF

Summarization • 4B • Updated Jul 16, 2025 • 364 • 1

mradermacher/Falcon-H1-3B-Base-GGUF

3B • Updated Jul 10, 2025 • 75

mradermacher/Falcon-H1-3B-Base-i1-GGUF

3B • Updated Jul 10, 2025 • 199

mradermacher/Falcon-H1-1.5B-Instruct-GGUF

2B • Updated Jul 31, 2025 • 85

mradermacher/Falcon-H1-1.5B-Deep-Base-GGUF

2B • Updated Jul 10, 2025 • 118

mradermacher/Falcon-H1-7B-Base-GGUF

8B • Updated Jul 10, 2025 • 123

mradermacher/Falcon-H1-7B-Instruct-GGUF

8B • Updated Jul 31, 2025 • 82

mradermacher/Falcon-H1-3B-Instruct-GGUF

3B • Updated Jul 31, 2025 • 138 • 1

mradermacher/Falcon-H1-34B-Base-GGUF

34B • Updated Jul 31, 2025 • 93 • 3

mradermacher/Falcon-H1-34B-Instruct-GGUF

34B • Updated Aug 1, 2025 • 138 • 3

tensorblock/utter-project_EuroMoE-2.6B-A0.6B-Instruct-Preview-GGUF

3B • Updated Jan 27 • 16

upb-nlp/xlm_roberta_large_article_same_topic_classification

0.6B • Updated Jul 10, 2025 • 4

mradermacher/Falcon-H1-1.5B-Instruct-i1-GGUF

2B • Updated Jul 31, 2025 • 192