Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,020

Base only

Active filters: ro

smirki/WEBGEN-Devstral-24B-Q4_K_M-GGUF

Text Generation • 24B • Updated Sep 28, 2025 • 4

smirki/WEBGEN-Devstral-24B-2-Scale

Text Generation • 24B • Updated Sep 28, 2025 • 14

mlx-community/Falcon-H1-7B-Instruct-6bit

Text Generation • 8B • Updated Sep 29, 2025 • 15

mlx-community/Falcon-H1-7B-Instruct-4bit

Text Generation • 1B • Updated Sep 29, 2025 • 35

coolsoon/e5-large-korean-Q4_K_M-GGUF

Sentence Similarity • 0.6B • Updated Sep 30, 2025 • 4

coolsoon/multilingual-e5-large-instruct-Q4_K_M-GGUF

0.6B • Updated Sep 30, 2025 • 14

adamo1139/EuroLLM-9B-Instruct-ungated

Text Generation • 9B • Updated Sep 30, 2025 • 267 • 1

mradermacher/EuroLLM-9B-Instruct-ungated-GGUF

9B • Updated Oct 2, 2025 • 760 • 2

wide-video/piper-voices-v1.0.2

Updated Oct 2, 2025 • 1

yashita13/kochimetro-model

Sentence Similarity • 0.1B • Updated Oct 2, 2025 • 33

mradermacher/EuroLLM-9B-Instruct-ungated-i1-GGUF

9B • Updated Dec 4, 2025 • 276 • 3

jaiswalraj/ultravox-llama-finetuned

Audio-Text-to-Text • 0.7B • Updated Oct 6, 2025 • 5

Wwayu/Medra27B-mlx-4Bit

Text Generation • 27B • Updated Oct 4, 2025

Wwayu/Medra27B-mlx-6Bit

Text Generation • 27B • Updated Oct 4, 2025

georgegiosue/t5-small-Q4_K_M-GGUF

Translation • 60.5M • Updated Oct 4, 2025 • 1

fuckoff11/mxbai-rerank-base-v2-Q4_K_M-GGUF

Text Ranking • 0.5B • Updated Oct 5, 2025 • 11

HuggingFaceFW/finepdfs_edu_classifier_ron_Latn

0.3B • Updated Oct 6, 2025 • 19

ijohn07/MedraN-E4B-Uncensored-EP7-Q8_0-GGUF

Image-Text-to-Text • 7B • Updated Oct 6, 2025 • 117

ijohn07/MedraN-E4B-Uncensored-EP7-Q4_K_M-GGUF

Image-Text-to-Text • 7B • Updated Oct 6, 2025 • 138 • 1

cnmoro/static-nomic-distilled-vocab-quantized

1.78M • Updated Oct 6, 2025 • 6

openeurollm/datamix-2b-80-20

Updated Jan 19 • 15

pazars/TildeOpen-30B-Instruct-LV

31B • Updated Dec 30, 2025 • 45 • 1

GaleneAI/Magistral-Small-2509-FP8-Dynamic

Updated Oct 8, 2025 • 14 • 2

hajkis-glami/multilingual-e5-base-embeddings

Sentence Similarity • 0.3B • Updated Oct 8, 2025 • 103

yanolja/YanoljaNEXT-Rosetta-12B-2510

Translation • 12B • Updated Nov 2, 2025 • 84 • 29

openeurollm/datamix-2b-50-50

Updated Jan 19 • 20

Rangers/fuxi-asr-multi-language-v1.0

Automatic Speech Recognition • 0.8B • Updated Oct 9, 2025

Res-eng-AC/flan-t5-small-Q8_0-GGUF

77M • Updated Oct 9, 2025 • 17

SomAnon/YanoljaNEXT-Rosetta-12B-2510-Q6_K-GGUF

Translation • 13B • Updated Oct 9, 2025 • 13 • 1

prenes/YanoljaNEXT-Rosetta-12B-2510-Q4_K_M-GGUF

Translation • 13B • Updated Oct 9, 2025 • 3 • 1