Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,452

Base only

Active filters: multilingual

roleplaiapp/ReaderLM-v2-Q5_K_S-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 12

roleplaiapp/ReaderLM-v2-Q5_K_M-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 6

roleplaiapp/ReaderLM-v2-Q6_K-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 4

roleplaiapp/ReaderLM-v2-Q8_0-GGUF

Text Generation • 2B • Updated Jan 19, 2025 • 5

Mohsen21/FineTunedWhisper

Automatic Speech Recognition • 2B • Updated Jan 20, 2025 • 2

louisthomaspro/xlm-roberta-base-language-detection-onnx

Text Classification • Updated Jan 19, 2025 • 47

gyroing/English-to-Persian-Translation-mT5-V1-Q4_K_M-GGUF

0.3B • Updated Jan 19, 2025 • 45 • 1

gyroing/English-to-Persian-Translation-mT5-V1-Q8_0-GGUF

0.3B • Updated Jan 19, 2025 • 14 • 1

gyroing/Persian-to-English-Translation-mT5-V1-Q8_0-GGUF

0.6B • Updated Jan 19, 2025 • 15 • 1

gyroing/Persian-to-English-Translation-mT5-V1-Q4_K_M-GGUF

0.6B • Updated Jan 19, 2025 • 35 • 1

mradermacher/SuperThoughts-CoT-14B-16k-o1-QwQ-i1-GGUF

15B • Updated Mar 1, 2025 • 407 • 1

jiviai/audioX-south-v1

Automatic Speech Recognition • 2B • Updated Jul 30, 2025 • 972 • 6

nulledinstance/Phi-3.5-mini-instruct-Q6_K-GGUF

Text Generation • 4B • Updated Jan 20, 2025 • 1

espnet/universa-base_urgent24_multi-metric

Updated May 30, 2025 • 6

sail/Sailor2-L-1B-SFT

Text Generation • 1.0B • Updated Feb 20, 2025 • 6

sail/Sailor2-L-8B-SFT

Text Generation • 9B • Updated Feb 20, 2025 • 2

Markobes/lucky52-bloom-7b1-no-39-Q8_0-GGUF

Text Generation • 8B • Updated Jan 20, 2025 • 5

mitulagr2/gguf-q5_k_m-phi-3.5-mini-instruct

Text Generation • 4B • Updated Jan 21, 2025 • 2

JHJHJHJHJ/multilingual-e5-large-instruct-Q5_K_M-GGUF

0.6B • Updated Jan 21, 2025 • 1 • 1

sail/Sailor2-L-20B-SFT

Text Generation • 19B • Updated Feb 20, 2025 • 3

blockenters/sms-spam-classifier

Text Classification • 0.2B • Updated Jan 22, 2025 • 169 • 3

OpenVINO/Phi-3.5-vision-instruct-fp16-ov

Image-Text-to-Text • Updated Aug 21, 2025 • 90 • 1

adaptive-classifier/llm-router

Text Classification • Updated Oct 6, 2025 • 294 • 8

OpenVINO/Phi-3.5-vision-instruct-int8-ov

Image-Text-to-Text • Updated Feb 24 • 971 • 2

OpenVINO/Phi-3.5-vision-instruct-int4-ov

Image-Text-to-Text • Updated Jul 22, 2025 • 676

sheldonrobinson/Phi-3.5-MoE-instruct-Q4_K_M-GGUF

Text Generation • 42B • Updated Jan 22, 2025 • 4

sheldonrobinson/Phi-3.5-MoE-instruct-Q4_0-GGUF

Text Generation • 42B • Updated Jan 22, 2025 • 5

Kwaipilot/KwaiCoder-23B-A4B-v1

Text Generation • 23B • Updated Jan 24, 2025 • 26 • 16

OpenVINO/InternVL2-1B-fp16-ov

Image-Text-to-Text • Updated Jan 23, 2025 • 629

OpenVINO/InternVL2-1B-int8-ov

Image-Text-to-Text • Updated Jan 23, 2025 • 84