Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,088

Base only

Active filters: fa

tomasmcm/gsarti-cora-mgen-onnx

Text Generation • Updated Apr 10, 2025 • 1

tangledgroup/tangled-alpha-0.13-core

Text Generation • Updated Apr 17, 2025

Bedovyy/c4ai-command-a-03-2025-gptqmodel-4bit

Text Generation • 111B • Updated Apr 22, 2025 • 6 • 1

neurlang/ipa-whisper-base

Automatic Speech Recognition • 72.6M • Updated Apr 14, 2025 • 6.1k • 24

FriendliAI/ultravox-v0_5-llama-3_3-70b

Audio-Text-to-Text • 0.7B • Updated Apr 15, 2025 • 3

Drliltaha/mindDraft

Updated Apr 13, 2025

Gomez12/multilingual-e5-large-instruct-Q8_0-GGUF

0.6B • Updated Apr 13, 2025 • 1

DavidAU/Llama3.1-MOE-4X8B-Gated-IQ-Multi-Tier-Deep-Reasoning-32B-GGUF

Text Generation • 25B • Updated Jul 28, 2025 • 418 • 10

Abdelkareem/jina_v3_distilled

64M • Updated Apr 14, 2025 • 16

Abdelkareem/nomic-embed-text-v2-moe_distilled

64M • Updated Apr 14, 2025 • 16

FriendliAI/Mistral-Small-3.1-24B-Instruct-2503

Image-Text-to-Text • 24B • Updated Apr 14, 2025 • 1

FriendliAI/ultravox-v0_5-llama-3_2-1b

Audio-Text-to-Text • 0.7B • Updated Apr 15, 2025 • 2

FriendliAI/ultravox-v0_5-llama-3_1-8b

Audio-Text-to-Text • 0.7B • Updated Apr 15, 2025 • 5

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • 24B • Updated Oct 29, 2025 • 1.68k • 10

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8

Image-Text-to-Text • 24B • Updated Oct 29, 2025 • 1.09k • 5

imkebe/Mistral-Small-3.1-24B-Instruct-2503-rk3588-1.2.0

Image-Text-to-Text • Updated Apr 15, 2025 • 13 • 2

Sangto/GemmaX2-28-9B-v0.1-Q4_K_M-GGUF

Translation • 9B • Updated Apr 16, 2025 • 5

Farhadgh/qwen2.5-legal-finetuned

Updated Apr 16, 2025 • 2

Mattimax/DATA-AI_Chat_4_Thinking_0.5B-Q4_K_M-GGUF

0.5B • Updated Apr 16, 2025 • 5

RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16

Text Generation • 8B • Updated Sep 22, 2025 • 355

nm-testing/Mistral-Small-3.1-24B-Instruct-2503-FP8

Image-Text-to-Text • Updated Apr 17, 2025 • 10 • 4

baaabaei/whisper-small-fa

0.2B • Updated Apr 18, 2025 • 1

tangledgroup/tangled-alpha-0.14-core

Text Generation • Updated Apr 26, 2025

DavidAU/Llama3.1-MOE-4X8B-Gated-IQ-Multi-Tier-COGITO-Deep-Reasoning-32B-GGUF

Text Generation • 25B • Updated May 28, 2025 • 315 • 6

tangledgroup/tangled-alpha-0.15-core

Text Generation • Updated Apr 26, 2025

mojtabataghiabadi/sadat

Text Generation • 8B • Updated Apr 20, 2025 • 3

irmma/Athena-R3-7B-Q4_K_M-GGUF

8B • Updated Apr 19, 2025 • 6

GlemVNT/VNT-3.5F-16K

Text Generation • Updated Apr 20, 2025

Hyphonical/aya-expanse-8b-Q4_K_M-GGUF

8B • Updated Apr 21, 2025 • 3

aliwrp97/aliw

Updated Apr 21, 2025 • 1