Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,738

Base only

Active filters: fi

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8

Image-Text-to-Text • 24B • Updated Jun 9 • 1.24k • 5

Mattimax/DATA-AI_Chat_4_Thinking_0.5B-Q4_K_M-GGUF

0.5B • Updated Apr 16, 2025 • 8

Srikant86/Phi-4-mini-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 16, 2025 • 3

OpenVINO/Phi-4-mini-instruct-int4-ov

Text Generation • Updated 26 days ago • 877 • 3

OpenVINO/Phi-4-mini-instruct-int8-ov

Text Generation • Updated Apr 16, 2025 • 125

OpenVINO/Phi-4-mini-instruct-fp16-ov

Text Generation • Updated Apr 16, 2025 • 15

OpenBuddy/openbuddy-wayfarer-70b-v25.1-131k

Text Generation • 71B • Updated Apr 20, 2025 • 7

RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16

Text Generation • 8B • Updated Jun 9 • 404 • 1

imkebe/Phi-4-mini-instruct-rk3588-1.2.0

Text Generation • Updated Apr 17, 2025 • 10 • 2

mradermacher/openbuddy-wayfarer-70b-v25.1-131k-GGUF

71B • Updated Jul 31, 2025 • 6

mradermacher/openbuddy-wayfarer-70b-v25.1-131k-i1-GGUF

71B • Updated Jul 11, 2025 • 48

tangledgroup/tangled-alpha-0.14-core

Text Generation • Updated Apr 26, 2025

IronWolfAI/GoldenCrow

Automatic Speech Recognition • 6B • Updated Apr 18, 2025 • 3

itlwas/Phi-4-mini-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 18, 2025 • 38

onnxruntime/Gemma-3-ONNX

Updated Feb 11 • 7 • 3

tangledgroup/tangled-alpha-0.15-core

Text Generation • Updated Apr 26, 2025

OpenBuddy/openbuddy-qwq-32b-v25.2q-200k

Text Generation • 33B • Updated Apr 20, 2025 • 13 • 4

GlemVNT/VNT-3.5F-16K

Text Generation • Updated Apr 20, 2025

OpenBuddy/openbuddy-qwq-32b-v25.2q-200k-Q4_K_M-GGUF

Text Generation • 33B • Updated Apr 21, 2025 • 12

Burman-AI/mGPT-ru

Text Generation • Updated Apr 22, 2025 • 12

rntc/cometkiwi-pubmed

Translation • Updated Apr 22, 2025 • 2

Derur/piper-tts-models

Updated Apr 23, 2025 • 3

johnpaulbin/jina-embeddings-v3-128

32M • Updated Apr 24, 2025 • 8

danhduc/M2V

0.1B • Updated Apr 24, 2025 • 5

theSuperShane/whisper-large-v3-ja

Automatic Speech Recognition • Updated Apr 28, 2025 • 5 • 1

OpenBuddy/openbuddy-thinker-32b-v26-preview

Text Generation • 33B • Updated May 1, 2025 • 7 • 3

mradermacher/openbuddy-qwq-32b-v25.2q-200k-GGUF

33B • Updated Jul 11, 2025 • 17

OrcaDB/e5-large

Feature Extraction • 0.6B • Updated Jun 16, 2025 • 172

mradermacher/openbuddy-qwq-32b-v25.2q-200k-i1-GGUF

33B • Updated Jul 11, 2025 • 51 • 1

tvergho/logos-retriever-v1

Sentence Similarity • 0.6B • Updated Oct 6, 2025 • 123