Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,706

Base only

Active filters: th

OpenVINO/whisper-tiny-fp16-ov

Automatic Speech Recognition • Updated May 13 • 211

OpenVINO/whisper-medium-int4-ov

Automatic Speech Recognition • Updated May 13 • 31

OpenVINO/whisper-medium-int8-ov

Automatic Speech Recognition • Updated May 13 • 1.3k

OpenVINO/whisper-medium-fp16-ov

Automatic Speech Recognition • Updated May 13 • 77

OpenVINO/whisper-large-v3-fp16-ov

Automatic Speech Recognition • Updated May 13 • 414 • 1

entai2965/nllb-200-3.3B-ctranslate2

Translation • Updated Nov 20, 2024 • 70 • 3

entai2965/nllb-200-3.3B-ctranslate2-float16

Translation • Updated Nov 20, 2024 • 12

entai2965/nllb-200-distilled-1.3B-ctranslate2

Translation • Updated Nov 20, 2024 • 75

entai2965/nllb-200-distilled-600M-ctranslate2

Translation • Updated Nov 20, 2024 • 907 • 4

jayakody2000lk/Llama-3.2-3B-Q5_K_M-GGUF

Text Generation • 3B • Updated Nov 21, 2024 • 8

mradermacher/llama-3.1-Asian-Bllossom-8B-Translator-GGUF

8B • Updated Nov 21, 2024 • 20

KoreaVirtualReality/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 21, 2024 • 6

typhoon-ai/typhoon2-safety-preview

Text Classification • 0.3B • Updated Mar 31, 2025 • 259 • 6

entai2965/small100-ctranslate2

Translation • Updated Nov 21, 2024 • 62

nuojohnchen/Apollo2-7B-Q4_K_M-GGUF

Question Answering • 8B • Updated Nov 21, 2024 • 5

cnmoro/tangled-llama-33m-32k-instruct-v0.1-fix

33.3M • Updated Feb 3, 2025 • 1

tensorblock/Llama-3.1-8B-GGUF

Text Generation • 8B • Updated Jan 27 • 139

nuojohnchen/Apollo2-7B-Q8_0-GGUF

Question Answering • 8B • Updated Nov 25, 2024 • 4

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int4-gs128-asym

Text Generation • 8B • Updated Nov 21, 2024 • 3

ShinnningPikachu/Llama-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • 3B • Updated Nov 21, 2024 • 1

ShinnningPikachu/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Nov 21, 2024 • 1

ShinnningPikachu/Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Nov 21, 2024 • 1

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • 8B • Updated Nov 21, 2024 • 2

tensorblock/Llama-Guard-3-1B-GGUF

Text Generation • 1B • Updated Jan 27 • 37 • 1

matrixportalx/Llama-3.2-3B-Instruct-IQ3_M-GGUF

Text Generation • 3B • Updated Nov 22, 2024 • 9

matrixportalx/Llama-3.2-3B-Instruct-IQ3_XXS-GGUF

Text Generation • 3B • Updated Nov 25, 2024 • 2

XiaoduoAILab/XmodelLM1.5

Updated Nov 22, 2024 • 2

matrixportalx/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • 3B • Updated Nov 22, 2024 • 3

raethehacker/Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Nov 23, 2024 • 12 • 1

alices2/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Nov 23, 2024 • 297 • 1