Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,904

Base only

Active filters: yo

tensorblock/bloomz-1b1-GGUF

Text Generation • 1B • Updated Jan 27 • 27

tensorblock/bloomz-560m-GGUF

Text Generation • 0.8B • Updated Jan 27 • 49

tensorblock/bloom-3b-GGUF

Text Generation • 4B • Updated Jan 27 • 76 • 1

tensorblock/bloom-7b1-GGUF

Text Generation • 8B • Updated Jan 27 • 31

tensorblock/bloomz-1b7-GGUF

Text Generation • 2B • Updated Jan 27 • 54

tensorblock/bloomz-7b1-mt-GGUF

Text Generation • 8B • Updated Jan 27 • 111 • 1

EnverLee/bge-m3-korean-Q4_K_M-GGUF

Sentence Similarity • 0.6B • Updated Nov 15, 2024 • 23

entai2965/m2m100-418M-ctranslate2

Translation • Updated Nov 21, 2024 • 74 • 1

entai2965/m2m100-1.2B-ctranslate2

Translation • Updated Nov 21, 2024 • 146 • 5

WueNLP/seamless-m4t-v2-large-speech-encoder

Text-to-Speech • 0.6B • Updated Dec 18, 2024 • 14 • 9

OpenVINO/whisper-base-int8-ov

Automatic Speech Recognition • Updated May 13 • 645 • 1

OpenVINO/whisper-base-int4-ov

Automatic Speech Recognition • Updated May 13 • 20

OpenVINO/whisper-tiny-int8-ov

Automatic Speech Recognition • Updated May 13 • 250

OpenVINO/whisper-base-fp16-ov

Automatic Speech Recognition • Updated May 13 • 792 • 1

OpenVINO/whisper-tiny-int4-ov

Automatic Speech Recognition • Updated May 13 • 44

OpenVINO/whisper-tiny-fp16-ov

Automatic Speech Recognition • Updated May 13 • 368

OpenVINO/whisper-medium-int4-ov

Automatic Speech Recognition • Updated May 13 • 71

OpenVINO/whisper-medium-int8-ov

Automatic Speech Recognition • Updated May 13 • 334

OpenVINO/whisper-medium-fp16-ov

Automatic Speech Recognition • Updated May 13 • 162

OpenVINO/whisper-large-v3-fp16-ov

Automatic Speech Recognition • Updated May 13 • 505 • 1

entai2965/nllb-200-3.3B-ctranslate2

Translation • Updated Nov 20, 2024 • 40 • 3

entai2965/nllb-200-3.3B-ctranslate2-float16

Translation • Updated Nov 20, 2024 • 16

entai2965/nllb-200-distilled-1.3B-ctranslate2

Translation • Updated Nov 20, 2024 • 95

entai2965/nllb-200-distilled-600M-ctranslate2

Translation • Updated Nov 20, 2024 • 1.12k • 5

entai2965/small100-ctranslate2

Translation • Updated Nov 21, 2024 • 67

cnmoro/tangled-llama-33m-32k-instruct-v0.1-fix

33.3M • Updated Feb 3, 2025 • 3 • 1

Matt00101/Poetry

Voice Activity Detection • Updated Nov 25, 2024

kp-forks/whisper-large-v3-turbo

Automatic Speech Recognition • 0.8B • Updated Oct 4, 2024 • 7

harcuracy619/Yoruba_asr_whisper

Automatic Speech Recognition • 0.2B • Updated Dec 8, 2024 • 2

mradermacher/LishizhenGPT-GGUF

8B • Updated Dec 10, 2024 • 117