Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,727

Base only

Active filters: te

bartowski/sarvam-1-GGUF

Text Generation • 3B • Updated Oct 29, 2024 • 397

Eddishockwave/madlad400-10b-mt-Q8_0-GGUF

Translation • 11B • Updated Oct 29, 2024 • 6 • 1

gpustack/gte-multilingual-reranker-base-GGUF

Text Classification • 0.3B • Updated Jan 14, 2025 • 148 • 3

nicolauduran45/affilgood-ner-multilingual-v2

Token Classification • 0.3B • Updated Apr 16, 2025 • 105

mradermacher/bloomz-mt-GGUF

Updated Aug 1, 2025

ai4bharat/indic-parler-tts-pretrained

Text-to-Speech • 0.9B • Updated Dec 9, 2024 • 1.25k • 11

mradermacher/bloomz-mt-i1-GGUF

180B • Updated Nov 4, 2024 • 29

abhiramk6/whisper-large-v3-turbo

Automatic Speech Recognition • 0.8B • Updated Nov 5, 2024

CISCai/jina-embeddings-v3-query-distilled

Feature Extraction • 64M • Updated Nov 5, 2024 • 4 • 1

CISCai/jina-embeddings-v3-passage-distilled

Feature Extraction • 64M • Updated Nov 5, 2024 • 4

CISCai/jina-embeddings-v3-separation-distilled

Feature Extraction • 64M • Updated Nov 5, 2024 • 3.31k • 2

CISCai/jina-embeddings-v3-classification-distilled

Feature Extraction • 64M • Updated Nov 5, 2024 • 5

CISCai/jina-embeddings-v3-matching-distilled

Feature Extraction • 64M • Updated Nov 5, 2024 • 8

apto-as/multilingual-e5-large-Q8_0-GGUF

Feature Extraction • 0.6B • Updated Nov 6, 2024 • 32

richiebailey/whisper-large-v3-turbo

Automatic Speech Recognition • 0.8B • Updated Nov 6, 2024 • 1

tensorblock/bloom-1b1-GGUF

Text Generation • 1B • Updated Jan 27 • 39

tensorblock/bloom-560m-GGUF

Text Generation • 0.8B • Updated Jan 27 • 39

Snowflake/snowflake-arctic-embed-m-v2.0

Sentence Similarity • 0.3B • Updated Apr 24, 2025 • 161k • 106

tensorblock/bloomz-3b-GGUF

Text Generation • 4B • Updated Jan 27 • 180

tensorblock/bloom-1b7-GGUF

Text Generation • 2B • Updated Jan 27 • 34

tensorblock/bloomz-1b1-GGUF

Text Generation • 1B • Updated Jan 27 • 36

tensorblock/bloomz-560m-GGUF

Text Generation • 0.8B • Updated Jan 27 • 72

tensorblock/bloom-3b-GGUF

Text Generation • 4B • Updated Jan 27 • 60 • 1

tensorblock/bloom-7b1-GGUF

Text Generation • 8B • Updated Jan 27 • 30

ISOISS/jina-embeddings-v3-tei

Feature Extraction • 0.6B • Updated Nov 12, 2024 • 30

deepfile/multilingual-e5-small-openvino

Sentence Similarity • 0.1B • Updated Nov 12, 2024 • 18

deepfile/multilingual-e5-small-onnx-qint8

Sentence Similarity • 0.1B • Updated Nov 13, 2024 • 23 • 1

tensorblock/bloomz-1b7-GGUF

Text Generation • 2B • Updated Jan 27 • 66

tensorblock/bloomz-7b1-mt-GGUF

Text Generation • 8B • Updated Jan 27 • 51 • 1

EnverLee/bge-m3-korean-Q4_K_M-GGUF

Sentence Similarity • 0.6B • Updated Nov 15, 2024 • 8