Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,084

Base only

Active filters: ro

am0n666x/aya-expanse-8b-ungated-Q3_K_S-GGUF

8B • Updated Nov 10, 2024 • 10

am0n666x/aya-expanse-8b-ungated-Q2_K-GGUF

8B • Updated Nov 10, 2024 • 10

tensorblock/falcon-11B-GGUF

11B • Updated Jan 27 • 4

fareshzm/flan-t5-base-Q4_K_M-GGUF

0.2B • Updated Nov 11, 2024 • 18

ISOISS/jina-embeddings-v3-tei

Feature Extraction • 0.6B • Updated Nov 12, 2024 • 65

deepfile/multilingual-e5-small-openvino

Sentence Similarity • 0.1B • Updated Nov 12, 2024 • 77

sizrox/paraphrase-multilingual-mpnet-base-v2-Q8_0-GGUF

Sentence Similarity • 0.3B • Updated Nov 12, 2024 • 12 • 1

lenML/aya-expanse-8b-abliterated

Text Generation • 8B • Updated Nov 13, 2024 • 168 • 10

deepfile/multilingual-e5-small-onnx-qint8

Sentence Similarity • 0.1B • Updated Nov 13, 2024 • 15 • 1

lenML/aya-expanse-8b-abliterated-GGUF

8B • Updated Nov 13, 2024 • 36

nguyenphuthien/flan-t5-large-Q4_K_M-GGUF

0.8B • Updated Nov 13, 2024 • 10

mradermacher/aya-expanse-8b-abliterated-GGUF

8B • Updated Nov 14, 2024 • 306 • 6

mradermacher/aya-expanse-8b-abliterated-i1-GGUF

8B • Updated Nov 14, 2024 • 559 • 2

EnverLee/bge-m3-korean-Q4_K_M-GGUF

Sentence Similarity • 0.6B • Updated Nov 15, 2024 • 17

ilhamdprastyo/jina-embeddings-v3-tei

Feature Extraction • 0.6B • Updated Nov 15, 2024 • 1

jester6136/multilingual-e5-large-instruct-m2v-768

0.2B • Updated Nov 15, 2024 • 6 • 1

OneFly7/bi_bs32_lr2e5_cosine_restart_period2_best

Sentence Similarity • 0.3B • Updated Nov 16, 2024 • 35

BEOBMA/aya-expanse-32b-Q4_K_M-GGUF

32B • Updated Nov 17, 2024 • 11

entai2965/m2m100-418M-ctranslate2

Translation • Updated Nov 21, 2024 • 205 • 1

entai2965/m2m100-1.2B-ctranslate2

Translation • Updated Nov 21, 2024 • 167 • 6

bh4/flan-t5-small-Q4_K_M-GGUF

77M • Updated Nov 17, 2024 • 14

WueNLP/seamless-m4t-v2-large-speech-encoder

Text-to-Speech • 0.6B • Updated Dec 18, 2024 • 25 • 9

OpenVINO/whisper-base-int8-ov

Automatic Speech Recognition • Updated May 13 • 636 • 1

OpenVINO/whisper-base-int4-ov

Automatic Speech Recognition • Updated May 13 • 24

OpenVINO/whisper-tiny-int8-ov

Automatic Speech Recognition • Updated May 13 • 240

OpenVINO/whisper-base-fp16-ov

Automatic Speech Recognition • Updated May 13 • 812 • 1

OpenVINO/whisper-tiny-int4-ov

Automatic Speech Recognition • Updated May 13 • 23

OpenVINO/whisper-tiny-fp16-ov

Automatic Speech Recognition • Updated May 13 • 226

OpenVINO/whisper-medium-int4-ov

Automatic Speech Recognition • Updated May 13 • 24

OpenVINO/whisper-medium-int8-ov

Automatic Speech Recognition • Updated May 13 • 348