Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

12,702

Base only

Active filters: ru

mykor/paraphrase-multilingual-mpnet-base-v2.gguf

0.3B • Updated Jan 8 • 84

mradermacher/ChatWaifu_v1.2.1-i1-GGUF

12B • Updated Sep 8, 2024 • 8 • 2

evgensoft/saiga_llama3_8b-Q5_K_M-GGUF

8B • Updated Aug 11, 2024 • 59 • 1

anthracite-org/magnum-v2.5-12b-kto

Text Generation • 12B • Updated Aug 22, 2024 • 416 • • 57

anthracite-org/magnum-v2.5-12b-kto-exl2

Text Generation • Updated Aug 15, 2024 • 8 • 8

iRedHat/iBat-ComfyUI

Updated Aug 29, 2024

dab512/saiga_gemma2_9b-Q8_0-GGUF

9B • Updated Aug 12, 2024 • 24

LemiSt/Mistral-Nemo-Instruct-2407-eetq-8bit

12B • Updated Aug 13, 2024 • 6

waveletdeboshir/whisper-base-ru-pruned

Automatic Speech Recognition • 50.3M • Updated Sep 2, 2024 • 12

data-silence/any-news-classifier

Text Classification • 0.5B • Updated Aug 19, 2024 • 76

DaveLeongSG/Mistral-Nemo-Base-2407-Q4_K_M-GGUF

12B • Updated Aug 13, 2024 • 4

data-silence/fasttext-rus-news-classifier

Text Classification • Updated Aug 22, 2024 • 47 • 1

waveletdeboshir/whisper-small-ru-pruned

Automatic Speech Recognition • 0.2B • Updated Sep 2, 2024 • 5

waveletdeboshir/whisper-tiny-ru-pruned

Automatic Speech Recognition • 21.5M • Updated Sep 2, 2024 • 17 • 1

Infomaniak-AI/onnx-xlm-roberta-base-language-detection

Text Classification • Updated Aug 14, 2024 • 19 • 5

QuantFactory/magnum-v2-12b-GGUF

Text Generation • 12B • Updated Aug 14, 2024 • 199 • 3

sayi50/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF

12B • Updated Aug 14, 2024 • 4.83k

anthracite-org/magnum-v2.5-12b-kto-gguf

Text Generation • 12B • Updated Aug 22, 2024 • 854 • 42

natong19/Mistral-Nemo-Instruct-2407-abliterated

12B • Updated Aug 15, 2024 • 210 • 20

bartowski/magnum-12b-v2.5-kto-GGUF

Text Generation • 12B • Updated Aug 15, 2024 • 4.6k • 11

Flamesline/Mistral-Nemo-Instruct-2407-abliterated-Q4_K_M-GGUF

12B • Updated Aug 15, 2024 • 185 • 3

bartowski/magnum-12b-v2.5-kto-exl2

Text Generation • Updated Aug 15, 2024

NikolayKozloff/magnum-12b-v2.5-kto-Q6_K-GGUF

Text Generation • 12B • Updated Aug 15, 2024 • 115 • 1

NikolayKozloff/magnum-12b-v2.5-kto-Q5_K_M-GGUF

Text Generation • 12B • Updated Aug 15, 2024 • 244 • 2

backyardai/Mistral-Nemo-Instruct-2407-GGUF

12B • Updated Aug 28, 2024 • 461 • 1

SIRIS-Lab/affilgood-span-multilingual

0.3B • Updated Oct 29, 2024 • 8 • 1

jinaai/jina-colbert-v2

0.6B • Updated Jan 17, 2025 • 249k • 145

spow12/ChatWaifu_v1.3

Text Generation • 12B • Updated Aug 22, 2024 • 14 • • 3

ISOISS/multilingual-e5-large-xnli-anli-onnx

Zero-Shot Classification • Updated Dec 12, 2024 • 20

ISTA-DASLab/Mistral-Nemo-Instruct-2407-AQLM-PV-2Bit-1x16-hf

3B • Updated Aug 16, 2024 • 5 • 3