Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,050

Base only

Active filters: uk

roleplaiapp/ALIA-40b-Q6_K-GGUF

Text Generation • 40B • Updated Jan 23, 2025 • 8

roleplaiapp/ALIA-40b-Q5_0-GGUF

Text Generation • 40B • Updated Jan 23, 2025 • 8

roleplaiapp/ALIA-40b-Q4_0-GGUF

Text Generation • 40B • Updated Jan 23, 2025 • 4 • 1

tblh4epob/X-ALMA-13B-Group3-Q6_K-GGUF

13B • Updated Jan 23, 2025 • 9

kevinbazira/aya-expanse-32b-gptq-4bit

Text Generation • 32B • Updated Jan 23, 2025 • 33 • 1

jimi0209/lb-reranker-0.5B-v1.0-Q5_K_M-GGUF

Text Generation • 0.5B • Updated Jan 23, 2025 • 25 • 2

panagoa/nllb-200-1.3b-kbd-pretrain

Translation • 1B • Updated Mar 1, 2025 • 10

capa8/salamandra-7b-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 23, 2025 • 22 • 1

capa8/salamandra-7b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jan 23, 2025 • 14

GodComplexxx/madlad400-10b-mt-Q4_K_M-GGUF

Translation • 11B • Updated Jan 23, 2025 • 7

panagoa/nllb-200-1.3b-kbd-v0.1

Translation • 1B • Updated Mar 1, 2025 • 13

shaunss/xlmroberta-pea-relevance-de

Text Classification • 0.6B • Updated Jun 23, 2025 • 23

mradermacher/Apollo2-3.8B-GGUF

4B • Updated Jan 24, 2025 • 57

mradermacher/Apollo2-3.8B-i1-GGUF

4B • Updated Jan 24, 2025 • 169

hongkeon/bge-m3-korean-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Nov 26, 2025 • 17

hongkeon/e5-large-korean-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Jan 25, 2025 • 14

Gan1108/mT5-T2Tgeneration

Text Generation • 0.3B • Updated Jan 25, 2025 • 5

fernandoruiz/salamandra-2b-instruct-Q4_0-GGUF

Text Generation • 2B • Updated Jun 1, 2025 • 27

fernandoruiz/salamandra-7b-instruct-Q4_0-GGUF

Text Generation • 8B • Updated Jun 1, 2025 • 32 • 2

fernandoruiz/ALIA-40b-Q4_0-GGUF

Text Generation • 40B • Updated Jan 25, 2025 • 9

tensorblock/mt0-xxl-mt-GGUF

Text Generation • 13B • Updated Jan 27 • 31

tboquet/m2v-gte-multilingual-base-pca-128

32M • Updated Jan 26, 2025 • 4

misterlakaz/Ceramic-Base-856b

Text Generation • Updated Jan 26, 2025 • 6

milk639/Miel

Text Generation • 1B • Updated Jan 27, 2025 • 15

tboquet/m2v-jina-embeddings-v3-pca-256

64M • Updated Jan 27, 2025 • 4

misterlakaz/Midas-1922b

Text Generation • Updated Jan 27, 2025 • 8

anuccikpmg/multilingual-e5-large-instruct-openvino-int8

Feature Extraction • Updated Jan 27, 2025 • 22

lightblue/lb-reranker-0.5B-v1.0-rev

Text Generation • 0.6B • Updated Jan 30, 2025 • 10 • 1

dinab/multilingual-e5-base-Q4_K_M-GGUF

Sentence Similarity • 0.3B • Updated Jan 28, 2025 • 1.2k

ptrdvn/lb-reranker-0.5B-v1.0

Text Generation • 0.5B • Updated Jan 30, 2025 • 7