Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,472

Base only

Active filters: da

roleplaiapp/ALIA-40b-Q5_0-GGUF

Text Generation • 40B • Updated Jan 23, 2025 • 23

roleplaiapp/ALIA-40b-Q4_0-GGUF

Text Generation • 40B • Updated Jan 23, 2025 • 15 • 1

mradermacher/Qwen2.5-3B-Renoia-i1-GGUF

3B • Updated Apr 29, 2025 • 251 • 1

jimi0209/lb-reranker-0.5B-v1.0-Q5_K_M-GGUF

Text Generation • 0.5B • Updated Jan 23, 2025 • 8 • 2

panagoa/nllb-200-1.3b-kbd-pretrain

Translation • 1B • Updated Mar 1, 2025 • 3

capa8/salamandra-7b-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 23, 2025 • 10 • 1

capa8/salamandra-7b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jan 23, 2025 • 8

Ryllix/X-ALMA-13B-Group1-Q8_0-GGUF

13B • Updated Jan 23, 2025 • 1

Ryllix/X-ALMA-13B-Group1-Q5_K_S-GGUF

13B • Updated Jan 23, 2025 • 9

Ryllix/X-ALMA-13B-Group1-Q5_K_M-GGUF

13B • Updated Jan 23, 2025 • 11

Ryllix/X-ALMA-13B-Group1-Q5_0-GGUF

13B • Updated Jan 23, 2025 • 3

Ryllix/X-ALMA-13B-Group1-Q6_K-GGUF

13B • Updated Jan 23, 2025 • 7

Ryllix/X-ALMA-13B-Group1-Q4_K_M-GGUF

13B • Updated Jan 23, 2025 • 7

Ryllix/X-ALMA-13B-Group1-Q4_K_S-GGUF

13B • Updated Jan 23, 2025 • 13

GodComplexxx/madlad400-10b-mt-Q4_K_M-GGUF

Translation • 11B • Updated Jan 23, 2025 • 6

panagoa/nllb-200-1.3b-kbd-v0.1

Translation • 1B • Updated Mar 1, 2025 • 6

shaunss/xlmroberta-pea-relevance-de

Text Classification • 0.6B • Updated Jun 23, 2025 • 8

mradermacher/Apollo2-3.8B-GGUF

4B • Updated Jan 24, 2025 • 106

mradermacher/Apollo2-3.8B-i1-GGUF

4B • Updated Jan 24, 2025 • 176

mimir-project/mimir-mistral-7b-core-scratch-instruct

7B • Updated Mar 13, 2025 • 4

hongkeon/bge-m3-korean-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Nov 26, 2025 • 15

hongkeon/e5-large-korean-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Jan 25, 2025 • 4

trollek/Llama-3.1-8B-Danoia

Text Generation • 8B • Updated Jan 27, 2025 • 8 • 1

fernandoruiz/salamandra-2b-instruct-Q4_0-GGUF

Text Generation • 2B • Updated Jun 1, 2025 • 9

fernandoruiz/salamandra-7b-instruct-Q4_0-GGUF

Text Generation • 8B • Updated Jun 1, 2025 • 18 • 2

fernandoruiz/ALIA-40b-Q4_0-GGUF

Text Generation • 40B • Updated Jan 25, 2025 • 7

tensorblock/mt0-xxl-mt-GGUF

Text Generation • 13B • Updated Jan 27 • 74

tboquet/m2v-gte-multilingual-base-pca-128

Updated Jan 26, 2025 • 5

fernandoruiz/salamandraTA-2B-Q4_0-GGUF

Translation • 2B • Updated Jan 26, 2025 • 4

misterlakaz/Ceramic-Base-856b

Text Generation • Updated Jan 26, 2025 • 6