Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,754

Base only

Active filters: fi

tensorblock/X-ALMA-13B-Pretrain-GGUF

13B • Updated Jan 27 • 31 • 1

mradermacher/salamandra-2b-instruct-aina-hack-GGUF

2B • Updated Nov 9, 2024 • 104 • 1

mradermacher/salamandra-7b-instruct-aina-hack-GGUF

8B • Updated Nov 9, 2024 • 138 • 3

mradermacher/openbuddy-deepseek-67b-v15.3-4k-i1-GGUF

67B • Updated Oct 26, 2025 • 6.03k

mradermacher/openbuddy-gemma-7b-v19.1-4k-GGUF

9B • Updated Nov 12, 2024 • 86

tensorblock/openbuddy-llama3-8b-v21.1-8k-GGUF

Text Generation • 8B • Updated Jan 27 • 8

mradermacher/openbuddy-mistral-7b-v19.1-4k-GGUF

7B • Updated Nov 13, 2024 • 94 • 1

mradermacher/openbuddy-gemma-7b-v19.1-4k-i1-GGUF

9B • Updated Nov 12, 2024 • 105

ISOISS/jina-embeddings-v3-tei

Feature Extraction • 0.6B • Updated Nov 12, 2024 • 97

deepfile/multilingual-e5-small-openvino

Sentence Similarity • 0.1B • Updated Nov 12, 2024 • 85

sizrox/paraphrase-multilingual-mpnet-base-v2-Q8_0-GGUF

Sentence Similarity • 0.3B • Updated Nov 12, 2024 • 24 • 1

mradermacher/openbuddy-mistral-7b-v19.1-4k-i1-GGUF

7B • Updated Nov 13, 2024 • 269 • 1

deepfile/multilingual-e5-small-onnx-qint8

Sentence Similarity • 0.1B • Updated Nov 13, 2024 • 33 • 1

tensorblock/Poro-34B-GGUF

35B • Updated Jan 27 • 34

tensorblock/openbuddy-qwen1.5-32b-v21.2-32k-GGUF

Text Generation • 33B • Updated Jan 27 • 28

tensorblock/Poro-34B-chat-GGUF

35B • Updated Jan 27 • 33

EnverLee/bge-m3-korean-Q4_K_M-GGUF

Sentence Similarity • 0.6B • Updated Nov 15, 2024 • 23

ilhamdprastyo/jina-embeddings-v3-tei

Feature Extraction • 0.6B • Updated Nov 15, 2024 • 1

jester6136/multilingual-e5-large-instruct-m2v-768

0.2B • Updated Nov 15, 2024 • 4 • 1

mpasila/Ahma-SlimInstruct-LoRA-V1-7B

Updated Dec 9, 2024 • 2

mpasila/Ahma-SlimInstruct-V1-7B

Text Generation • 7B • Updated May 27, 2025 • 34

OneFly7/bi_bs32_lr2e5_cosine_restart_period2_best

Sentence Similarity • 0.3B • Updated Nov 16, 2024 • 88

bartowski/openbuddy-nemotron-70b-v23.2q-131k-GGUF

Text Generation • 71B • Updated Nov 16, 2024 • 358 • 2

tensorblock/openbuddy-qwen1.5-32b-v21.1-32k-GGUF

Text Generation • 33B • Updated Jan 27 • 59

tensorblock/openbuddy-llama3.1-8b-v22.3-131k-GGUF

Text Generation • 8B • Updated Jan 27 • 3

entai2965/m2m100-418M-ctranslate2

Translation • Updated Nov 21, 2024 • 74 • 1

entai2965/m2m100-1.2B-ctranslate2

Translation • Updated Nov 21, 2024 • 146 • 5

WueNLP/seamless-m4t-v2-large-speech-encoder

Text-to-Speech • 0.6B • Updated Dec 18, 2024 • 14 • 9

tensorblock/openbuddy-mistral-22b-v21.1-32k-GGUF

Text Generation • 22B • Updated Jan 27 • 29

tensorblock/openbuddy-qwen1.5-14b-v21.1-32k-GGUF

Text Generation • 14B • Updated Jan 27 • 28