Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,690

Base only

Active filters: ro

AaronFeng753/aya-expanse-8b-abliterated-Q8_0-GGUF

8B • Updated Feb 5, 2025 • 36

AaronFeng753/aya-expanse-8b-abliterated-Q4_K_S-GGUF

8B • Updated Feb 5, 2025 • 8

testllmuser/DeepSeek-R1-Distill-Qwen-14B-Multilingual-Q5_K_M-GGUF

15B • Updated Feb 5, 2025 • 4

fixie-ai/ultravox-v0_5-llama-3_1-8b

Audio-Text-to-Text • Updated May 6, 2025 • 6.14k • 37

jebish7/aya-expanse-8b

Text Generation • 8B • Updated Feb 6, 2025 • 8

jebish7/aya-expanse-32b

Text Generation • 32B • Updated Feb 6, 2025 • 6

Casual-Autopsy/snowflake-arctic-embed-l-v2.0-gguf

Sentence Similarity • 0.6B • Updated Feb 6, 2025 • 14.3k • 14

serahgw/piper-model-original

Updated Feb 6, 2025

fixie-ai/ultravox-v0_5-llama-3_2-1b

Audio-Text-to-Text • 0.7B • Updated Mar 11 • 1.21M • 88

mradermacher/BioMistral-7B-DARE-GGUF

7B • Updated Feb 7, 2025 • 37

alikia2x/jina-embedding-v3-m2v-1024

Updated May 5, 2025 • 11 • 5

PyThaGo/LeetSeek-R1ML32B

33B • Updated May 29, 2025 • 4

nomic-ai/nomic-embed-text-v2-moe

Sentence Similarity • 0.5B • Updated Apr 1, 2025 • 1.49M • 489

Nagase-Kotono/e5-large-korean-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Feb 8, 2025 • 3

dinab/multilingual-e5-base-Q4_0-GGUF

Sentence Similarity • 0.3B • Updated Feb 8, 2025 • 8

dinab/multilingual-e5-base-Q8_0-GGUF

Sentence Similarity • 0.3B • Updated Feb 8, 2025 • 139 • 2

dinab/multilingual-e5-base-Q5_K_S-GGUF

Sentence Similarity • 0.3B • Updated Feb 8, 2025 • 8

dinab/multilingual-e5-base-Q4_K_S-GGUF

Sentence Similarity • 0.3B • Updated Feb 8, 2025 • 8

Impulse2000/multilingual-e5-large-instruct-GGUF

Feature Extraction • 0.6B • Updated Feb 8, 2025 • 13 • 1

Lucy-in-the-Sky/c4ai-command-r7b-12-2024-Q8_0-GGUF

8B • Updated Feb 8, 2025 • 19

Lucy-in-the-Sky/c4ai-command-r7b-12-2024-Q4_K_M-GGUF

8B • Updated Feb 9, 2025 • 7

Lucy-in-the-Sky/c4ai-command-r7b-12-2024-Q6_K-GGUF

8B • Updated Feb 9, 2025 • 11

adriey/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-Q8_0-GGUF

2B • Updated Feb 10, 2025 • 8

adriey/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual

2B • Updated Feb 10, 2025 • 1

panagoa/nllb-200-distilled-600M-kbd-v0.1

Translation • 0.6B • Updated Mar 2, 2025 • 4

Zenabius/multilingual-e5-large-instruct-Q8_0-GGUF

0.6B • Updated Feb 10, 2025 • 10

Zenabius/multilingual-e5-large-Q8_0-GGUF

Feature Extraction • 0.6B • Updated Feb 10, 2025 • 9

sander-wood/clamp3

Feature Extraction • Updated Feb 24, 2025 • 12

ClausQ-dk/madlad400-10b-mt-Q2_K-GGUF

Translation • 11B • Updated Feb 10, 2025 • 4 • 1

Cran-May/Hormoz-8B-IQ4_NL-GGUF

8B • Updated Feb 11, 2025 • 5 • 2