Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,073

Base only

Active filters: ro

fixie-ai/ultravox-v0_5-llama-3_3-70b

Audio-Text-to-Text • 0.7B • Updated Sep 12, 2025 • 13 • 32

mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-GGUF

2B • Updated Jan 31, 2025 • 231

mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-i1-GGUF

2B • Updated Feb 1, 2025 • 324 • 3

mradermacher/DeepSeek-R1-Distill-Qwen-14B-Multilingual-GGUF

15B • Updated Feb 1, 2025 • 188 • 1

mradermacher/DeepSeek-R1-Distill-Qwen-14B-Multilingual-i1-GGUF

15B • Updated Feb 1, 2025 • 298 • 1

mann-e/Hormoz-8B

8B • Updated Feb 5, 2025 • 59 • 21

StickyWorm/salamandra-2b-instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Feb 1, 2025 • 9

StickyWorm/salamandra-7b-instruct-Q2_K-GGUF

Text Generation • 8B • Updated Feb 1, 2025 • 6

Lucy-in-the-Sky/c4ai-command-r7b-12-2024-Q2_K-GGUF

8B • Updated Feb 2, 2025 • 23

Lucy-in-the-Sky/aya-23-35B-Q2_K-GGUF

35B • Updated Feb 2, 2025 • 16

Lucy-in-the-Sky/aya-23-8B-Q2_K-GGUF

8B • Updated Feb 2, 2025 • 14

Lucy-in-the-Sky/aya-expanse-8b-Q2_K-GGUF

8B • Updated Feb 2, 2025 • 4

Lucy-in-the-Sky/aya-expanse-32b-Q2_K-GGUF

32B • Updated Feb 2, 2025 • 11

Lucy-in-the-Sky/c4ai-command-r7b-12-2024-IQ3_M-GGUF

8B • Updated Feb 2, 2025 • 16

huggingkot/c4ai-command-r7b-12-2024-Q4_K_M-GGUF

8B • Updated Feb 3, 2025 • 10

anuccikpmg/multilingual-e5-large-instruct

Feature Extraction • Updated Feb 4, 2025 • 56

AlirezaF138/Hormoz-8B-GGUF

8B • Updated Feb 4, 2025 • 22 • 3

Asakrg/hausa-fine-tune-facebook-mms

1.0B • Updated Feb 5, 2025 • 2

AaronFeng753/aya-expanse-8b-abliterated-Q8_0-GGUF

8B • Updated Feb 5, 2025 • 7

AaronFeng753/aya-expanse-8b-abliterated-Q4_K_S-GGUF

8B • Updated Feb 5, 2025 • 24

testllmuser/DeepSeek-R1-Distill-Qwen-14B-Multilingual-Q5_K_M-GGUF

15B • Updated Feb 5, 2025 • 3

fixie-ai/ultravox-v0_5-llama-3_1-8b

Audio-Text-to-Text • 0.7B • Updated May 6, 2025 • 660 • 37

jebish7/aya-expanse-8b

Text Generation • 8B • Updated Feb 6, 2025 • 21

TransferRapid/whisper-large-v3-turbo_ro

0.8B • Updated Mar 2, 2025 • 97 • 8

jebish7/aya-expanse-32b

Text Generation • 32B • Updated Feb 6, 2025 • 8

Casual-Autopsy/snowflake-arctic-embed-l-v2.0-gguf

Sentence Similarity • 0.6B • Updated Feb 6, 2025 • 2.43k • 14

serahgw/piper-model-original

Updated Feb 6, 2025

mradermacher/BioMistral-7B-DARE-GGUF

7B • Updated Feb 7, 2025 • 82

alikia2x/jina-embedding-v3-m2v-1024

0.3B • Updated May 5, 2025 • 15 • 5

PyThaGo/LeetSeek-R1ML32B

33B • Updated May 29, 2025 • 4