Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

12,019

Base only

Active filters: llama.cpp

Lyronx/AI_maid_Chinese

8B • Updated May 13 • 56 • 1

salimlko/XML_Qwen2_5_Coder_3B_bnb_4bit_Model_V2

Text Generation • 3B • Updated Mar 26, 2025 • 14

DARELab/qwen-coder-2.5-32B-SFT-fc4eosc

33B • Updated Apr 4, 2025 • 40

Mungert/gemma-3-4b-it-qat-q4_0-GGUF

Image-Text-to-Text • 4B • Updated Sep 24, 2025 • 282 • 2

erax-ai/EraX-Translator-V1.0

Translation • 4B • Updated May 6, 2025 • 39 • 29

Deaquay/T-Rex-mini-IQ4_XS-GGUF

8B • Updated Apr 9, 2025 • 7

matrixportalx/Gemmasutra-Small-4B-v1-GGUF

Text Generation • 4B • Updated Apr 9, 2025 • 453

Deaquay/T-Rex-mini-I1-GGUF

8B • Updated Apr 9, 2025 • 47

BirdieByte1024/doctor-dental-implant-LoRA-Qwen2.5-7B-Instruct-FullModel

8B • Updated Apr 12, 2025 • 66 • 1

mradermacher/EraX-Translator-V1.0-GGUF

Translation • 4B • Updated Jul 31, 2025 • 283 • 1

erax-ai/EraX-Translator-V1.0-GGUF

Translation • 4B • Updated May 6, 2025 • 462 • 10

mradermacher/EraX-Translator-V1.0-i1-GGUF

Translation • 4B • Updated Jul 11, 2025 • 710 • 1

dipeshmajithia/mirror_dolly

7B • Updated Apr 15, 2025 • 29 • 1

ZeroAgency/Zero-Mistral-24B-gguf

Text Generation • 24B • Updated Apr 22, 2025 • 343 • 4

Tiotanio/gemma-3-27b-it-tr-reasoning_Q4_K_M

27B • Updated Apr 25, 2025 • 38 • 1

christopherheuer/phi3-mini-4k-instruct-pii-redactor-q4_k_m-gguf

Text Generation • 4B • Updated Apr 25, 2025 • 20

jedisct1/MiMo-7B-RL-GGUF

8B • Updated Apr 30, 2025 • 2.52k • 30

AlSamCur123/Mistral-Small-Instruct-2409

22B • Updated Apr 6 • 21

Baskar2005/deepseek_Sunfall_Merged_Model

8B • Updated May 8, 2025 • 91

Baskar2005/deepseek_sunfall_merged_model_GGUF

8B • Updated May 8, 2025 • 5

sychonix/OlympicCoder-7B-Sychonix

8B • Updated May 14, 2025 • 4 • 1

kelkalot/medgemma-4b-it-GGUF

4B • Updated May 22, 2025 • 196 • 12

tifin-india/sarvam-m-24b-q6-k-gguf

Text Generation • 24B • Updated May 24, 2025 • 45 • 1

tifin-india/sarvam-m-24b-q5-1-gguf

Text Generation • 24B • Updated May 24, 2025 • 20

tifin-india/sarvam-m-24b-q2-k-gguf

Text Generation • 24B • Updated May 24, 2025 • 23

tifin-india/sarvam-m-24b-f16-gguf

Text Generation • 24B • Updated May 24, 2025 • 26

tifin-india/sarvam-m-24b-q3-k-l-gguf

Text Generation • 24B • Updated May 24, 2025 • 39

tifin-india/sarvam-m-24b-q3-k-s-gguf

Text Generation • 24B • Updated May 24, 2025 • 39

tifin-india/sarvam-m-24b-q3-k-gguf

Text Generation • 24B • Updated May 24, 2025 • 27

tifin-india/sarvam-m-24b-q4-k-m-gguf

Text Generation • 24B • Updated May 24, 2025 • 38 • 1