Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

954

Base only

Active filters: 4bit

boods/mistral-location-extractor-4bit

Text Generation • 7B • Updated Sep 29, 2025 • 3

mradermacher/SEOcrate-4B_grpo_new_01-GGUF

Reinforcement Learning • 4B • Updated Jul 11, 2025 • 127 • 1

mradermacher/SEOcrate-4B_grpo_new_01-i1-GGUF

Reinforcement Learning • 4B • Updated Jul 11, 2025 • 110

vannishh/llama3-2.1B-4bit-finetuned

Updated May 15, 2025

Programmer-RD-AI/ResearchQwen-2.5-3B-LoRA

Question Answering • 3B • Updated May 26, 2025 • 4

CodCodingCode/DeepSeek-V2-medical

Text Generation • Updated May 18, 2025

tripolskypetr/Plutus-Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated May 21, 2025 • 233 • 1

abdou-u/MNLP_M2_quantized_model

Text Generation • 0.6B • Updated May 19, 2025 • 7

HagalazAI/CyberDolphin-2.9.3-mistral-nemo-12b

Text Generation • 12B • Updated May 22, 2025 • 4 • 1

HagalazAI/CyberDolphin-2.9.3-mistral-nemo-12b-GGUF

Text Generation • 12B • Updated May 23, 2025 • 289 • 2

Jimmi42/sarvam-m-4bit-mlx

Text Generation • 4B • Updated May 26, 2025 • 103 • 2

geninhu/RakutenAI-7B-instruct-GPTQ

Updated May 30, 2025 • 1

umangshikarvar/sentiment-qlora-gptneo

Text Classification • Updated Jun 2, 2025

Fulstac/deepseek-r1-Distill-Qwen-32B-sqlgen-4bit-v1

Text Generation • 33B • Updated Jun 6, 2025 • 3

Fulstac/deepseek-r1-Distill-Qwen-32B-lora-4bit-v3

Text Generation • 33B • Updated Jun 6, 2025 • 3

acauanrr/qlora-ti-2025-adapter

Updated Jun 7, 2025 • 3

abdou-u/MNLP_M3_quantized_dpo_mcqa_model

Multiple Choice • 0.6B • Updated Jun 8, 2025 • 2

kevin510/friday-4bit

Text Generation • 4B • Updated Sep 23, 2025 • 14

ayureasehealthcare/ayurezeastraai

Text Generation • Updated Jun 13, 2025

Renugadevi82/cisco-nx-ai-4bit

1B • Updated Jun 16, 2025 • 2

avinashhm/Llama-3.1-Nemotron-Nano-4B-v1.1-GPTQ

Text Generation • 5B • Updated Jun 17, 2025 • 4

btbtyler09/Kimi-Dev-72B-GPTQ-4bit

Text Generation • 73B • Updated Jun 19, 2025 • 12 • 2

riddhimanrana/fastvlm-0.5b-captions

Image-Text-to-Text • 99.1M • Updated Aug 31, 2025 • 227 • 3

mehta/CooperLM-354M-4bit

Text Generation • 0.4B • Updated Jun 21, 2025 • 6 • 1

adriabama06/GLM-4-9B-0414-exl3

Text Generation • Updated Jun 23, 2025 • 4 • 1

JustJaro/SmolLM-135M_gptq_g32_4bit

Text Generation • 0.1B • Updated Jul 7, 2025 • 1

ConfidentialMind/Mistral-Small-3.2-24B-Instruct-2506-GPTQ-AutoRound-TextOnly

Text Generation • 24B • Updated Jul 7, 2025 • 875

btbtyler09/Qwen3-30B-A3B-gptq-4bit

Text Generation • 31B • Updated Jul 30, 2025 • 8

dsuram/mistral-medical-finetuned

Text Generation • Updated Jul 7, 2025

nxtcloud-org/kanana-safeguard-8b-bitsandbytes-4bit

Text Generation • 8B • Updated Jul 22, 2025 • 43 • 1