Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

954

Base only

Active filters: 4bit

nxtcloud-org/kanana-safeguard-prompt-2.1b-bitsandbytes-4bit

2B • Updated Jul 22, 2025 • 36 • 1

nxtcloud-org/kanana-safeguard-siren-8b-bitsandbytes-4bit

8B • Updated Jul 22, 2025 • 35 • 1

Cre4T3Tiv3/unsloth-llama3-alpaca-lora

Text Generation • Updated Jul 10, 2025

crazymaker1122/Llama-3.3-8B-Instruct-awq-direct

Text Generation • 8B • Updated Jul 9, 2025 • 50

Susant-Achary/smollm3-indian-recipes

Text Generation • Updated Jul 9, 2025 • 37 • 1

PJEDeveloper/Mistral-Nemo-Instruct-2407-4bit-20250714_213418

13B • Updated Jul 15, 2025 • 2

adamrb/mpt-30b-chat-w4a16-gptq

30B • Updated Jul 15, 2025 • 6

PJEDeveloper/Mistral-7B-Instruct-v0.3-4bit-20250716_003938

Text Generation • 7B • Updated Jul 16, 2025 • 7

PJEDeveloper/Mistral-7B-Instruct-v0.2-4bit-20250716_010928

Text Generation • 7B • Updated Jul 16, 2025 • 3

kivoai/tinyllama-1.1b-chat-gptq

Text Generation • Updated Jul 19, 2025 • 3

Hariprasath28/orpheus-3b-4bit-AWQ

Text Generation • 3B • Updated Jul 19, 2025 • 1.11k

codemajesty/gemma2b-4bit-quantized

Text Generation • 3B • Updated Jul 22, 2025 • 2

Irfanuruchi/1B-building-engineering-llm

1B • Updated Jul 25, 2025 • 1

Irfanuruchi/Llama-3.2-3B-Computer-Engineering-LLM

3B • Updated Jul 25, 2025

jw-sohn/Llama-3.1-8B-Instruct-nf4

Text Generation • 8B • Updated Aug 17, 2025 • 3

btbtyler09/Qwen3-30B-A3B-Instruct-2507-gptq-4bit

Text Generation • 31B • Updated Jul 31, 2025 • 11 • 3

VincentGOURBIN/voxtral-small-4bit-mixed

Automatic Speech Recognition • 25B • Updated Jul 31, 2025 • 104

sp-embraceable/e2-llama-v3p3-70B-Merged-v1-LQ

Text Generation • Updated Jul 31, 2025

YijingOlivia/llama3-movie-rating-lora

Updated Aug 3, 2025

Jacaranda-Health/ASR-STT-4bit

Automatic Speech Recognition • 0.8B • Updated Aug 15, 2025 • 4 • 1

Seonghaa/CalMate-20B-KO-LoRA

Text Generation • Updated Aug 13, 2025

tahamajs/Qwen3-4b-gsm8k-Qlora-SFT

Text Generation • Updated Aug 17, 2025 • 4 • 1

tahamajs/Qwen3-4b-gsm8k-Qlora-GRPO

Text Generation • Updated Aug 17, 2025 • 5 • 2

sweatSmile/Gemma-3-270m-Buddha-QA

Question Answering • Updated Aug 18, 2025 • 1

sweatSmile/Qwen3-0.6B-4bit-NEET

Question Answering • 0.6B • Updated Aug 22, 2025 • 1

analystgatitu/economist_model_v2

Text Generation • 3B • Updated Aug 22, 2025 • 3 • 1

arkaprovob/medgemma-4b-it-mlx-4bit

0.9B • Updated Aug 25, 2025 • 12

trainfarren/john-welbourne-csm-1b-4bit

Text-to-Speech • 2B • Updated Aug 26, 2025

BennyDaBall/Mistral-44B-MoE-Patched-MLX-4bit-G64

Text Generation • 44B • Updated 23 days ago • 644

benyamini/DeepSeek-R1-Distill-Llama-8B-AWQ-w4g128

Updated Jan 25 • 7