Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,896

Base only

Active filters: quantized

TheMelonGod/Qwen3-1.7B-exl2

Text Generation • Updated May 23, 2025 • 36 • 1

TheMelonGod/Qwen3-0.6B-exl2

Text Generation • Updated May 23, 2025 • 42

c516a/quantized-codegemma-7b-it

Text Generation • Updated May 25, 2025 • 3

TheMelonGod/Qwen3-14B-exl2

Text Generation • Updated May 25, 2025 • 46

tifin-india/sarvam-m-24b-q6-k-gguf

Text Generation • 24B • Updated May 24, 2025 • 25 • 1

tifin-india/sarvam-m-24b-q5-1-gguf

Text Generation • 24B • Updated May 24, 2025 • 21

tifin-india/sarvam-m-24b-q2-k-gguf

Text Generation • 24B • Updated May 24, 2025 • 15

tifin-india/sarvam-m-24b-f16-gguf

Text Generation • 24B • Updated May 24, 2025 • 31

tifin-india/sarvam-m-24b-q3-k-l-gguf

Text Generation • 24B • Updated May 24, 2025 • 13

tifin-india/sarvam-m-24b-q3-k-s-gguf

Text Generation • 24B • Updated May 24, 2025 • 11

tifin-india/sarvam-m-24b-q3-k-gguf

Text Generation • 24B • Updated May 24, 2025 • 11

tifin-india/sarvam-m-24b-q4-k-m-gguf

Text Generation • 24B • Updated May 24, 2025 • 58 • 1

tifin-india/sarvam-m-24b-q3-k-m-gguf

Text Generation • 24B • Updated May 24, 2025 • 13

tifin-india/sarvam-m-24b-q4-k-s-gguf

Text Generation • 24B • Updated May 24, 2025 • 16

tifin-india/sarvam-m-24b-q5-k-m-gguf

Text Generation • 24B • Updated May 24, 2025 • 54 • 2

phazei/phazei-SkyReels-V2-fp8-e5m2

Text-to-Video • Updated May 25, 2025 • 4

Kikinoking/MNLP_M2_quantized_model

0.6B • Updated May 27, 2025 • 3

dinhnhat241103/Phi-4-mini-instruct-Vi

4B • Updated May 25, 2025 • 3

argmaxinc/parakeetkit-pro

Automatic Speech Recognition • Updated Sep 23, 2025 • 160k • 4

Raymond-dev-546730/MaterialsAnalyst-AI-7B

Text Generation • 8B • Updated Aug 1 • 387 • 8

Jimmi42/sarvam-m-4bit-mlx

Text Generation • 4B • Updated May 26, 2025 • 75 • 2

tommytracx/CodeLlama-Edge-1.5B

Text Generation • Updated May 26, 2025 • 2

martinctl/MNLP_M2_quantized_model

Text Generation • 0.6B • Updated May 27, 2025 • 7

MWeste/MNLP_M2_quantized_model

0.6B • Updated Jun 6, 2025 • 6

steampunque/Qwen3-30B-A3B-MP-GGUF

31B • Updated Apr 22 • 65

steampunque/Qwen3-14B-MP-GGUF

15B • Updated Apr 21 • 24

steampunque/Mistral-Small-3.1-24B-Instruct-2503-MP-GGUF

24B • Updated Feb 18 • 67 • 1

ikerion/mistral-7b-magyar-q4-gguf

7B • Updated May 29, 2025 • 33

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • 8B • Updated May 29, 2025 • 162k • 11

mahdi-b/viral-esm2-3b-hqq

2B • Updated May 30, 2025 • 16