Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,440

Base only

Active filters: quantization

pravdin/merged-Gensyn-Qwen2.5-1.5B-Instruct-deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B-gguf

Text Generation • 2B • Updated Jun 27, 2025 • 38

pravdin/Qwen2.5-1.5B-dare_linear-merge-gguf

Text Generation • 2B • Updated Jul 1, 2025 • 25

pravdin/meta-llama-Llam-Llama-3.2-3B-dare_linear-gguf

Text Generation • 3B • Updated Jun 28, 2025 • 9

pravdin/meta-I-Hermes-3-dare_linear-gguf

Text Generation • 3B • Updated Jun 28, 2025 • 27

pravdin/Qwen2.5-1.5B-DeepSeek-R1-dare_linear-gguf

Text Generation • 2B • Updated Jul 1, 2025 • 20

169Pi/Alpie-Core

Text Generation • Updated Jun 19 • 14 • 7

JustJaro/SmolLM-135M-FP8-Static

Image-Text-to-Text • 0.2B • Updated Jul 7, 2025 • 5

JustJaro/SmolLM-135M-FP8-Dynamic-Test

Image-Text-to-Text • 0.1B • Updated Jul 7, 2025 • 3

JustJaro/GOT-OCR-2.0-hf-FP8-Static

Image-Text-to-Text • 0.6B • Updated Jul 7, 2025 • 7

JustJaro/SmolLM-135M_gptq_g32_4bit

Text Generation • 0.1B • Updated Jul 7, 2025 • 5

ConfidentialMind/Mistral-Small-3.2-24B-Instruct-2506-GPTQ-AutoRound-TextOnly

Text Generation • 24B • Updated Jul 7, 2025 • 608

HighCWu/FLUX.1-Kontext-dev-bnb-hqq-4bit

Image-to-Image • 6B • Updated Jul 5, 2025 • 143 • 12

Compumacy/Llama-3.2-3B-Instruct-WINT8

Text Generation • 4B • Updated Jul 6, 2025 • 7

Compumacy/Meta-Llama-3-8B-Instruct-WFP8

Text Generation • 8B • Updated Jul 6, 2025 • 5

Compumacy/Meta-Llama-3-8B-Instruct-WINT8

Text Generation • 8B • Updated Jul 6, 2025 • 4

Compumacy/Phi-4-mini-instruct-WINT4

Text Generation • 4B • Updated Jul 6, 2025 • 5

Compumacy/Meta-Llama-3-8B-Instruct-WINT4

Text Generation • 8B • Updated Jul 6, 2025 • 7

Compumacy/Llama-3.2-3B-Instruct-WINT4

Text Generation • 4B • Updated Jul 6, 2025 • 8

brandonbeiler/Skywork-R1V3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Jul 18, 2025 • 13 • 2

tflsxyy/DeepSeek-V2-Lite-BiMoE-w1g16

Text Generation • 2B • Updated Jul 14, 2025 • 7

codelion/Qwen3-0.6B-accuracy-recovery-lora

Text Generation • Updated Jul 13, 2025 • 2.03k • 5

Arivukkarasu/TinyLlama-1.1B-Chat-GGUF

1B • Updated Jul 15, 2025 • 24 • 1

PJEDeveloper/Mistral-Nemo-Instruct-2407-4bit-20250714_213418

Text Generation • 13B • Updated Jul 15, 2025 • 5

Arivukkarasu/Mistral-7B-Instruct-v0.3-GGUF

7B • Updated Jul 15, 2025 • 3

PJEDeveloper/Mistral-7B-Instruct-v0.3-4bit-20250716_003938

Text Generation • 7B • Updated Jul 16, 2025 • 5

PJEDeveloper/Mistral-7B-Instruct-v0.2-4bit-20250716_010928

Text Generation • 7B • Updated Jul 16, 2025 • 5

kivoai/tinyllama-1.1b-chat-gptq

Text Generation • Updated Jul 19, 2025 • 3

codemajesty/gemma2b-4bit-quantized

Text Generation • 3B • Updated Jul 22, 2025 • 4

devankit/smollm3_q4

dev-bjoern/smolvlm-int4-ov

Image-Text-to-Text • Updated Aug 6, 2025 • 2