Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

20

Base only

Active filters: q4f16_1

pr0methium/ReelevateLM-q4f16_1

Updated May 30, 2025 • 6

brimtown/Groupchat-Qwen3-0.6B-MLC

Text Generation • Updated Oct 26, 2025 • 20

brimtown/Groupchat-Qwen2.5-0.5B-MLC

Text Generation • Updated Oct 24, 2025 • 23

brimtown/Groupchat-Qwen3-4B-MLC

Text Generation • Updated Oct 24, 2025 • 4

vikramlingam/SmolLM2-360M-Instruct-q4f16_1-MLC

Updated Feb 1 • 11

jjjunho/Qwen3-4B-Instruct-2507-MLC

Text Generation • Updated Feb 1

Akshayram1/omnibrowser-planner-1p5b-q4f16_1-MLC

Text Generation • Updated Mar 29 • 4 • 1

Pelnora/Bielik-Minitron-7B-v3-Instruct-q4f16_1-MLC

Text Generation • Updated May 10 • 2 • 1

Maelstrome/wave-gemma4-E2B-q4f16_1-MLC

kasys/llm-jp-4-8b-thinking-q4f16_1-MLC

Text Generation • Updated Jun 4

aipster/Phi-4-mini-instruct-abliterated-q4f16_1-MLC

Text Generation • Updated Jun 17 • 27

belsamber/OmniCoder-9B-q4f16_1-MLC

Text Generation • Updated Jun 21 • 3 • 1

bernardw/qwen2.5-coder-3b-codereview-taid-q4-mlc

Updated Jun 29 • 4

bernardw/qwen2.5-coder-1.5b-codereview-taid-q4-mlc

bernardw/qwen2.5-coder-3b-codereview-multiteacher-q4-mlc

bernardw/qwen3-4b-codereview-taid-q4-mlc

Text Generation • Updated Jul 15 • 2

bernardw/qwen3-1.7b-codereview-taid-q4-mlc

Text Generation • Updated Jul 15 • 4

Leyten/Qwen3.5-9B-compute-q4f16_1-MLC

Text Generation • Updated 3 days ago • 38

Leyten/Qwen3.5-4B-compute-q4f16_1-MLC

Text Generation • Updated 3 days ago • 24

nyaaorick/Qwen3.8-2B-q4f16_1-MLC

Text Generation • Updated 2 days ago • 4