Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

local-inference

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

268

Base only

Active filters: local-inference

continuum-ai/qwen3.5-0.8b-general-forged

Text Generation • 0.8B • Updated Apr 9 • 30

continuum-ai/qwen3.5-2b-general-forged

Text Generation • 2B • Updated Apr 9 • 16

continuum-ai/qwen3.5-9b-general-forged

Text Generation • 9B • Updated Apr 9 • 11

continuum-ai/qwen2.5-coder-7b-compacted

Text Generation • 8B • Updated Apr 11 • 39

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 1.68k • 2

continuum-ai/olmoe-1b-7b-compacted-5b

Text Generation • 5B • Updated Apr 11 • 38 • 1

TxemAI/Qwen3-53B-A3B-2507-TOTAL-RECALL-v2-MLX-6bit

53B • Updated Apr 9 • 21

TxemAI/Qwen3-53B-A3B-2507-TOTAL-RECALL-v2-MLX-8bit

53B • Updated Apr 9 • 17

continuum-ai/mixtral-8x7b-instruct-compacted-conservative

Text Generation • 35B • Updated Apr 11 • 250

Jackrong/Qwen3.5-9B-GLM5.1-Distill-v1

Image-Text-to-Text • 10B • Updated Apr 18 • 2.55k • 69

worthdoing/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Apr 17 • 18

worthdoing/SmolLM2-1.7B-Instruct-GGUF

Text Generation • 2B • Updated Apr 17 • 20

worthdoing/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Apr 17 • 52

worthdoing/Phi-4-mini-GGUF

Text Generation • 4B • Updated Apr 17 • 40

worthdoing/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Apr 17 • 11

Jackrong/Qwen3.5-9B-GLM5.1-Distill-v1-GGUF

Image-Text-to-Text • 9B • Updated Jul 9 • 89.8k • 112

worthdoing/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Apr 17 • 53

worthdoing/DeepSeek-R1-Distill-Qwen-7B-GGUF

Text Generation • 8B • Updated Apr 17 • 130

worthdoing/Phi-3.5-mini-instruct-GGUF

Text Generation • 4B • Updated Apr 17 • 22

worthdoing/Stablelm-2-Zephyr-1.6B-GGUF

Text Generation • 2B • Updated Apr 17 • 31

worthdoing/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • 1B • Updated Apr 17 • 23

worthdoing/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Apr 17 • 39

mradermacher/Qwen3.5-9B-GLM5.1-Distill-v1-GGUF

Text Generation • 9B • Updated Apr 19 • 316

mradermacher/Qwen3.5-9B-GLM5.1-Distill-v1-i1-GGUF

Text Generation • 9B • Updated Apr 19 • 662 • 11

worthdoing/Qwen3.6-35B-A3B-GGUF

Text Generation • 35B • Updated Apr 17 • 4.4k

worthdoing/Mixtral-8x7B-Instruct-v0.1-GGUF

Text Generation • 47B • Updated Apr 17 • 547

ewald1976/Newton-Insights-V1-cannabis-extraction-science-gguf

Text Generation • 8B • Updated Apr 18 • 231 • 1

NguyenDinhHieu/Cube-Python-1.0

Text Generation • 3B • Updated 26 days ago • 125

stamsam/MedusaGemma-E4B

Text Generation • 8B • Updated 13 days ago • 24 • 1

stamsam/MedusaGemma-E4B_MLX_4Bit

Text Generation • 1B • Updated 13 days ago • 51