Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

llm-compression

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

47

Base only

Active filters: llm-compression

caiovicentino1/Qwen3.5-9B-EOQ-v3

Text Generation • 5B • Updated Apr 6 • 16 • 2

caiovicentino1/Qwen3.5-9B-HLWQ-Engine-v4

Text Generation • 7B • Updated Apr 13 • 21

caiovicentino1/Qwen3.5-9B-HLWQ-MLX-4bit

Text Generation • 9B • Updated Apr 13 • 67 • 5

mariokart59/Llama-3.2-3B-AQLM-OA-EM-2Bit-2x8

Text Generation • Updated Apr 14 • 24 • 1

mariokart59/Qwen-2.5-3B-AQLM-OA-EM-2Bit-2x8

Text Generation • 1B • Updated Jun 19 • 32 • 1

mariokart59/Llama-3.1-8B-AQLM-OA-EM-2Bit-2x8

Text Generation • Updated Apr 14 • 17 • 1

Zabo4203/csr-gemma-3-4b-pt

plawanrath/phi-3.5-mini-instruct-random-s10-pia

Text Generation • 4B • Updated 2 days ago • 142

plawanrath/phi-3.5-mini-instruct-magnitude-s10-pia

Text Generation • 4B • Updated 2 days ago • 128

plawanrath/phi-3.5-mini-instruct-wanda-s10-pia

Text Generation • 4B • Updated 2 days ago • 149

plawanrath/phi-3.5-mini-instruct-random-s30-pia

Text Generation • 4B • Updated 2 days ago • 149

plawanrath/phi-3.5-mini-instruct-magnitude-s30-pia

Text Generation • 4B • Updated 2 days ago • 142 • 1

plawanrath/phi-3.5-mini-instruct-wanda-s30-pia

Text Generation • 4B • Updated 2 days ago • 146

plawanrath/phi-3.5-mini-instruct-random-s50-pia

Text Generation • 4B • Updated 2 days ago • 146

plawanrath/phi-3.5-mini-instruct-magnitude-s50-pia

Text Generation • 4B • Updated 2 days ago • 145 • 1

plawanrath/phi-3.5-mini-instruct-wanda-s50-pia

Text Generation • 4B • Updated 2 days ago • 140

plawanrath/phi-3.5-mini-instruct-random-s70-pia

Text Generation • 4B • Updated 2 days ago • 151

plawanrath/phi-3.5-mini-instruct-magnitude-s70-pia

Text Generation • 4B • Updated 2 days ago • 145

plawanrath/phi-3.5-mini-instruct-wanda-s70-pia

Text Generation • 4B • Updated 2 days ago • 146

plawanrath/mistral-7b-instruct-v0.3-random-s10-pia

Text Generation • 7B • Updated May 12 • 12

plawanrath/mistral-7b-instruct-v0.3-magnitude-s10-pia

Text Generation • 7B • Updated May 12 • 20

plawanrath/mistral-7b-instruct-v0.3-wanda-s10-pia

Text Generation • 7B • Updated May 12 • 19

plawanrath/mistral-7b-instruct-v0.3-random-s30-pia

Text Generation • 7B • Updated May 12 • 9

plawanrath/mistral-7b-instruct-v0.3-magnitude-s30-pia

Text Generation • 7B • Updated May 12 • 11

plawanrath/mistral-7b-instruct-v0.3-wanda-s30-pia

Text Generation • 7B • Updated May 12 • 14

plawanrath/mistral-7b-instruct-v0.3-random-s50-pia

Text Generation • 7B • Updated May 12 • 12

plawanrath/mistral-7b-instruct-v0.3-magnitude-s50-pia

Text Generation • 7B • Updated May 12 • 18

plawanrath/mistral-7b-instruct-v0.3-wanda-s50-pia

Text Generation • 7B • Updated May 12 • 14

plawanrath/mistral-7b-instruct-v0.3-random-s70-pia

Text Generation • 7B • Updated May 12 • 8

plawanrath/mistral-7b-instruct-v0.3-magnitude-s70-pia

Text Generation • 7B • Updated May 12 • 17