Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

3,417

Base only

Active filters: quantization

rshoemake/taq-qwen32b-coder-outlier-3bit

33B • Updated Aug 15 • 6

rshoemake/taq-qwen32b-outlier-3bit

33B • Updated Aug 14 • 4

rshoemake/taq-qwen32b-coder-rotation-outlier-3bit

33B • Updated Aug 15 • 5

rshoemake/taq-qwen32b-rotation-outlier-3bit

33B • Updated Aug 14 • 8

Vishva007/Muse-Glimmer-30B-W4A16-AutoRound

Image-Text-to-Text • 5B • Updated 29 days ago • 95

Vishva007/Muse-Glimmer-30B-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 5B • Updated 29 days ago • 130 • 1

TrojAI/ostquant_qwen3_4b_w4a4kv16_int4_v2

1.0B • Updated Aug 11 • 11

JuliaML/Cosmos3-Super-Image2Video-4Step-INT4-G64-BF16

Image-to-Video • 34B • Updated Aug 11

JuliaML/Cosmos3-Super-Image2Video-4Step-INT8-G64-BF16

Image-to-Video • 65B • Updated Aug 11 • 1

TrojAI/ostquant_qwen3_4b_w4a4kv4_int4_v2

1.0B • Updated Aug 11 • 7

rshoemake/taq-qwen32b-coder-outlier-4bit

33B • Updated Aug 15 • 7

rshoemake/taq-qwen32b-coder-rotation-outlier-4bit

33B • Updated Aug 15 • 7

rshoemake/taq-qwen32b-outlier-2bit

33B • Updated Aug 14 • 4

rshoemake/taq-qwen32b-rotation-outlier-2bit

33B • Updated Aug 14 • 4

rshoemake/taq-qwen32b-coder-mixed-allocator-2bit

33B • Updated Aug 15 • 11

rshoemake/taq-qwen32b-outlier-4bit

33B • Updated Aug 14 • 8

rshoemake/taq-qwen32b-coder-mixed-allocator-3bit

33B • Updated Aug 15 • 6

Uzbekswe/Muse-Glimmer-30B-Q4_K_M-GGUF

Text Generation • 28B • Updated Aug 12 • 182 • 2

rshoemake/taq-qwen32b-rotation-outlier-4bit

33B • Updated Aug 14 • 9

kaushikmondal2289/needle2

Text Generation • Updated Aug 12 • 38

rshoemake/taq-qwen32b-coder-mixed-allocator-4bit

33B • Updated Aug 15 • 11

rshoemake/taq-qwen32b-mixed-allocator-2bit

33B • Updated Aug 14 • 4

DmitryDB/LTX-2.5-ComfyUI-Quants

Text-to-Video • Updated Aug 13 • 2

nuvaidev/all-MiniLM-L6-v2-onnx-quantized

Feature Extraction • Updated Aug 12 • 13 • 1

Geometric-AI/Muse-Glimmer-30B-geoquant-GGUF

Text Generation • 28B • Updated Aug 14 • 117 • 1

dstair/gated-deltanet-nki-trainium

dstair/qwen3.5-moe-fp8-trainium2

Schackay3/Qwen3-Next-80B-A3B-Instruct-ternary-GGUF

Text Generation • 80B • Updated Aug 12 • 708 • 6

ftc8565/replitedet-s0

Object Detection • Updated Aug 14 • 21 • 1

lshar/ARM-TUNE-CPU-INFERENCE-OPT

Text Generation • Updated Aug 14