Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

mixed-precision

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

780

Base only

Active filters: mixed-precision

npario/Ornith-1.0-35B-OptiQ-4bit

Image-Text-to-Text • 7B • Updated 11 days ago • 154

appautomaton/sam-3d-objects-mlx-8bit

Image-to-3D • Updated 11 days ago

MarxistLeninist/MiniMax-H3-FL2VA-Pruned-IQ1-GGUF

Image-Text-to-Video • 20B • Updated 10 days ago • 366

MarxistLeninist/MiniMax-H3-LowBit-GGUF

Image-Text-to-Video • 20B • Updated 10 days ago • 347

rshoemake/taq-qwen32b-mixed-allocator-3bit

33B • Updated 7 days ago • 11

rshoemake/taq-qwen32b-mixed-allocator-4bit

33B • Updated 7 days ago • 10

AutomatosX/AX-gpt-oss-20b-MLX-AXQ-4bit

Text Generation • 4B • Updated 6 days ago • 213

AutomatosX/AX-gpt-oss-20b-MLX-AXQ-6bit

Text Generation • 5B • Updated 6 days ago • 638

rshoemake/taq-qwen32b-coder-outlier-2bit

33B • Updated 6 days ago • 37

ariacompute/gemma-3n-e2b-it_q326_channel

Text Generation • Updated 9 days ago

rshoemake/taq-qwen32b-coder-rotation-outlier-2bit

33B • Updated 6 days ago • 32

rshoemake/taq-qwen32b-coder-outlier-3bit

33B • Updated 6 days ago • 32

rshoemake/taq-qwen32b-outlier-3bit

33B • Updated 7 days ago • 14

rshoemake/taq-qwen32b-coder-rotation-outlier-3bit

33B • Updated 6 days ago • 31

rshoemake/taq-qwen32b-rotation-outlier-3bit

33B • Updated 7 days ago • 14

rshoemake/taq-qwen32b-coder-outlier-4bit

33B • Updated 6 days ago • 18

rshoemake/taq-qwen32b-coder-rotation-outlier-4bit

33B • Updated 6 days ago • 17

rshoemake/taq-qwen32b-outlier-2bit

33B • Updated 7 days ago • 14

ariacompute/gemma-3n-e4b-it_q326_channel

Text Generation • Updated 9 days ago

ariacompute/gemma-4-e2b-it_q326_channel

Text Generation • Updated 9 days ago

rshoemake/taq-qwen32b-rotation-outlier-2bit

33B • Updated 7 days ago • 13

rshoemake/taq-qwen32b-coder-mixed-allocator-2bit

33B • Updated 6 days ago • 37

rshoemake/taq-qwen32b-outlier-4bit

33B • Updated 7 days ago • 12

rshoemake/taq-qwen32b-coder-mixed-allocator-3bit

33B • Updated 6 days ago • 36

rshoemake/taq-qwen32b-rotation-outlier-4bit

33B • Updated 7 days ago • 12

rshoemake/taq-qwen32b-coder-mixed-allocator-4bit

33B • Updated 6 days ago • 18

rshoemake/taq-qwen32b-mixed-allocator-2bit

33B • Updated 7 days ago • 12

maglun/Gemma-4-E2B-it-Text-MLX-Mixed-3.62bpw

Text Generation • 0.6B • Updated 4 days ago • 750 • 2

Ishowbackup/MiniMax-M2.7-JANGTQ-CRACK

Text Generation • 15B • Updated 7 days ago • 98

Ishowbackup/Nemotron-3-Super-120B-A12B-UNCENSORED-JANG_2L

Text Generation • 13B • Updated 7 days ago • 415