Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,195

Base only

Active filters: quantization

npario/Qwen3.8-27B-QAT-NVFP4

Image-Text-to-Text • 28B • Updated 24 days ago • 182

b4ph/qwen3-4b-lowram-bench

Text Generation • 4B • Updated 20 days ago • 721 • 3

TelperionAI/Qwen3.8-27B-EXL3-4.0bpw-v2

8B • Updated 24 days ago • 64

TelperionAI/Qwen3.8-27B-EXL3-5.5bpw-v2

11B • Updated 24 days ago • 52 • 1

neopolita/Qwen3.8-Flash-Next-113B-A5B-Niwaki-3bit-mlx

Text Generation • 87B • Updated 22 days ago • 1.05k • 1

neopolita/Qwen3.8-Flash-Next-113B-A5B-Niwaki-3bit-gguf

Text Generation • 121B • Updated 22 days ago • 1.31k • 2

aufjsufjaujda3/vdn-minimax-h3-int8-convrot-comfyui

Updated 24 days ago • 105

agentlans/Apertus-v1.1-4B-Instruct-GGUF

4B • Updated 24 days ago • 609

LookUpMark/Ornith-1.5-35B-A3B-oQ4e-mtp

Text Generation • 36B • Updated 23 days ago • 539

LookUpMark/Ornith-1.5-35B-A3B-oQ6e-mtp

Text Generation • 36B • Updated 23 days ago • 537

LookUpMark/Ornith-1.5-35B-A3B-oQ8e-mtp

Text Generation • 36B • Updated 23 days ago • 575

HBB-Community/wit-GGUF

Text Generation • 0.1B • Updated 22 days ago • 384

single-spark-ai/Qwen3.8-Flash-Next-DGX-Spark-Optimized-Recipe

Text Generation • Updated 10 days ago • 2

penkia/TernaryQuench-Qwen3.8-27B-GGUF

Text Generation • 27B • Updated 21 days ago • 1.31k • 6

SofiTesfay2010/Agents-A1-Flash

Text Generation • 8B • Updated 22 days ago • 357

chenjiaj109550158/AbsorbQuant-NVFP4

Text-to-Image • Updated 3 days ago

pixelwandere34/Qwen3.8-27B-QUASAR-NVFP4

Image-Text-to-Text • 28B • Updated 22 days ago • 180

Rotem12/kokoro-thai-q8-onnx

Text-to-Speech • Updated 22 days ago • 67

wepiqx/Ling-3.0-tiny-ASHQ1-GGUF

Text Generation • 8B • Updated 22 days ago • 826

wepiqx/Ornith-1.5-9B-MTP-ASHQ1-GGUF

Text Generation • 9B • Updated 16 days ago • 2.36k

wepiqx/Spark-X2.5-4B-ASHQ1-GGUF

Text Generation • 4B • Updated 17 days ago • 1.05k

wepiqx/Spark-X2.5-1.7B-ASHQ1-GGUF

Text Generation • 2B • Updated 17 days ago • 1.19k • 1

JBruceAI/VoronoiReasoner-41M-IT-GGUF

Text Generation • 41.9M • Updated 21 days ago • 667 • 1

TitanMamo10/qwen25-qat-q3-poc

0.5B • Updated 21 days ago • 142

Duke-CEI-SVD/traj-mc

Updated 21 days ago

elichen-skymizer/GAP-models

31B • Updated 16 days ago • 43.5k

MingZwhy/qwen3-8b-hif4-l16-17-18

8B • Updated 21 days ago • 17

ewin-reg/jina-embeddings-v5-omni-small-retrieval-Quantized

Feature Extraction • 0.9B • Updated 20 days ago • 720 • 2

collectiveai/canary-1b-v2-onnx-split-int8

Automatic Speech Recognition • Updated 20 days ago • 51

ewin-reg/WeMM-Embedding-2B-Quantized

Feature Extraction • 2B • Updated 3 days ago • 1.82k • 4