Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32

Base only

Active filters: quanto

aydin99/FLUX.2-klein-4B-int8

Text-to-Image • 4B • Updated Jan 15 • 744 • 13

jvh/whisper-base-quant-ct2

Automatic Speech Recognition • Updated Mar 19, 2024 • 7 • 2

jvh/whisper-large-v2-quant-ct2

Automatic Speech Recognition • Updated Mar 19, 2024 • 10 • 3

jvh/whisper-medium-quant-ct2

Automatic Speech Recognition • Updated Mar 19, 2024 • 8 • 2

jvh/whisper-large-v3-quant-ct2

Automatic Speech Recognition • Updated Mar 19, 2024 • 19 • 1

doreilly257/PleIAs-OCRonos_Q4_K_M

Updated Sep 2, 2024 • 3

doreilly257/PleIAs-OCRonos_Q2_K_M

Updated Sep 2, 2024 • 3

p1atdev/CogView4-6B-quanto_int8

Updated Mar 8, 2025 • 1

jhugentobler/quanto_last_hope_q8a8

0.8B • Updated Jun 7, 2025 • 3

femboysLover/z-image-turbo-quanto-int4

3B • Updated Dec 7, 2025 • 16

VincentGOURBIN/flux_qint_8bit

Text-to-Image • Updated Dec 25, 2025 • 20

tokenlabsdotrun/Llama-3.1-8B-Quanto-Int8

Text Generation • 8B • Updated Jan 8 • 4

Sambhavnoobcoder/gpt2-test-quantization-Quanto-int8

0.2B • Updated Jan 10 • 10

Sambhavnoobcoder/gpt2-test-quantization-Quanto-int8-Quanto-int8

Updated Jan 10 • 4

Sambhavnoobcoder/gpt2-test-quantization-Quanto-int8-Quanto-int8-Quanto-int8

Updated Jan 10 • 4

Sambhavnoobcoder/gpt2-test-quantization-Quanto-int8-Quanto-int8-Quanto-int8-Quanto-int8

Updated Jan 10 • 8

Sambhavnoobcoder/gpt2-test-quantization-Quanto-int8-Quanto-int8-Quanto-int8-Quanto-int8-Quanto-int8

Updated Jan 10 • 5

Sambhavnoobcoder/gpt2-test-quantization-Quanto-int8-Quanto-int8-Quanto-int8-Quanto-int8-Quanto-int8-Quanto-int8

Updated Jan 10 • 4

Hadidiz9/UI-S1-7B-Hybrid-W4-Quanto

Image-Text-to-Text • Updated Jan 20 • 7 • 1

ixim/Qwen-Image-2512-Quanto-INT8-transformer

20B • Updated Feb 2

ixim/Qwen-Image-2512-Quanto-INT8-Full

Text-to-Image • 20B • Updated Feb 2 • 5

ixim/Z-Image-INT8

Text-to-Image • 6B • Updated Feb 22 • 13 • 2

renhehuang/qwen3-1.7b-coffee-sft-quanto-int4

Text Generation • 1B • Updated Mar 16 • 5

renhehuang/qwen3-1.7b-coffee-sft-quanto-int8

Text Generation • 2B • Updated Mar 17 • 5

albex123/flux2-klein-kv-qint8-offload

Text-to-Image • Updated Apr 8 • 5 • 1

haanjack/Solar-Open-100B-MXFP4

Text Generation • 57B • Updated Apr 22 • 32

haanjack/EXAONE-4.5-33B-MXFP4

Image-Text-to-Text • 21B • Updated Apr 22 • 19

haanjack/K-EXAONE-236B-A23B-MXFP4

Text Generation • 130B • Updated Apr 23 • 60 • 1

WaveCut/Cosmos3-Super-Text2Image-Quanto-FP8-Transformer

Text-to-Image • 64B • Updated Jun 1

SLLLC/canary-qwen-2.5b-quanto-8bit-safetensors-stt

Automatic Speech Recognition • Updated Jun 5