Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

839

Full-text search

Active filters: quantization

OpenTransformer/unary-quantization-research

Updated 13 days ago

mukesh3444/LTX2-Rapid-Merges-GGUF

Image-Text-to-Video • 19B • Updated 13 days ago • 338

Al-hin/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • 1B • Updated 12 days ago • 1.55k

Ne7/LTX2-Rapid-Merges-GGUF

Image-Text-to-Video • 19B • Updated 11 days ago • 292

groxaxo/Qwen3-4B-Instruct-2507-heretic-W4A16

Text Generation • 0.9B • Updated 11 days ago • 9

namgyu-youn/EXAONE-4.0-1.2B-LLMC-AWQ-W4

0.6B • Updated 11 days ago • 69

oshkorinova/MamayLM-Gemma-3-12B-IT-v1.0-FP8-Dynamic

Text Generation • 12B • Updated 3 days ago • 17

EricRollei/HunyuanImage-3-INT8-v2

Text-to-Image • 83B • Updated 8 days ago • 38

EricRollei/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated 8 days ago • 61

EricRollei/HunyuanImage-3.0-Instruct-INT8-v2

Text-to-Image • 83B • Updated 7 days ago • 10

EricRollei/HunyuanImage-3.0-Instruct-NF4-v2

Text-to-Image • 83B • Updated 7 days ago • 25

AlaminI/nllb-200-600M-ct2-float16

Translation • Updated 6 days ago • 22

AlaminI/nllb-200-600M-ct2-int8

Translation • Updated 6 days ago • 12

Jakubrd4/Bielik-11B-v2.3-Instruct-QuIP-2bit

Text Generation • 0.6B • Updated 6 days ago • 18

AlaminI/nllb-200-600M-nf4-custom-weights-bare-metal

Translation • Updated 4 days ago • 17

MO7YW4NG/ms-marco-MiniLM-L-6-v2-4bit-nf4

Text Ranking • 23.1M • Updated 4 days ago • 27

ApacheOne/ZImageTurbo-nvfp4_mixed

Updated 2 days ago • 38

ApacheOne/Qwen2.5-VL-7B-Instruct-abliterated-nvfp4

Updated 4 days ago • 115

JongYeop/Llama-3.1-8B-Instruct-MXFP4-W4A4

Text Generation • 5B • Updated 4 days ago • 103

JongYeop/Qwen2.5-7B-Instruct-MXFP4-W4A4

Text Generation • 5B • Updated 4 days ago • 19

jameshhugg/OptiMind-SFT-Q4_K_M-GGUF

21B • Updated 4 days ago • 36

oshkorinova/MamayLM-Gemma-3-12B-IT-v1.0-FP8-Static-Ultrachat-200k

Text Generation • 12B • Updated 3 days ago • 19

AlaminI/nllb-200-600M-int8-custom-weights-bare-metal

Translation • Updated 3 days ago • 17

elon-trump/pixtral-12b-2409-w4a16-gptq

3B • Updated 2 days ago • 10

damema5941/Qwen-Image-Edit-2511-FP8

Image-to-Image • Updated 2 days ago • 6

joshuaeric/vllm-tool-calling-guide

Text Generation • Updated 2 days ago

ApacheOne/ZImageBase-nvfp4_mixed

Updated 1 day ago • 8

Wojtekb30/Trurl-2-7B-Q4_K_M-GGUF

7B • Updated 2 days ago • 9

chronicskink51/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • 7B • Updated 1 day ago • 15