Models

228

Full-text search

Active filters: llm-compressor

JongYeop/Llama-3.1-8B-Instruct-NVFP4-W4A4

5B • Updated Jan 29

JongYeop/Llama-3.1-70B-Instruct-NVFP4-W4A4

41B • Updated Feb 2 • 115

JongYeop/Llama-3.1-8B-Instruct-INT8-W8A8

8B • Updated Feb 3 • 2

JongYeop/Llama-3.1-8B-Instruct-INT8-W8A8-Dynamic-Per-Token

8B • Updated Feb 3 • 2

JongYeop/Llama-3.1-8B-Instruct-FP8-W8A8-Dynamic-Per-Token

8B • Updated Feb 3

rtj1/Qwen2.5-0.5B-AWQ-FP8-Dynamic

Text Generation • 0.6B • Updated Feb 10 • 2

rtj1/Qwen2.5-0.5B-AWQ-FP8-Block

Text Generation • 0.6B • Updated Feb 10 • 31

ludovicoYIN/MiniMax-M2-BF16

Text Generation • 229B • Updated Feb 8 • 2 • 1

vistralis/Qwen3-4B-NVFP4

Text Generation • 3B • Updated Feb 7 • 3 • 1

vistralis/Qwen3-4B-FP8

Text Generation • 4B • Updated Feb 7 • 1

vistralis/Qwen3-4B-INT8

Text Generation • 4B • Updated Feb 7 • 3

vistralis/Qwen3-8B-INT8

Text Generation • 8B • Updated Feb 7 • 4

inference-optimization/Qwen3-Coder-Next.w4a16-old

Text Generation • 12B • Updated Feb 26 • 6

Sophia-AI/Qwen3-4B-Instruct-2507-AWQ-W4A16

Text Generation • 1B • Updated Feb 12 • 76

ludovicoYIN/MiniMax-M2-BF16-W4A16

Text Generation • 34B • Updated Feb 13 • 9

mratsim/MiniMax-M2.5-BF16-INT4-AWQ

Text Generation • 39B • Updated Feb 17 • 11.8k • 38

ekurtic/granite-4.0-h-small-FP8-block

Text Generation • 32B • Updated Feb 14 • 2

ekurtic/granite-4.0-h-small-FP8-dynamic

Text Generation • 32B • Updated Feb 14 • 2

kaitchup/Nanbeige4.1-3B-MXFP4

2B • Updated Feb 16 • 3 • 1

kaitchup/Nanbeige4.1-3B-NVFP4

3B • Updated Feb 17 • 65

kaitchup/Nanbeige4.1-3B-FP8-Dynamic

4B • Updated Feb 17 • 186

kaitchup/Nanbeige4.1-3B-AWQ-W4A16-ASYM

1B • Updated Feb 17 • 5 • 1

RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic

Image-Text-to-Text • 397B • Updated 1 day ago • 2.64k • 5

Sehyo/Qwen3.5-397B-A17B-NVFP4

Updated Mar 2 • 1.55k • 6

prithivMLmods/ZwZ-8B-FP8

Image-Text-to-Text • 9B • Updated Feb 19 • 8 • 1

prithivMLmods/chandra-FP8-Latest

Image-Text-to-Text • 9B • Updated Feb 19 • 230 • 1

prithivMLmods/FireRed-Image-Edit-1.0-FP8

Image-to-Image • Updated Feb 21 • 5

JongYeop/Qwen2.5-VL-3B-Instruct-FP8-W8A8-LM-Only

Image-Text-to-Text • 4B • Updated Feb 22 • 3

JongYeop/Qwen2.5-VL-3B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 3B • Updated Feb 22 • 52

JongYeop/Qwen2.5-VL-7B-Instruct-FP8-W8A8-LM-Only

Image-Text-to-Text • 8B • Updated Feb 22 • 193