Edit Models filters

Showing models from

Intel Neural Compressor

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

71

Base only

Active filters: INC4AI

INC4AI/Qwen3-Next-80B-A3B-Thinking-int4-AutoRound

Text Generation • 11B • Updated Apr 16 • 25 • 6

INC4AI/DeepSeek-V3.1-Terminus-int4-mixed-AutoRound

Text Generation • 2B • Updated Sep 23, 2025 • 80 • 4

INC4AI/DeepSeek-V3.1-Terminus-gguf-q2ks-mixed-AutoRound

671B • Updated Sep 25, 2025 • 26 • 6

INC4AI/GLM-4.6-gguf-q2ks-mixed-AutoRound

357B • Updated Oct 24, 2025 • 18 • 6

INC4AI/Ling-flash-2.0-gguf-q2ks-mixed-AutoRound

103B • Updated Oct 30, 2025 • 57 • 9

INC4AI/Qwen2.5-0.5B-W4A16-G128-AutoRound-LLMC-TEST-ONLY

Updated Dec 5, 2025

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS1-LLMC-TEST-ONLY

Updated Dec 19, 2025

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS200-LLMC-TEST-ONLY

32B • Updated Dec 19, 2025 • 5

INC4AI/Qwen3-8B-w2g64-AutoRound-test

2B • Updated Dec 23, 2025 • 9 • 1

INC4AI/DeepSeek-V2-Lite-Chat-FP8-STATIC-ATTN-TEST-ONLY

16B • Updated Jan 7 • 30

INC4AI/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only

16B • Updated Dec 29, 2025 • 22

INC4AI/DeepSeek-V2-Lite-Chat-BF16-FP8-STATIC-FP8-KV-TEST-ONLY

16B • Updated Dec 29, 2025 • 90

INC4AI/DeepSeek-R1_mxfp8

INC4AI/DS-V3.2-fp8-w4a16-test-only

3B • Updated Jan 16 • 10

INC4AI/ds-v32-exp-w4a16-test-only

3B • Updated Jan 16 • 5

INC4AI/Qwen2.5-0.5B-Instruct-FP8-Dynamic-LLMC-TEST-Only

0.5B • Updated Jan 19 • 13

INC4AI/LongCat-Flash-Thinking-2601-int4-mixed-AutoRound

Text Generation • 2B • Updated Jan 21 • 53 • 4

INC4AI/MiniMax-M2.1-int4-AutoRound

Text Generation • 1B • Updated Jan 21 • 16 • 1

INC4AI/WeDLM-8B-Instruct-int4-AutoRound

Text Generation • 1B • Updated Jan 21 • 17

INC4AI/Youtu-LLM-2B-int4-AutoRound

Text Generation • 0.5B • Updated Jan 21 • 15

INC4AI/Qwen3-8B-FP8_STATIC-FP8-Attn-LLMC-Test-Only

8B • Updated Jan 26 • 30

INC4AI/unsloth-DeepSeek-R1-BF16-4Layers-Test-Only

15B • Updated Jan 27 • 11

INC4AI/DeepSeek-Math-V2-int4-AutoRound

Text Generation • 3B • Updated Feb 2 • 24

INC4AI/Qwen3-30B-A3B-Instruct-2507-FP8-2Layers

2B • Updated Feb 3 • 23 • 1

INC4AI/ds-r1-autoround-llmc-fp8

671B • Updated Feb 11 • 9

INC4AI/MiroThinker-1.7-int4-AutoRound

Text Generation • 33B • Updated Mar 17 • 13 • 5

INC4AI/Qwen3-8B-MXFP8-LLMC-TEST-ONLY

8B • Updated Mar 20 • 6

INC4AI/Qwen3-8B-MXFP8A16-LLMC-TEST-ONLY

8B • Updated Mar 20 • 7

INC4AI/GLM-5.1-int4-mixed-AutoRound

104B • Updated Apr 9 • 9 • 7

INC4AI/LongCat-Next-int4-AutoRound

Any-to-Any • 44B • Updated Apr 13 • 16 • 2