sy128/CQ3-Qwen3-4B-K16-Channel-FP4Mix-WithSub
4B • Updated • 26
CodeQuant3
-
-
sy128/CQ3-Qwen3-4B-K16-Channel-FP4Mix-NoSub
4B • Updated • 24 -
sy128/CQ3-Qwen3-4B-K8-Channel-FP4Mix-WithSub
4B • Updated • 25 -
sy128/CQ3-Qwen3-4B-K8-Channel-FP4Mix-NoSub
4B • Updated • 26 -
sy128/CQ3-Qwen3-4B-K4-Channel-FP4Mix-WithSub
4B • Updated • 29 -
sy128/CQ3-Qwen3-4B-K4-Channel-FP4Mix-NoSub
4B • Updated • 29 -
sy128/CQ3-Qwen3-8B-K16-Channel-FP4Mix-WithSub
8B • Updated • 22 -
sy128/CQ3-Qwen3-8B-K16-Channel-FP4Mix-NoSub
8B • Updated • 25 -
sy128/CQ3-Qwen3-8B-K8-Channel-FP4Mix-WithSub
8B • Updated • 25 -
sy128/CQ3-Qwen3-8B-K8-Channel-FP4Mix-NoSub
8B • Updated • 21 -
sy128/CQ3-Qwen3-8B-K4-Channel-FP4Mix-WithSub
8B • Updated • 19 -
sy128/CQ3-Qwen3-8B-K4-Channel-FP4Mix-NoSub
8B • Updated • 21 -
sy128/CQ3-Qwen3-14B-K16-Channel-FP4Mix-WithSub
15B • Updated • 26 -
sy128/CQ3-Qwen3-14B-K16-Channel-FP4Mix-NoSub
15B • Updated • 24 -
sy128/CQ3-Qwen3-14B-K8-Channel-FP4Mix-WithSub
15B • Updated • 22 -
sy128/CQ3-Qwen3-14B-K8-Channel-FP4Mix-NoSub
15B • Updated • 24 -
sy128/CQ3-Qwen3-14B-K4-Channel-FP4Mix-WithSub
15B • Updated • 24 -
sy128/CQ3-Qwen3-14B-K4-Channel-FP4Mix-NoSub
15B • Updated • 25 -
sy128/CQ3-Qwen3-32B-K16-Channel-FP4Mix-WithSub
33B • Updated • 18 -
sy128/CQ3-Qwen3-32B-K16-Channel-FP4Mix-NoSub
33B • Updated • 25 -
sy128/CQ3-Qwen3-32B-K8-Channel-FP4Mix-WithSub
33B • Updated • 22 -
sy128/CQ3-Qwen3-32B-K8-Channel-FP4Mix-NoSub
33B • Updated • 25 -
sy128/CQ3-Qwen3-32B-K4-Channel-FP4Mix-WithSub
33B • Updated • 22 -
sy128/CQ3-Qwen3-32B-K4-Channel-FP4Mix-NoSub
33B • Updated • 32 -
sy128/CQ3-Qwen3-4B-Thinking-2507-K16-Channel-FP4Mix
4B • Updated • 9 -
sy128/CQ3-Qwen3-4B-Thinking-2507-K8-Channel-FP4Mix
4B • Updated • 10 -
sy128/CQ3-Qwen3-4B-Thinking-2507-K4-Channel-FP4Mix
4B • Updated • 10 -
sy128/CQ3-Llama-3.1-Nemotron-Nano-4B-v1.1-K16-Channel-FP4Mix
5B • Updated • 11 • 1 -
sy128/CQ3-Llama-3.1-Nemotron-Nano-4B-v1.1-K8-Channel-FP4Mix
5B • Updated • 12 -
sy128/CQ3-Llama-3.1-Nemotron-Nano-4B-v1.1-K4-Channel-FP4Mix
5B • Updated • 13 -
sy128/CQ3-DeepSeek-R1-Distill-Llama-8B-K16-Channel-FP4Mix
8B • Updated • 13 -
sy128/CQ3-DeepSeek-R1-Distill-Llama-8B-K8-Channel-FP4Mix
8B • Updated • 14 • 1 -
sy128/CQ3-DeepSeek-R1-Distill-Llama-8B-K4-Channel-FP4Mix
8B • Updated • 16