sy128/CQ3-Llama-3.1-Nemotron-Nano-4B-v1.1-K4-Channel-FP4Mix
5B • Updated • 13
Shawn Yin PRO
sy128
AI & ML interests
AI Efficiency, Representation Learning
Recent Activity
updated a model 3 days ago
sy128/CQ3-Qwen3-32B-K4-SqueezeLLM updated a model 3 days ago
sy128/CQ3-Qwen3-32B-K8-SqueezeLLM updated a model 3 days ago
sy128/CQ3-Qwen3-32B-K16-SqueezeLLMOrganizations
sy128/CQ3-Llama-3.1-Nemotron-Nano-4B-v1.1-K8-Channel-FP4Mix
5B • Updated • 12
sy128/CQ3-Llama-3.1-Nemotron-Nano-4B-v1.1-K16-Channel-FP4Mix
5B • Updated • 11 • 1
sy128/CQ3-Qwen3-4B-Thinking-2507-K4-Channel-FP4Mix
4B • Updated • 10
sy128/CQ3-Qwen3-4B-Thinking-2507-K8-Channel-FP4Mix
4B • Updated • 10
sy128/CQ3-Qwen3-4B-Thinking-2507-K16-Channel-FP4Mix
4B • Updated • 9
sy128/CQ3-Qwen3-4B-Thinking-2507-K4-CodeQuant
4B • Updated • 14 • 2
sy128/CQ3-Qwen3-4B-Thinking-2507-K8-CodeQuant
4B • Updated • 10
sy128/CQ3-Qwen3-4B-Thinking-2507-K16-CodeQuant
4B • Updated • 14 • 1
sy128/CQ3-Qwen3-32B-W2-ParoQuant-WO
33B • Updated • 20
sy128/CQ3-Qwen3-32B-W3-ParoQuant-WO
33B • Updated • 16
sy128/CQ3-Qwen3-32B-W4-ParoQuant-WO
33B • Updated • 17
sy128/CQ3-Qwen3-14B-W2-ParoQuant-WO
15B • Updated • 20
sy128/CQ3-Qwen3-14B-W3-ParoQuant-WO
15B • Updated • 19
sy128/CQ3-Qwen3-14B-W4-ParoQuant-WO
15B • Updated • 19
sy128/CQ3-Qwen3-8B-W2-ParoQuant-WO
8B • Updated • 14
sy128/CQ3-Qwen3-8B-W3-ParoQuant-WO
8B • Updated • 29
sy128/CQ3-Qwen3-8B-W4-ParoQuant-WO
8B • Updated • 23
sy128/CQ3-Qwen3-4B-W2-ParoQuant-WO
4B • Updated • 21
sy128/CQ3-Qwen3-4B-W3-ParoQuant-WO
4B • Updated • 17
sy128/CQ3-Qwen3-4B-W4-ParoQuant-WO
4B • Updated • 21
sy128/CQ3-Qwen3-32B-K4-CodeQuant
33B • Updated • 14
sy128/CQ3-Qwen3-32B-K8-CodeQuant
33B • Updated • 18
sy128/CQ3-Qwen3-32B-K16-CodeQuant
33B • Updated • 24
sy128/CQ3-Qwen3-14B-K4-CodeQuant
15B • Updated • 32
sy128/CQ3-Qwen3-14B-K8-CodeQuant
15B • Updated • 24
sy128/CQ3-Qwen3-14B-K16-CodeQuant
15B • Updated • 19
sy128/CQ3-Qwen3-8B-K4-CodeQuant
8B • Updated • 22
sy128/CQ3-Qwen3-8B-K8-CodeQuant
8B • Updated • 18
sy128/CQ3-Qwen3-8B-K16-CodeQuant
8B • Updated • 32