sy128/CQ3-Qwen3-32B-K4-SqueezeLLM
33B • Updated • 31
Shawn Yin PRO
sy128
AI & ML interests
AI Efficiency, Representation Learning
Recent Activity
updated a model 2 days ago
sy128/CQ3-Qwen3-32B-K4-SqueezeLLM updated a model 2 days ago
sy128/CQ3-Qwen3-32B-K8-SqueezeLLM updated a model 2 days ago
sy128/CQ3-Qwen3-32B-K16-SqueezeLLMOrganizations
sy128/CQ3-Qwen3-32B-K8-SqueezeLLM
33B • Updated • 24
sy128/CQ3-Qwen3-32B-K16-SqueezeLLM
33B • Updated • 19
sy128/CQ3-Qwen3-14B-K4-SqueezeLLM
15B • Updated • 34
sy128/CQ3-Qwen3-14B-K8-SqueezeLLM
15B • Updated • 31
sy128/CQ3-Qwen3-14B-K16-SqueezeLLM
15B • Updated • 41
sy128/CQ3-Qwen3-8B-K4-SqueezeLLM
8B • Updated • 32
sy128/CQ3-Qwen3-8B-K8-SqueezeLLM
8B • Updated • 34
sy128/CQ3-Qwen3-8B-K16-SqueezeLLM
8B • Updated • 36
sy128/CQ3-Qwen3-4B-K4-SqueezeLLM
4B • Updated • 40
sy128/CQ3-Qwen3-4B-K8-SqueezeLLM
4B • Updated • 47
sy128/CQ3-Qwen3-4B-K16-SqueezeLLM
4B • Updated • 39
sy128/CQ3-DeepSeek-R1-Distill-Llama-8B-K4-SqueezeLLM
8B • Updated • 17
sy128/CQ3-DeepSeek-R1-Distill-Llama-8B-K8-SqueezeLLM
8B • Updated • 13
sy128/CQ3-DeepSeek-R1-Distill-Llama-8B-K16-SqueezeLLM
8B • Updated • 13
sy128/CQ3-Llama-3.1-Nemotron-Nano-4B-v1.1-K4-SqueezeLLM
5B • Updated • 12
sy128/CQ3-Llama-3.1-Nemotron-Nano-4B-v1.1-K8-SqueezeLLM
5B • Updated • 14
sy128/CQ3-Llama-3.1-Nemotron-Nano-4B-v1.1-K16-SqueezeLLM
5B • Updated • 14
sy128/CQ3-Qwen3-4B-Thinking-2507-K4-SqueezeLLM
4B • Updated • 16
sy128/CQ3-Qwen3-4B-Thinking-2507-K8-SqueezeLLM
4B • Updated • 11
sy128/CQ3-Qwen3-4B-Thinking-2507-K16-SqueezeLLM
4B • Updated • 11
sy128/CQ3-DeepSeek-R1-Distill-Llama-8B-K4-CodeQuant
8B • Updated • 13
sy128/CQ3-DeepSeek-R1-Distill-Llama-8B-K8-CodeQuant
8B • Updated • 14 • 1
sy128/CQ3-DeepSeek-R1-Distill-Llama-8B-K16-CodeQuant
8B • Updated • 13
sy128/CQ3-DeepSeek-R1-Distill-Llama-8B-K4-Channel-FP4Mix
8B • Updated • 16
sy128/CQ3-DeepSeek-R1-Distill-Llama-8B-K8-Channel-FP4Mix
8B • Updated • 14 • 1
sy128/CQ3-DeepSeek-R1-Distill-Llama-8B-K16-Channel-FP4Mix
8B • Updated • 13
sy128/CQ3-Llama-3.1-Nemotron-Nano-4B-v1.1-K4-CodeQuant
5B • Updated • 12 • 2
sy128/CQ3-Llama-3.1-Nemotron-Nano-4B-v1.1-K8-CodeQuant
5B • Updated • 11 • 3
sy128/CQ3-Llama-3.1-Nemotron-Nano-4B-v1.1-K16-CodeQuant
5B • Updated • 12