carlyou/DeepSeek-V2-Lite-FP8-Group
Text Generation • 16B • Updated • 266
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
25
Active filters: group-quantization
donghyunli/Llama-2-7b-KronQ-W4A16-g128
Text Generation • 4B • Updated • 787
donghyunli/Llama-2-7b-KronQ-W2A16-g128
Text Generation • 2B • Updated • 782
donghyunli/Meta-Llama-3-8B-KronQ-W4A16-g128
Text Generation • 5B • Updated • 641
donghyunli/Meta-Llama-3-8B-KronQ-W2A16-g128
Text Generation • 3B • Updated • 559
donghyunli/Llama-2-13b-KronQ-W4A16-g128
Text Generation • 7B • Updated • 310
donghyunli/Llama-2-70b-KronQ-W4A16-g128
Text Generation • 36B • Updated • 649
donghyunli/Llama-2-13b-KronQ-W2A16-g128
Text Generation • 4B • Updated • 618
donghyunli/Llama-2-7b-KronQ-W3A16-g128-fake
Text Generation • 7B • Updated • 699
donghyunli/Meta-Llama-3-8B-KronQ-W3A16-g128-fake
Text Generation • 8B • Updated • 815
donghyunli/Llama-2-70b-KronQ-W2A16-g128
Text Generation • 19B • Updated • 354
donghyunli/Llama-2-13b-KronQ-W3A16-g128-fake
Text Generation • 13B • Updated • 566
donghyunli/Meta-Llama-3-70B-KronQ-W4A16-g128
Text Generation • 37B • Updated • 782
donghyunli/Meta-Llama-3-70B-KronQ-W2A16-g128
Text Generation • 20B • Updated • 481
donghyunli/Llama-2-70b-KronQ-W3A16-g128-fake
Text Generation • 69B • Updated • 606
donghyunli/Meta-Llama-3-70B-KronQ-W3A16-g128-fake
Text Generation • 71B • Updated • 700
ariacompute/qwen3-0.6b_q4
Text Generation • Updated
ariacompute/qwen3-0.6b_q8
Text Generation • Updated
ariacompute/qwen3-1.7b_q326_channel
Text Generation • Updated
ariacompute/qwen3-1.7b_q4
Text Generation • Updated
ariacompute/qwen3-1.7b_q8
Text Generation • Updated
ariacompute/qwen3.5-0.8b_q4
Text Generation • Updated
ariacompute/qwen3.5-0.8b_q8
Text Generation • Updated
ariacompute/qwen3.5-2b_q4
Text Generation • Updated
ariacompute/qwen3.5-2b_q8
Text Generation • Updated