Ricky CCK

ricky-cck's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cyankiwi/Mellum2-12B-A2.5B-Thinking-AWQ-INT4 3 months ago

Base model fixed broken SWA

#2 opened 3 months ago by

ricky-cck

New activity in cyankiwi/Mellum2-12B-A2.5B-Thinking-AWQ-INT4 4 months ago

Unable to serve model, got "Only symmetric quantization is supported for MoE" using vllm 0.22.1

1

#1 opened 4 months ago by

ricky-cck

Unable to serve model, got "Only symmetric quantization is supported for MoE" using vllm 0.22.1

1

#1 opened 4 months ago by

ricky-cck

Unable to serve model, got "Only symmetric quantization is supported for MoE" using vllm 0.22.1

1

#1 opened 4 months ago by

ricky-cck