Amit Gupta

amit864's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cyankiwi/Devstral-2-123B-Instruct-2512-AWQ-4bit 3 months ago

A slightly smaller 4Bit quant is needed.

#2 opened 3 months ago by

amit864

New activity in cyankiwi/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit 4 months ago

Did anyone get speculative decode working?

👀 1

4

#10 opened 5 months ago by

amit864

New activity in cyankiwi/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit 5 months ago

Did anyone get speculative decode working?

👀 1

4

#10 opened 5 months ago by

amit864

Did anyone get speculative decode working?

👀 1

4

#10 opened 5 months ago by

amit864