Pavlin Penev

zelias's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit about 1 month ago

vLLM v0.11.1 seems to work, but v0.11.2 fails

👍 ❤️ 2

8

#3 opened about 1 month ago by

stelterlab

New activity in Firworks/Kimi-Linear-48B-A3B-Instruct-nvfp4 about 1 month ago

How many tokens/s are you seeing on those two 6000 Blackwell's?

1

#6 opened about 1 month ago by

zelias

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit about 1 month ago

vLLM v0.11.1 seems to work, but v0.11.2 fails

👍 ❤️ 2

8

#3 opened about 1 month ago by

stelterlab