Li dongyang

lsm03624's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cyankiwi/Qwen3.5-35B-A3B-AWQ-8bit 12 days ago

The VLLM installed in this way can run this model.

#1 opened 12 days ago by

lsm03624

New activity in cyankiwi/Qwen3.5-35B-A3B-AWQ-4bit 12 days ago

Unable to run (vllm/sglang)

7

#1 opened 15 days ago by

nfunctor

New activity in cyankiwi/Qwen3-Coder-Next-AWQ-4bit about 1 month ago

Can we perform 4-bit quantization for the awq of the Step-3.5-Flash model? The VLLM can run it.

1

#3 opened about 1 month ago by

lsm03624

New activity in ubergarm/Kimi-K2-Thinking-GGUF 4 months ago

the faster the inference speed becomes. Why is that?

👍 1

1

#9 opened 4 months ago by

lsm03624

New activity in MidnightPhreaker/GLM-4.5-Air-REAP-82B-A12B-GPTQ-INT4-gs32 4 months ago

GPU: 5060Ti*4, vllm version 0.11. The following error occurred:

1

#1 opened 4 months ago by

lsm03624

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit 4 months ago

Error installing from PR branch

👍 1

14

#1 opened 4 months ago by

DrRos

New activity in QuantTrio/GLM-4.5-Air-AWQ-FP16Mix 4 months ago

Thanks!

❤️ 2

9

#1 opened 7 months ago by

lightenup

New activity in DevQuasar/MiniMaxAI.MiniMax-M2-GGUF 4 months ago

Seems to be working with PR and `--jinja`

🤝 ❤️ 3

4

#1 opened 4 months ago by

ubergarm