宋小猫

SongXiaoMao's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in nerkyor/Qwen3.6-27B-DSV4Pro-Thinking-Distill 2 days ago

VLLM启动报错

9

#2 opened 3 days ago by

SongXiaoMao

liked a model 3 days ago

nerkyor/Qwen3.6-27B-DSV4Pro-Thinking-Distill

Text Generation • 27B • Updated about 4 hours ago • 12.1k • 8

liked a model about 1 month ago

froggeric/Qwen-Fixed-Chat-Templates

Updated 22 days ago • 613

New activity in havenoammo/Qwen3.6-27B-INT8-MTP about 1 month ago

MTP efficiency without official FP8 ha

👍 1

#1 opened about 1 month ago by

SongXiaoMao

liked a model about 1 month ago

havenoammo/Qwen3.6-27B-INT8-MTP

Image-Text-to-Text • 28B • Updated May 9 • 6.51k • 4

New activity in nameistoken/Qwen3.6-27B-Quark-W8A8-INT8 about 1 month ago

MTP cannot be accelerated

#1 opened about 1 month ago by

SongXiaoMao

New activity in inclusionAI/Ling-2.6-flash-int4 about 2 months ago

The official VLLM example starts normal inference error

#3 opened about 2 months ago by

SongXiaoMao

New activity in groxaxo/Qwen3.6-27B-GPTQ-Pro-4bit 2 months ago

This model cannot use MTP

4

#2 opened 2 months ago by

SongXiaoMao

Modify the configuration file

🔥 1

1

#1 opened 2 months ago by

SongXiaoMao

liked a model 2 months ago

huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated

Image-Text-to-Text • 36B • Updated Apr 18 • 14.8k • 66

New activity in z-lab/Qwen3.5-27B-DFlash 2 months ago

FP8 work for base model or is 16-bit of 27B required?

17

#2 opened 3 months ago by

unoid

liked 2 models 2 months ago

Qwen/Qwen3.5-27B-FP8

Image-Text-to-Text • 28B • Updated Apr 24 • 1.35M • 135

Qwen/Qwen3.5-122B-A10B-GPTQ-Int4

Image-Text-to-Text • 125B • Updated Apr 24 • 339k • 41

New activity in Jackrong/Qwopus3.5-27B-v3 3 months ago

Is there anyone who can tell me how to run this model with vllm correctly?

😔 3

7

#8 opened 3 months ago by

beginor

New activity in olka-fi/Qwen3.5-27B-MXFP4 3 months ago

Can the big guy quantify this model into MXFP4? Thank you!!

#3 opened 3 months ago by

SongXiaoMao

New activity in Jackrong/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled 3 months ago

How does the VLLM start this model?

2

#4 opened 3 months ago by

SongXiaoMao

New activity in olka-fi/Qwen3.5-122B-A10B-MXFP4 3 months ago

This quantization model is amzing

❤️👍 2

5

#1 opened 4 months ago by

hyunw55

New activity in olka-fi/Qwen3.5-27B-MXFP4 3 months ago

Why is the file size of 4bit similar to FP8?

3

#2 opened 3 months ago by

SongXiaoMao

liked 2 models 3 months ago

olka-fi/Qwen3.5-35B-A3B-MXFP4

Image-Text-to-Text • 20B • Updated Mar 15 • 318 • 2

olka-fi/Qwen3.5-122B-A10B-MXFP4

Text Generation • 71B • Updated Feb 25 • 332 • 11