machi

pkumc's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in meituan/DeepSeek-R1-Channel-INT8 3 days ago

Fix chat_template crash when assistant message omits the `content` key

#14 opened 4 days ago by

qgallouedec

New activity in meituan/DeepSeek-R1-Channel-INT8 about 1 year ago

Difference with Block-wise Int8?

1

#1 opened about 1 year ago by

leo98xh

New activity in meituan/DeepSeek-R1-Block-INT8 about 1 year ago

How about deepseek v3 model?

1

#15 opened about 1 year ago by

JohnnyBoyzzz

sglang和vllm运行目前不支持blockwise_int8

2

#12 opened about 1 year ago by

zhangneilc

量化类型

1

#11 opened about 1 year ago by

a-r-c

Why hasn't the model file size changed?

1

#9 opened about 1 year ago by

yu5

Update README.md

#10 opened about 1 year ago by

yuanzu

New activity in meituan/DeepSeek-R1-Channel-INT8 about 1 year ago

Update README.md

#2 opened about 1 year ago by

HandH1998

New activity in meituan/DeepSeek-R1-Block-INT8 about 1 year ago

Update README.md

#8 opened about 1 year ago by

HandH1998

Update inference/bf16_cast_block_int8.py

#7 opened about 1 year ago by

HandH1998

Update README.md

#6 opened about 1 year ago by

yuanzu

Update README.md

#5 opened about 1 year ago by

yuanzu

Update README.md

#3 opened about 1 year ago by

yuanzu

Update README.md

#2 opened about 1 year ago by

yuanzu

Update README.md

#1 opened about 1 year ago by

yuanzu

New activity in Qwen/Qwen1.5-MoE-A2.7B about 2 years ago

Why is there only one shared expert in the code?

2

#4 opened about 2 years ago by

KevinChen1994