Mike Shane
xueshuai
AI & ML interests
None yet
Organizations
None yet
Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?
10
#19 opened 10 months ago
by
xueshuai
Function Calling好像修复了
👍
6
7
#20 opened 10 months ago
by
hunzizhe
F*** Sam Altman!
🔥
❤️
180
23
#8 opened 10 months ago
by
6cf
when i run command ,it didnot work. ( via vllm 0.7.3)
2
#16 opened 12 months ago
by
xueshuai
when i use vllm v0.7.2 to deploy r1 awq, i got empty content
13
#10 opened 12 months ago
by
bupalinyu
skips the thinking process
11
#5 opened 12 months ago
by
muzizon
Has anyone evaluated the performance of the AWQ version of the model on benchmarks?
4
#8 opened 12 months ago
by
liuqianchao
有人跑成功了吗, 用的什么配置跑的
6
#58 opened about 1 year ago
by
xl343
vLLM help pls :(
4
#6 opened about 1 year ago
by
fsaudm
Thank you, Elon Musk! You are truly leading by example! Respect to you sir!
😔
❤️
22
7
#15 opened almost 2 years ago
by
jobenb