vLLM-Kunlun

community

AI & ML interests

vLLM-Kunlun can deploy models with various torch dtype weights, which can be downloaded here.

published a model 2 months ago

vLLM-Kunlun/GLM-5-W8A8-INT8-Dynamic

in vLLM-Kunlun/Qwen3-235B-A22B-Instruct-2507-Int8-Dynamic 2 months ago

Upload files

#1 opened 2 months ago by

in vLLM-Kunlun/Qwen3-4B-Int8-Dynamic 2 months ago

Update README.md

#6 opened 2 months ago by

in vLLM-Kunlun/Qwen3-4B-Int8-Dynamic 2 months ago

Update README.md

#6 opened 2 months ago by

in vLLM-Kunlun/Qwen3-4B-Int8-Dynamic 2 months ago

Update README.md

#5 opened 2 months ago by

in vLLM-Kunlun/Qwen3-4B-Int8-Dynamic 2 months ago

Update README.md

#5 opened 2 months ago by

in vLLM-Kunlun/Qwen3-4B-Int8-Dynamic 2 months ago

Update README.md

#2 opened 3 months ago by

Update README.md

#4 opened 2 months ago by

in vLLM-Kunlun/Qwen3-4B-Int8-Dynamic 2 months ago

Update README.md

#4 opened 2 months ago by

in vLLM-Kunlun/MiMo-V2-Flash-BF16 2 months ago

Upload files

#4 opened 2 months ago by

Upload files

#3 opened 2 months ago by

Upload files

#2 opened 2 months ago by

Upload files

#1 opened 2 months ago by

in vLLM-Kunlun/Qwen3-4B-Int8-Dynamic 2 months ago

Update README.md

#3 opened 3 months ago by

in vLLM-Kunlun/Qwen3-4B-Int8-Dynamic 3 months ago

Update README.md

#3 opened 3 months ago by

Update README.md

#2 opened 3 months ago by

Update README.md

#1 opened 3 months ago by

published 2 models 3 months ago

vLLM-Kunlun/Qwen3-4B-Int8-Dynamic

4B • Updated Feb 3

vLLM-Kunlun/Qwen3-235B-A22B-Instruct-2507-Int8-Dynamic

updated a model 3 months ago

vLLM-Kunlun/Qwen3-4B-Int8-Dynamic

4B • Updated Feb 3