Milos Mitic

Mitke15's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in zai-org/GLM-4.1V-9B-Thinking 5 months ago

multi-gpu setup on vllm

#15 opened 5 months ago by

Mitke15

New activity in OpenGVLab/InternVL3-78B-AWQ 8 months ago

Tensor parallel size

1

#1 opened 8 months ago by

Mitke15

New activity in Qwen/Qwen2.5-VL-72B-Instruct-AWQ 10 months ago

Lanuch model with vllm --tensor-parallel (Error: input_size_per_partition not divisible by min_thread_k)

8

#2 opened 10 months ago by

prstg