JAGVARAL BATSELEM

selmee's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in unsloth/Qwen3.5-27B-GGUF 2 months ago

memory error when loading 27b model on 20gb vram gpu

1

#10 opened 2 months ago by

selmee

Qwen3.5-27B still thinking even with enable_thinking false, here is the method for now to actually disable Thinking Mode on Qwen3.5-27B (llama.cpp b8148）

👀👍 5

6

#4 opened 2 months ago by

gannima

how to run 4bit model on vLLM?

1

#8 opened 2 months ago by

selmee

New activity in apple/FastVLM-7B 6 months ago

Does not work with vLLM?

👍 2

2

#7 opened 8 months ago by

WinterNot