Spaces:
Running
Running
Any plans for a 4-bit version of Qwen3.5-35B-A3B-Base?
#5
by
Maksim1000 - opened
Hi @cyankiwi!
Thank you for your great work on model quantizations.
I was wondering if you have any plans to release a 4-bit version of Qwen3.5-35B-A3B-Base (similar to what you did with cyankiwi/Qwen3.5-35B-A3B-AWQ-4bit)?
Having a 4-bit version would be incredibly helpful for those of us trying to run this model locally with limited VRAM.
Thanks in advance for your time and your contributions to the community!