osmapi

/

MiniMax-M2-THRIFT-55-MLX-4bit

like 2

Follow

osmAPI 139

Could you please quantize a 6-bit or 6.5-bit model that requires 93-97GB of memory? Such a model could be deployed on a Mac with 128GB of RAM. Thank you very much!