Could you please quantize a 6-bit or 6.5-bit model that requires 93-97GB of memory? Such a model could be deployed on a Mac with 128GB of RAM. Thank you very much!

by mimeng1990 - opened Dec 3, 2025

mimeng1990

Dec 3, 2025

Could you please quantize a 6-bit or 6.5-bit model that requires 93-97GB of memory? Such a model could be deployed on a Mac with 128GB of RAM. Thank you very much!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment