README.md

metadata

library_name: transformers
license: apache-2.0
base_model:
  - allenai/Molmo-7B-D-0924

Molmo-7B-D NF4 Quant Only the LLM portion was quantized, CLIP encoder remains as is

30GB -> 7GB

approx. 12GB VRAM required

base model for more information:

https://huggingface.co/allenai/Molmo-7B-D-0924