FP16

by bsbsbsbs112321 - opened Aug 1, 2024

Thanks for the version!
Is it possible to make a fp16 version? For some reason original bf16 is taking 40gb+ of RAM on MacOS.

Would also love to see this

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment