FP8 quatized version?

by VlSav - opened Jul 18, 2024

Hello!
Thank you for new promising model!
It is mentioned "Comes with a FP8 quantized version with no accuracy loss". Will it be available?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment