70B Version?

by amrothemich - opened Apr 22, 2024

Hi, are y'all working on the 70B version? That would be so helpful to have!

IST Austria Distributed Algorithms and Systems Lab org Apr 22, 2024

@amrothemic Yes, quantization is in progress.

amrothemich changed discussion status to closed May 22, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment