Any int4 version ?

by lucasjin - opened Nov 17, 2023

Any int4 version ?

There is other compression format availbale by TheBloke https://huggingface.co/TheBloke/Nous-Capybara-34B-GGUF

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment