inceptionai
/

jais-13b

Text Generation

Model card Files Files and versions

any plan to release quantization that works with llama.cpp

#3

by ziyadalkhonein - opened Sep 4, 2023

any plan to release quantization that works with llama.cpp? you know not lot of people have V100 or A100

You can run it on oobabooga in 4bit which will take less vram

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment