MetaIX
/

GPT4-X-Alpasta-30b-4bit

Text Generation

text-generation-inference

Model card Files Files and versions

MetaIX commited on May 3, 2023

Commit

7f54478

·

1 Parent(s): 8c11117

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -5,7 +5,7 @@ GPT4-X-Alpasta-30b working with Oobabooga's Text Generation Webui and KoboldAI.
 <p><strong>What's included</strong></p>
 <P>GPTQ: 2 quantized versions. One quantized --true-sequential and act-order optimizations, and the other was quantized using --true-sequential --groupsize 128 optimizations (coming soon)</P>
-<P>GGML: 2 quantized versions. One quantized using q4_1, and the second one was quantized using q4_2(coming soon)</P>
 <p><strong>GPU/GPTQ Usage</strong></p>
 <p>To use with your GPU using GPTQ pick one of the .safetensors along with all of the .jsons and .model files.</p>

 <p><strong>What's included</strong></p>
 <P>GPTQ: 2 quantized versions. One quantized --true-sequential and act-order optimizations, and the other was quantized using --true-sequential --groupsize 128 optimizations (coming soon)</P>
+<P>GGML: 1 quantized version. One quantized using q4_1</P>
 <p><strong>GPU/GPTQ Usage</strong></p>
 <p>To use with your GPU using GPTQ pick one of the .safetensors along with all of the .jsons and .model files.</p>