Black-Ink-Guild
/

Pernicious_Prophecy_70B

Text Generation

text-generation-inference

Model card Files Files and versions

SicariusSicariiStuff commited on Feb 8, 2025

Commit

97d8317

·

verified ·

1 Parent(s): ad0850d

Update README.md

Files changed (1) hide show

README.md +4 -0

README.md CHANGED Viewed

@@ -305,6 +305,10 @@ language:
       <a href="https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B-3.5bpw">3.5bpw</a> |
       <a href="https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B-5.0bpw">5.0bpw</a>
     </p>
     <h3>Recommended Settings</h3>
     <p>
       Pernicious Prophecy 70B uses the Llama-3 Instruct format, which is available as a preset in all good UIs. The

       <a href="https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B-3.5bpw">3.5bpw</a> |
       <a href="https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B-5.0bpw">5.0bpw</a>
     </p>
+    <p>
+      GPTQ:
+      <a href="https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B_GPTQ">GPTQ-4Bit-g32</a> |
+    </p>
     <h3>Recommended Settings</h3>
     <p>
       Pernicious Prophecy 70B uses the Llama-3 Instruct format, which is available as a preset in all good UIs. The