Black-Ink-Guild
/

Pernicious_Prophecy_70B_FP8

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

invisietch commited on Feb 4, 2025

Commit

8b200be

·

verified ·

1 Parent(s): 55558a9

Update README.md

Files changed (1) hide show

README.md +4 -0

README.md CHANGED Viewed

@@ -293,6 +293,10 @@ license_name: llama3.3
       <a href="https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B">FP16 (HF)</a> |
       <a href="https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B_FP8">FP8 (Aph.)</a>
     </p>
     <h3>Recommended Settings</h3>
     <p>
       Pernicious Prophecy 70B uses the Llama-3 Instruct format, which is available as a preset in all good UIs. The

       <a href="https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B">FP16 (HF)</a> |
       <a href="https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B_FP8">FP8 (Aph.)</a>
     </p>
+    <p>
+      GGUF:
+      <a href="https://huggingface.co/Black-Ink-Guild/Pernicious_Prophecy_70B_GGUF_Q4">Q4_K_S</a>
+    </p>
     <h3>Recommended Settings</h3>
     <p>
       Pernicious Prophecy 70B uses the Llama-3 Instruct format, which is available as a preset in all good UIs. The