Spaces:
Running
Running
Add Qwen3.5-4B Pingala-8 to the models table
Browse files- README.md +1 -0
- index.html +2 -1
README.md
CHANGED
|
@@ -18,6 +18,7 @@ Founded by Harshit Goyal, former Google software engineer and IIIT Delhi alumnus
|
|
| 18 |
|---|---|---|---|
|
| 19 |
| [Qwen3-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit) | 1.24 GB | 16.64 | 28.61 |
|
| 20 |
| [Llama-3.1-8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit) | 2.39 GB | 9.14 | 12.35 |
|
|
|
|
| 21 |
|
| 22 |
Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them.
|
| 23 |
|
|
|
|
| 18 |
|---|---|---|---|
|
| 19 |
| [Qwen3-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit) | 1.24 GB | 16.64 | 28.61 |
|
| 20 |
| [Llama-3.1-8B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit) | 2.39 GB | 9.14 | 12.35 |
|
| 21 |
+
| [Qwen3.5-4B-Pingala8-2bit](https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit) | 1.51 GB | 10.97 | 14.75 |
|
| 22 |
|
| 23 |
Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them.
|
| 24 |
|
index.html
CHANGED
|
@@ -26,6 +26,7 @@
|
|
| 26 |
<tr><th>Model</th><th>Size</th><th>WikiText-2 PPL, ours</th><th>IQ2_XXS, same size</th></tr>
|
| 27 |
<tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3-4B-Pingala8-2bit</a></td><td>1.24 GB</td><td>16.64</td><td>28.61</td></tr>
|
| 28 |
<tr><td><a href="https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Llama-3.1-8B-Pingala8-2bit</a></td><td>2.39 GB</td><td>9.14</td><td>12.35</td></tr>
|
|
|
|
| 29 |
</table>
|
| 30 |
<p class="lead">Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them.</p>
|
| 31 |
<h2>Pingala-8: 2-bit LLMs for llama.cpp, no retraining</h2>
|
|
@@ -41,7 +42,7 @@
|
|
| 41 |
<li><a href="https://github.com/Genrius-AI/pingala8-llm/releases/tag/v2.4-oneclick" target="_blank" rel="noopener noreferrer">One-click Windows build</a></li>
|
| 42 |
<li><a href="https://github.com/Genrius-AI/pingala8-llm" target="_blank" rel="noopener noreferrer">Code</a></li>
|
| 43 |
<li><a href="https://doi.org/10.5281/zenodo.23481757" target="_blank" rel="noopener noreferrer">Paper</a></li>
|
| 44 |
-
<li><a href="https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3-4B-Pingala8-2bit</a>
|
| 45 |
<li><a href="https://huggingface.co/datasets/Genrius-AI/pingala8-benchmarks" target="_blank" rel="noopener noreferrer">Benchmark tables</a></li>
|
| 46 |
</ul>
|
| 47 |
</main>
|
|
|
|
| 26 |
<tr><th>Model</th><th>Size</th><th>WikiText-2 PPL, ours</th><th>IQ2_XXS, same size</th></tr>
|
| 27 |
<tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3-4B-Pingala8-2bit</a></td><td>1.24 GB</td><td>16.64</td><td>28.61</td></tr>
|
| 28 |
<tr><td><a href="https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Llama-3.1-8B-Pingala8-2bit</a></td><td>2.39 GB</td><td>9.14</td><td>12.35</td></tr>
|
| 29 |
+
<tr><td><a href="https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-4B-Pingala8-2bit</a></td><td>1.51 GB</td><td>10.97</td><td>14.75</td></tr>
|
| 30 |
</table>
|
| 31 |
<p class="lead">Lower is better. The files need our patched llama.cpp build (NVIDIA CUDA); stock llama.cpp, Ollama and LM Studio cannot load them.</p>
|
| 32 |
<h2>Pingala-8: 2-bit LLMs for llama.cpp, no retraining</h2>
|
|
|
|
| 42 |
<li><a href="https://github.com/Genrius-AI/pingala8-llm/releases/tag/v2.4-oneclick" target="_blank" rel="noopener noreferrer">One-click Windows build</a></li>
|
| 43 |
<li><a href="https://github.com/Genrius-AI/pingala8-llm" target="_blank" rel="noopener noreferrer">Code</a></li>
|
| 44 |
<li><a href="https://doi.org/10.5281/zenodo.23481757" target="_blank" rel="noopener noreferrer">Paper</a></li>
|
| 45 |
+
<li><a href="https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3-4B-Pingala8-2bit</a>, <a href="https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Llama-3.1-8B-Pingala8-2bit</a> and <a href="https://huggingface.co/Genrius-AI/Qwen3.5-4B-Pingala8-2bit" target="_blank" rel="noopener noreferrer">Qwen3.5-4B-Pingala8-2bit</a> (text only)</li>
|
| 46 |
<li><a href="https://huggingface.co/datasets/Genrius-AI/pingala8-benchmarks" target="_blank" rel="noopener noreferrer">Benchmark tables</a></li>
|
| 47 |
</ul>
|
| 48 |
</main>
|