Spaces:
Running
Running
Add the shipped models and their measured numbers
Browse files- index.html +27 -0
index.html
CHANGED
|
@@ -91,6 +91,33 @@ put the achievable number below it. Larger batches raise arithmetic intensity an
|
|
| 91 |
change the picture entirely — this models the single-stream case, which is what
|
| 92 |
most people run locally. Bandwidth figures are vendor peak.
|
| 93 |
</p>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 94 |
<p class="note" style="border:none;padding-top:0">
|
| 95 |
Compressed models: <a href="https://huggingface.co/Exeaon">huggingface.co/Exeaon</a> ·
|
| 96 |
Runtime: <a href="https://github.com/ExeaonLM">github.com/ExeaonLM</a> ·
|
|
|
|
| 91 |
change the picture entirely — this models the single-stream case, which is what
|
| 92 |
most people run locally. Bandwidth figures are vendor peak.
|
| 93 |
</p>
|
| 94 |
+
<h2 style="margin-top:34px">Models built against this limit</h2>
|
| 95 |
+
<p class="note" style="border:none;padding-top:0">
|
| 96 |
+
Bytes are the only lever at batch one, so these are what the lever is worth in
|
| 97 |
+
practice. Accuracy retained is the mean of ARC-Easy, ARC-Challenge, HellaSwag and
|
| 98 |
+
PIQA against the uncompressed model, scored on the same GPU and harness. The
|
| 99 |
+
speech model has no such benchmark, so it is measured by word error rate instead.
|
| 100 |
+
</p>
|
| 101 |
+
|
| 102 |
+
<div class="tblwrap"><table>
|
| 103 |
+
<thead><tr><th>Model</th><th>Base</th><th>Size</th><th>Smaller by</th><th>Accuracy retained</th></tr></thead>
|
| 104 |
+
<tbody>
|
| 105 |
+
<tr><td><a href="https://huggingface.co/Exeaon/Exeaon1-Nunya-14B">Exeaon1-Nunya-14B</a></td><td>Qwen3-14B</td><td>7.38 GB</td><td>3.73x</td><td>100.3%</td></tr>
|
| 106 |
+
<tr><td><a href="https://huggingface.co/Exeaon/Exeaon1-Kese-30B-A3B">Exeaon1-Kese-30B-A3B</a></td><td>Qwen3-30B-A3B</td><td>16.27 GB</td><td>3.50x</td><td>98.1%</td></tr>
|
| 107 |
+
<tr><td><a href="https://huggingface.co/Exeaon/Exeaon1-Nunya-8B">Exeaon1-Nunya-8B</a></td><td>Qwen3-8B</td><td>4.11 GB</td><td>3.80x</td><td>99.6%</td></tr>
|
| 108 |
+
<tr><td><a href="https://huggingface.co/Exeaon/Exeaon1-Dzo-4B">Exeaon1-Dzo-4B</a></td><td>Qwen3-4B</td><td>2.04 GB</td><td>3.67x</td><td>98.1%</td></tr>
|
| 109 |
+
<tr><td><a href="https://huggingface.co/Exeaon/Exeaon1-Dzo-0.6B">Exeaon1-Dzo-0.6B</a></td><td>Qwen3-0.6B</td><td>0.31 GB</td><td>3.50x</td><td>96.3%</td></tr>
|
| 110 |
+
<tr><td><a href="https://huggingface.co/Exeaon/Exeaon1-Voice-0.8B">Exeaon1-Voice-0.8B</a></td><td>Whisper v3-turbo</td><td>0.43 GB</td><td>3.47x</td><td>WER unchanged</td></tr>
|
| 111 |
+
</tbody>
|
| 112 |
+
</table></div>
|
| 113 |
+
|
| 114 |
+
<p class="note">
|
| 115 |
+
<strong>Retention is not a free lunch, and neither is speed.</strong> On a large
|
| 116 |
+
GPU these run slower than dense fp16 — a vendor tensor-core GEMM is heavily
|
| 117 |
+
tuned and there is bandwidth to spare, so trading compute for memory loses. The
|
| 118 |
+
win is on the other side of this page: fitting where the dense model does not.
|
| 119 |
+
</p>
|
| 120 |
+
|
| 121 |
<p class="note" style="border:none;padding-top:0">
|
| 122 |
Compressed models: <a href="https://huggingface.co/Exeaon">huggingface.co/Exeaon</a> ·
|
| 123 |
Runtime: <a href="https://github.com/ExeaonLM">github.com/ExeaonLM</a> ·
|