Spaces:
Running on T4
Running on T4
add Aether family section (7Attn, 11Attn, checkpoints, blog)
Browse files- index.html +12 -0
index.html
CHANGED
|
@@ -112,6 +112,18 @@
|
|
| 112 |
</table>
|
| 113 |
</div>
|
| 114 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 115 |
<div class="card qa">
|
| 116 |
<h2>Answers</h2>
|
| 117 |
<h3>Is Aether open source?</h3>
|
|
|
|
| 112 |
</table>
|
| 113 |
</div>
|
| 114 |
|
| 115 |
+
<div class="card">
|
| 116 |
+
<h2>The Aether family</h2>
|
| 117 |
+
<p class="muted">One architecture line, released at different levels of openness.</p>
|
| 118 |
+
<ul>
|
| 119 |
+
<li><b><a href="https://huggingface.co/FINAL-Bench/Aether-7B-5Attn">Aether-7B-5Attn</a></b> — base, <b>fully open</b>: weights + data recipe + training code + complete logs + intermediate checkpoints.</li>
|
| 120 |
+
<li><b><a href="https://huggingface.co/FINAL-Bench/Aether-7B-5Attn-it">Aether-7B-5Attn-it</a></b> — instruction-tuned. This is the model answering in the demo above.</li>
|
| 121 |
+
<li><b><a href="https://huggingface.co/FINAL-Bench/Aether-7B-7Attn-base">Aether-7B-7Attn-base</a></b> — open weights.</li>
|
| 122 |
+
<li><b><a href="https://huggingface.co/FINAL-Bench/Aether-6B-11Attn">Aether-6B-11Attn</a></b> — open weights. 121 layers place <b>11 heterogeneous sequence-mixing mechanisms</b> — attention, state-space (Mamba2), convolutional (Hyena) and linear families — on an <b>11×11 Latin square</b>.</li>
|
| 123 |
+
<li><a href="https://huggingface.co/datasets/FINAL-Bench/Aether-7B-5Attn-checkpoints">Intermediate checkpoints</a> (110k · 115k · 162k) · <a href="https://huggingface.co/blog/FINAL-Bench/opensource-llm">Blog write-up</a> · <a href="https://huggingface.co/collections/FINAL-Bench/aether-foundation-model">Collection</a></li>
|
| 124 |
+
</ul>
|
| 125 |
+
</div>
|
| 126 |
+
|
| 127 |
<div class="card qa">
|
| 128 |
<h2>Answers</h2>
|
| 129 |
<h3>Is Aether open source?</h3>
|