Update README.md
Browse files
README.md
CHANGED
|
@@ -25,7 +25,7 @@ license: apache-2.0
|
|
| 25 |
<strong>Instinct-1-1.0B</strong> is a fully reproducible, from-scratch trained 1 Billion parameter language model built under the AutonomousX organization. It is trained on 20B tokens of the PILE dataset utilizing powerful TPU v4 infrastructure.
|
| 26 |
</p>
|
| 27 |
<div class="ix-link-group">
|
| 28 |
-
<a href="
|
| 29 |
<span style="font-family: monospace; font-weight: bold;"></></span> GitHub Repository
|
| 30 |
</a>
|
| 31 |
<a href="https://sites.research.google/trc/about/" class="ix-link" target="_blank">
|
|
@@ -119,7 +119,7 @@ This includes:
|
|
| 119 |
|
| 120 |
You can reproduce the complete training pipeline from scratch.
|
| 121 |
|
| 122 |
-
***🚀Full training pipeline repository*** :- [Github training pipeline](
|
| 123 |
|
| 124 |
***📊TPU Setup Guide*** :- [Youtube](https://youtu.be/FqXr8GTscNk?si=gd5P_BFcwIWmQCEO)
|
| 125 |
|
|
|
|
| 25 |
<strong>Instinct-1-1.0B</strong> is a fully reproducible, from-scratch trained 1 Billion parameter language model built under the AutonomousX organization. It is trained on 20B tokens of the PILE dataset utilizing powerful TPU v4 infrastructure.
|
| 26 |
</p>
|
| 27 |
<div class="ix-link-group">
|
| 28 |
+
<a href="" class="ix-link">
|
| 29 |
<span style="font-family: monospace; font-weight: bold;"></></span> GitHub Repository
|
| 30 |
</a>
|
| 31 |
<a href="https://sites.research.google/trc/about/" class="ix-link" target="_blank">
|
|
|
|
| 119 |
|
| 120 |
You can reproduce the complete training pipeline from scratch.
|
| 121 |
|
| 122 |
+
***🚀Full training pipeline repository*** :- [Github training pipeline]()
|
| 123 |
|
| 124 |
***📊TPU Setup Guide*** :- [Youtube](https://youtu.be/FqXr8GTscNk?si=gd5P_BFcwIWmQCEO)
|
| 125 |
|