Add files using upload-large-folder tool
Browse files
README.md
CHANGED
|
@@ -47,8 +47,8 @@ Our framework for calculating LLM density involves a two-step estimation process
|
|
| 47 |
By combining these, we can determine the effective compute, and therefore the effective parameter size, for any model based on its performance.
|
| 48 |
|
| 49 |
<div align="center">
|
| 50 |
-
<img src="assets/
|
| 51 |
-
<p><b>Figure 2:</b
|
| 52 |
</div>
|
| 53 |
|
| 54 |
## 📜 License
|
|
|
|
| 47 |
By combining these, we can determine the effective compute, and therefore the effective parameter size, for any model based on its performance.
|
| 48 |
|
| 49 |
<div align="center">
|
| 50 |
+
<img src="assets/fig.jpeg" width="800"/>
|
| 51 |
+
<p><b>Figure 2:</b> Results for the (a) loss estimation and (b) performance estimation processes. The purple line represents our fitted scaling law, derived from the reference models (colored dots).</p>
|
| 52 |
</div>
|
| 53 |
|
| 54 |
## 📜 License
|