Card header: paper PDF and project page links, no License badge
Browse files
README.md
CHANGED
|
@@ -17,7 +17,7 @@ tags:
|
|
| 17 |
|
| 18 |
# ShellElastic
|
| 19 |
|
| 20 |
-
### Scalable Elastic Pretraining
|
| 21 |
|
| 22 |
**Can Jin**<sup>1*</sup> 路 **Yan Kang**<sup>2</sup> 路 **Yifan Gong**<sup>2</sup> 路 **Chongjian Ge**<sup>2</sup> 路 **Mingze Xu**<sup>2</sup> 路 **Yuanjun Xiong**<sup>2</sup> 路 **Dimitris N. Metaxas**<sup>1</sup> 路 **Hongwu Peng**<sup>2</sup>
|
| 23 |
|
|
@@ -25,12 +25,11 @@ tags:
|
|
| 25 |
|
| 26 |
<sup>*</sup>Corresponding author: [can.jin@rutgers.edu](mailto:can.jin@rutgers.edu). Work done during an internship at Adobe Research.
|
| 27 |
|
| 28 |
-
<a href="https://github.com/jincan333/ShellElastic/
|
| 29 |
-
<a href="
|
| 30 |
<a href="https://github.com/jincan333/ShellElastic"><img alt="Code" src="https://img.shields.io/badge/Code-GitHub-181717?style=for-the-badge&logo=github&logoColor=white"></a>
|
| 31 |
<a href="https://huggingface.co/collections/Can111/shellelastic-checkpoints-and-data-6ac41e3a763d5a3fd0e79111"><img alt="Checkpoints" src="https://img.shields.io/badge/Checkpoints-Hugging%20Face-ffd21e?style=for-the-badge&logo=huggingface&logoColor=white"></a>
|
| 32 |
<a href="https://huggingface.co/collections/Can111/shellelastic-checkpoints-and-data-6ac41e3a763d5a3fd0e79111"><img alt="Datasets" src="https://img.shields.io/badge/Datasets-Hugging%20Face-ffd21e?style=for-the-badge&logo=huggingface&logoColor=white"></a>
|
| 33 |
-
<a href="https://github.com/jincan333/ShellElastic/blob/main/LICENSE"><img alt="License" src="https://img.shields.io/badge/License-Apache--2.0-3da639?style=for-the-badge&logo=apache&logoColor=white"></a>
|
| 34 |
|
| 35 |
</div>
|
| 36 |
|
|
|
|
| 17 |
|
| 18 |
# ShellElastic
|
| 19 |
|
| 20 |
+
### Scalable Elastic Pretraining<br>with Simultaneous Maximal Updates and Hyperparameter Transfer
|
| 21 |
|
| 22 |
**Can Jin**<sup>1*</sup> 路 **Yan Kang**<sup>2</sup> 路 **Yifan Gong**<sup>2</sup> 路 **Chongjian Ge**<sup>2</sup> 路 **Mingze Xu**<sup>2</sup> 路 **Yuanjun Xiong**<sup>2</sup> 路 **Dimitris N. Metaxas**<sup>1</sup> 路 **Hongwu Peng**<sup>2</sup>
|
| 23 |
|
|
|
|
| 25 |
|
| 26 |
<sup>*</sup>Corresponding author: [can.jin@rutgers.edu](mailto:can.jin@rutgers.edu). Work done during an internship at Adobe Research.
|
| 27 |
|
| 28 |
+
<a href="https://github.com/jincan333/ShellElastic/blob/main/paper/ShellElastic.pdf"><img alt="Paper" src="https://img.shields.io/badge/Paper-PDF-b31b1b?style=for-the-badge"></a>
|
| 29 |
+
<a href="https://jincan333.github.io/ShellElastic_page"><img alt="Project Page" src="https://img.shields.io/badge/Project-Page-2f6db5?style=for-the-badge"></a>
|
| 30 |
<a href="https://github.com/jincan333/ShellElastic"><img alt="Code" src="https://img.shields.io/badge/Code-GitHub-181717?style=for-the-badge&logo=github&logoColor=white"></a>
|
| 31 |
<a href="https://huggingface.co/collections/Can111/shellelastic-checkpoints-and-data-6ac41e3a763d5a3fd0e79111"><img alt="Checkpoints" src="https://img.shields.io/badge/Checkpoints-Hugging%20Face-ffd21e?style=for-the-badge&logo=huggingface&logoColor=white"></a>
|
| 32 |
<a href="https://huggingface.co/collections/Can111/shellelastic-checkpoints-and-data-6ac41e3a763d5a3fd0e79111"><img alt="Datasets" src="https://img.shields.io/badge/Datasets-Hugging%20Face-ffd21e?style=for-the-badge&logo=huggingface&logoColor=white"></a>
|
|
|
|
| 33 |
|
| 34 |
</div>
|
| 35 |
|