AmareshHebbar/Stretch32K_Data_TinyLlama_1.1B
Viewer • Updated • 1.23k • 80
TinyLlama 1.1B stretched from 2k to long context on one GPU. PI, NTK, YaRN, LongLoRA and SFT on one table.
Note Training data shared by every model in this collection
Note Stretch32K PI
Note Stretch32K YARN
Note Stretch32K YARN_LONGLORA
Note Stretch32K SFT