Ctrl+K

1 contributor

History: 2 commits

Delta-Vector

add phase-2 ultra-conservative sweep (J,K,L,M) + waiter that auto-launches after phase 1 from the best ckpt

729546e verified about 1 month ago

A_resume_lr1e7_cos.toml

1.28 kB
add 9-config hparam sweep + new_layer_lr_mul param-groups support about 1 month ago
B_resume_lr5e8_cos.toml

1.22 kB
add 9-config hparam sweep + new_layer_lr_mul param-groups support about 1 month ago
C_resume_lr2e8_cos.toml

1.22 kB
add 9-config hparam sweep + new_layer_lr_mul param-groups support about 1 month ago
D_resume_lr1e7_const.toml

1.23 kB
add 9-config hparam sweep + new_layer_lr_mul param-groups support about 1 month ago
E_resume_lr5e8_b95.toml

1.26 kB
add 9-config hparam sweep + new_layer_lr_mul param-groups support about 1 month ago
F_cold_lr1e7_grow40.toml

1.21 kB
add 9-config hparam sweep + new_layer_lr_mul param-groups support about 1 month ago
G_cold_lr2e7_grow40.toml

1.21 kB
add 9-config hparam sweep + new_layer_lr_mul param-groups support about 1 month ago
H_cold_lr1e7_32L.toml

1.26 kB
add 9-config hparam sweep + new_layer_lr_mul param-groups support about 1 month ago
I_cold_paramgroups_grow40.toml

1.3 kB
add 9-config hparam sweep + new_layer_lr_mul param-groups support about 1 month ago
J_phase2_lr5e9_const.toml

1.27 kB
add phase-2 ultra-conservative sweep (J,K,L,M) + waiter that auto-launches after phase 1 from the best ckpt about 1 month ago
K_phase2_lr2e8_const.toml

1.2 kB
add phase-2 ultra-conservative sweep (J,K,L,M) + waiter that auto-launches after phase 1 from the best ckpt about 1 month ago
L_phase2_lr1e8_warmup500.toml

1.22 kB
add phase-2 ultra-conservative sweep (J,K,L,M) + waiter that auto-launches after phase 1 from the best ckpt about 1 month ago
M_phase2_lr2e8_largebatch.toml

1.31 kB
add phase-2 ultra-conservative sweep (J,K,L,M) + waiter that auto-launches after phase 1 from the best ckpt about 1 month ago