canbingol/exp1_flash_attn_1epoch_lr1e4_500k_vngr_corpus
Updated
•
25
Pretrain experiments
This collection created for storing my pretrain expriments
-
-
canbingol/exp2_sdpa_1epoch_lr1e4_500k_vngr_corpus
Updated • 20 -
canbingol/exp3_eager_1epoch_lr1e4_500k_vngr_corpus
Updated • 24 -
canbingol/exp4_flash_attn_1epoch_lr1e4_200k_vngr_corpus
Updated • 19 -
canbingol/exp5_sdpa_1epoch_lr1e4_200k_vngr_corpus
Updated • 23 -
canbingol/exp6_flash_attn_1epoch_lr1e4_500k_vngr_corpus_10layers
Updated • 10