xiulinyang/gpt2_small_baby_100M_32768_42
Updated • 75
PoSH-Bench
This collection contains the models I trained for the PoSH-Bench paper
-
-
xiulinyang/gpt2_small_wiki_100M_32768_42
Updated • 49 -
xiulinyang/gpt2_small_wiki_100M_32768_53
Updated • 48 -
xiulinyang/gpt2_small_baby_100M_32768_76
Updated • 43 -
xiulinyang/gpt2_mini_baby_100M_32768_42
Updated • 3 -
xiulinyang/gpt2_small_baby_100M_32768_42_c
Updated • 3 -
xiulinyang/gpt2_small_baby_50M_32768_42
Updated • 41 -
xiulinyang/gpt2_small_wiki_50M_32768_42
Updated • 34 -
xiulinyang/gpt2_small_baby_30Mf_32768_42
Updated • 49 -
xiulinyang/gpt2_xxs_baby_10Mf_32768_42_300k
Updated • 3 -
xiulinyang/gpt2_small_baby_30M_32768_42
Updated • 57 -
xiulinyang/pretraining-10Mf-10k-42
Text Generation • 0.2B • Updated • 6 -
xiulinyang/gpt2_small_baby_50Mf_32768_42
Updated • 42 -
xiulinyang/gpt2_mini_baby_10Mf_32768_42
Updated • 50 -
xiulinyang/gpt2_small_baby_100M_32768_53
Updated • 48 -
xiulinyang/pre-pretraining-10Mf-10k-42
Text Generation • 0.2B • Updated • 4 -
xiulinyang/gpt2_small_wiki_100M_32768_76
Updated • 49 -
xiulinyang/gpt2_small_baby_50M_32768_42f
Updated • 2 -
xiulinyang/gpt2_small_wiki_50M_32768_76
Updated • 34 -
xiulinyang/gpt2_small_baby_30Mf_32768_76
Updated • 43 -
xiulinyang/gpt2_mini_baby-dyck_10Mf_32768_53
Updated • 6 -
xiulinyang/gpt2_small_wiki_30M_32768_42
Updated • 36 -
xiulinyang/gpt2_mini_baby-dyck_10Mf_32768_76
Updated • 6 -
xiulinyang/gpt2_mini_baby-dyck_10Mf_32768_42
Updated • 4 -
xiulinyang/gpt2_mini_baby_10M_32768_42
Updated • 71 -
xiulinyang/gpt2_small_baby_30M_32768_42f
Updated • 3 -
xiulinyang/gpt2_xs_baby_30M_32768_42
Updated • 2 -
xiulinyang/gpt2_xs_baby_50M_32768_42
Updated • 2 -
xiulinyang/pretraining-10Mf-gpt2-small-42
Text Generation • 29.6M • Updated • 7 -
xiulinyang/gpt2_mini_baby_10M_32768_53
Updated • 37 -
xiulinyang/gpt2_small_wiki_50M_32768_53
Updated • 32 -
xiulinyang/gpt2_tiny_baby_50M_32768_42
Updated • 2 -
xiulinyang/gpt2_mini_wiki_10M_32768_42
Updated • 30 -
xiulinyang/gpt2_small_baby_10M_32768_42
Updated • 4 -
xiulinyang/gpt2_mini_wiki_10M_32768_76
Updated • 22 -
xiulinyang/pretraining-gpt2-mini-10Mf
Text Generation • 29.6M • Updated • 9 -
xiulinyang/gpt2_mini_baby_10Mf_32768_53
Updated • 44 -
xiulinyang/gpt2_mini_wiki_10M_32768_53
Updated • 24 -
xiulinyang/gpt2_small_baby_10M_32768_42f
Updated • 3 -
xiulinyang/gpt2_mini_baby_10Mf_32768_76
Updated • 45 -
xiulinyang/pre-pretraining-10Mf-10k
Text Generation • 0.2B • Updated • 5 -
xiulinyang/gpt2_small_baby_30Mf_32768_53
Updated • 41 -
xiulinyang/gpt2_small_baby_30M_32768_53
Updated • 46 -
xiulinyang/pretraining-10Mf-10k-53
Text Generation • 0.2B • Updated • 10