xiulinyang/dynamtic_attention_10Mf_512
11.8M • Updated • 2
Xiulin Yang
xiulinyang
·
AI & ML interests
Language Modeling, Interpretability, (compositional) generalization, tokenization
Organizations
None yet
xiulinyang/gpt2_xxs_baby_10Mf_32768_42_300k
Updated • 3
xiulinyang/dynamic_attention_10Mf
11.8M • Updated • 4
xiulinyang/gpt2_small_baby_50M_32768_53
Updated • 45
xiulinyang/gpt2_small_baby_50Mf_32768_76
Updated • 38
xiulinyang/gpt2_small_wiki_30M_32768_76
Updated • 33
xiulinyang/gpt2_small_baby_30M_32768_53
Updated • 46
xiulinyang/gpt2_small_baby_30Mf_32768_76
Updated • 43
xiulinyang/gpt2_mini_wiki_10M_32768_76
Updated • 22
xiulinyang/gpt2_small_wiki_50M_32768_53
Updated • 32
xiulinyang/gpt2_mini_baby_10M_32768_53
Updated • 37
xiulinyang/gpt2_mini_baby_10Mf_32768_76
Updated • 45
xiulinyang/gpt2_small_baby_50M_32768_76
Updated • 40
xiulinyang/gpt2_small_baby_50Mf_32768_53
Updated • 37
xiulinyang/gpt2_small_wiki_30M_32768_53
Updated • 32
xiulinyang/gpt2_small_baby_30M_32768_76
Updated • 46
xiulinyang/gpt2_small_baby_30Mf_32768_53
Updated • 41
xiulinyang/gpt2_mini_baby_10M_32768_76
Updated • 37
xiulinyang/gpt2_mini_wiki_10M_32768_53
Updated • 24
xiulinyang/gpt2_mini_baby_10Mf_32768_53
Updated • 44
xiulinyang/gpt2_mini_baby_100M_32768_42
Updated • 3
xiulinyang/gpt2_small_baby_30M_32768_42
Updated • 57
xiulinyang/gpt2_small_baby_100M_32768_42
Updated • 75
xiulinyang/gpt2_small_baby_50M_32768_42
Updated • 41
xiulinyang/gpt2_small_baby_50Mf_32768_42
Updated • 42
xiulinyang/gpt2_small_baby_30Mf_32768_42
Updated • 49
xiulinyang/gpt2_mini_baby_10M_32768_42
Updated • 71
xiulinyang/gpt2_mini_baby_10Mf_32768_42
Updated • 50
xiulinyang/gpt2_small_baby_100M_32768_42_c
Updated • 3
xiulinyang/gpt2_small_wiki_100M_32768_42
Updated • 49