Soham Jain

anonym5035 's models 38

Sort:  Recently updated

anonym5035/sink_finetuning

Updated Aug 27

anonym5035/sink_attn_swi_glu_64_16_4_8

Updated Aug 27 • 7

anonym5035/finetuning_original_model

Updated Aug 26

anonym5035/gpt2_finetune_results

Updated Aug 26

anonym5035/neurips_trail_1_8experts

Updated Aug 24

anonym5035/swi_glu_sw_64_16_8_4_xpert_gpt

Text Generation • 56.9M • Updated Aug 24 • 23

anonym5035/converted_gpt_2

Text Generation • Updated Jul 21 • 1

anonym5035/gpt_2_124M

Updated Jul 19

anonym5035/gpt-2_baseline_98M

Updated Jul 19

anonym5035/active_param_gpt2_31M

Updated Jul 19

anonym5035/gpt2_dense_50M_same_total_param

54.5M • Updated Jul 18 • 7

anonym5035/ablation_5_no_experts

Text Generation • Updated Jul 18

anonym5035/ablation_6_no_global_attn

Text Generation • Updated Jul 18

anonym5035/temp

Text Generation • Updated Jul 18

anonym5035/Xpert-GPT-50M-final

Text Generation • Updated Jul 18

anonym5035/correct_small_sw_64_16_8_4_norm_residuls_xpert_strcit_small

Text Generation • 56.8M • Updated Jul 18 • 10

anonym5035/router_rope_16_16_4_4_ln_swiglu_residuls_xpert_strcit_small

Text Generation • 56.9M • Updated Jul 17 • 10

anonym5035/router_rope_64_16_8_4_ln_residuls_xpert_strcit_small

Text Generation • 56.8M • Updated Jul 17 • 11

anonym5035/router_rope_64_16_8_4_ln_swiglu_residuls_xpert_strcit_small

Text Generation • 56.9M • Updated Jul 17 • 11

anonym5035/correct_small_sw_8_8_4_4_norm_residuls_xpert_strcit_small

Text Generation • 56.8M • Updated Jul 16 • 13

anonym5035/correct_small_sw_16_8_4_2_norm_residuls_xpert_strcit_small

Text Generation • Updated Jul 16

anonym5035/correct_small_sw_16_16_4_4_norm_residuls_xpert_strcit_small

Text Generation • Updated Jul 16

anonym5035/correct_sw_None_128_64_16_norm_residuls_xpert_strcit_small

Text Generation • 56.8M • Updated Jul 16 • 8

anonym5035/correct_ln_residual_xpert_gpt

Text Generation • 56.8M • Updated Jul 16 • 12

anonym5035/XpertGPT-BabyLM2026-Strict

Text Generation • 56.8M • Updated Jul 12 • 16

anonym5035/babylm-strict-project-dummy

Updated Jul 12

anonym5035/XpertGPT-BabyLM2026-Strict-Small

Text Generation • 56.8M • Updated Jul 12 • 18 • 3

anonym5035/babylm-finetune-moe-swa-run

Updated Jul 10 • 1

anonym5035/msit_gptbert_fresh

Updated Jul 9 • 12

anonym5035/moe_decreasedbatchsize_expertpicks

Updated Jul 8 • 8