melhoushi/gpt_h640_d13_gbs48_tpp20.0_lp0.2_linear
Updated • 80
Mostafa Elhoushi
melhoushi
AI & ML interests
Make ML faster, smaller, smarter.
Recent Activity
updated a model 7 days ago
melhoushi/qwen2.5_7b_synthetic_duo3_ce1_max_bsz256 published a model 7 days ago
melhoushi/qwen2.5_7b_synthetic_duo3_ce1_max_bsz256 updated a model 13 days ago
melhoushi/jacobiforcing-mixed-bsz4-lr1e-5-step10000Organizations
melhoushi/slimpj_h640_d13_gbs48_tpp20.0_lp0.2_linear
Updated
melhoushi/slimpj_h2048_d40_gbs200_tpp30.0_warmup602_lp0.8_linear_linear_reverse
Updated
melhoushi/slimpj_h2048_d40_gbs200_tpp30.0_lp0.0_uniform
Updated • 1
melhoushi/slimpj_h1536_d30_gbs136_tpp20.0_warmup602_lp0.6_linear_linear_reverse
Updated
melhoushi/slimpj_h1536_d30_gbs136_tpp20.0_lp0.0_uniform
Updated
melhoushi/slimpj_h1152_d23_gbs124_tpp64.0_lp0.4_linear_linear_reverse
Updated
melhoushi/slimpj_h1152_d23_gbs124_tpp64.0_lp0.0_uniform
Updated
melhoushi/slimpj_h896_d17_gbs182_tpp256.0_lp0.2_linear_linear_reverse
Updated
melhoushi/slimpj_h896_d17_gbs182_tpp256.0_lp0.0_uniform
Updated
melhoushi/slimpj_h1152_d23_nh9_dhqk128_dhv128_ffnmult8_gbs76_tpp20.0_29117steps
Updated • 2
melhoushi/slimpj_h640_d13_nh10_dhqk64_dhv64_ffnmult8_gbs48_tpp20.0_13773steps_lp0.4_row_null_linear
Updated • 1
melhoushi/slimpj_h1152_d23_nh9_dhqk128_dhv128_ffnmult8_gbs76_tpp20.0_29117steps_layer_prob0.4
Updated • 1
melhoushi/gpt_h2048_d40_gbs200_tpp30.0_lp0.0_uniform
Updated • 279
melhoushi/gpt_h1536_d30_gbs136_tpp20.0_lp0.0_uniform
Updated • 115
melhoushi/gpt_h1152_d23_gbs124_tpp64.0_lp0.0_uniform
Updated • 77
melhoushi/gpt_h896_d17_gbs182_tpp256.0_lp0.2_linear_linear_reverse
Updated • 72
melhoushi/gpt_h896_d17_gbs182_tpp256.0_lp0.0_uniform
Updated • 80
melhoushi/gpt_h1152_d23_gbs124_tpp64.0_lp0.4_linear_linear_reverse
Updated • 76
melhoushi/nanogpt-2025-12-13-recurrent-small-2-10-pool
Updated
melhoushi/slimpj_h640_d13_nh10_dhqk64_dhv64_ffnmult8_gbs48_tpp20.0_13773steps_dmup1215_depthsupar_pol1_v2
Updated • 1
melhoushi/nanogpt-baseline-steps20000-fixlr
Updated
melhoushi/nanogpt-2025-11-29-oracle-2-10
Updated
melhoushi/nanogpt-recurrent-12-24-steps20000-learned-wronglrdecay
Updated
melhoushi/nanogpt-baseline-steps20000-wronglrdecay2
Updated
melhoushi/nanogpt-baseline-steps20000
Updated
melhoushi/nanogpt-oracle-stopping-tokenwise-fixed-edge-noise-predlude-injection-concat-steps20000-fixlr
Updated
melhoushi/nanogpt-oracle-stopping-tokenwise-fixed-edge-noise-predlude-injection-concat
Updated
melhoushi/nanogpt-2025-11-29-oracle-10-22-wronglr
Updated
melhoushi/nanogpt-2025-11-29-oracle-10-22
Updated