gpt2_dense_50M_same_total_param / configuration_gpt2.py

Commit History

Initial commit of GPT-2 46M SwiGLU Dense baseline model architecture and configs
83e4eda
verified

Soham Jain commited on

Initial commit of GPT-2 46M SwiGLU Dense baseline model architecture and configs
2e08129
verified

Soham Jain commited on

Initial commit of GPT-2 46M SwiGLU Dense baseline model architecture and configs
c9c18cd
verified

Soham Jain commited on

Initial commit of GPT-2 46M SwiGLU Dense baseline model architecture and configs
1beab5d
verified

Soham Jain commited on

Initial commit of GPT-2 46M SwiGLU Dense baseline model architecture and configs
fa2fdd8
verified

Soham Jain commited on