Update modeling_alinlight.py

Upload checkpoint 2000 (Testing GatedNorm initialization)

Update modeling_alinlight.py

Update modeling_alinlight.py

Update modeling_alinlight.py

Update modeling_alinlight.py

Update configuration_alinlight.py

Update modeling_alinlight.py

Update modeling_alinlight.py

Update modeling_alinlight.py

Update modeling_alinlight.py

FIX ATTENTION

Step 300

Step 300

Step Final_Loss6.35_Tok19.69M

Upload config.json with huggingface_hub

Step 1000

Upload config.json with huggingface_hub

Upload modeling_alinlight.py with huggingface_hub

Upload configuration_alinlight.py with huggingface_hub

Step 500

Finished 2000 Steps

Step 500

Upload README.md with huggingface_hub

Upload tokenizer

initial commit