Atomium90
/

nano4M-architecture-ablations

image-generation

architecture-ablation

Model card Files Files and versions

nano4M-architecture-ablations

Commit History

Create README.md

8ec2012
verified

Atomium90 commited on May 22

Upload configs/variants/swiglu_depth8.yaml

adf28ac
verified

Atomium90 commited on May 22

Upload configs/variants/swiglu_depth16_rope_deepnorm_residual_depth.yaml

ebe2c56
verified

Atomium90 commited on May 22

Upload configs/variants/swiglu_depth16_rope_deepnorm.yaml

8d69114
verified

Atomium90 commited on May 22

Upload configs/variants/swiglu_depth16_residual_depth_deepnorm.yaml

503ec4a
verified

Atomium90 commited on May 22

Upload configs/variants/swiglu_depth16_residual_depth.yaml

d15834d
verified

Atomium90 commited on May 22

Upload configs/variants/swiglu_depth16.yaml

9767257
verified

Atomium90 commited on May 22

Upload configs/variants/swiglu_depth12.yaml

4f260fb
verified

Atomium90 commited on May 22

Upload configs/variants/swiglu.yaml

50d7636
verified

Atomium90 commited on May 22

Upload configs/variants/rope_swiglu_depth16.yaml

f9a6289
verified

Atomium90 commited on May 22

Upload configs/variants/rope_swiglu.yaml

95ac04f
verified

Atomium90 commited on May 22

Upload configs/variants/rope_depth16.yaml

c811bd4
verified

Atomium90 commited on May 22

Upload configs/variants/rope.yaml

3d9ecb8
verified

Atomium90 commited on May 22

Upload configs/variants/residual_rezero.yaml

4a9dd0c
verified

Atomium90 commited on May 22

Upload configs/variants/residual_fixed.yaml

f89fff5
verified

Atomium90 commited on May 22

Upload configs/variants/residual_depth_scaled.yaml

f06a23d
verified

Atomium90 commited on May 22

Upload configs/variants/resi_scaled_depth16.yaml

4bd0924
verified

Atomium90 commited on May 22

Upload configs/variants/resi_scaled_depth12.yaml

59da198
verified

Atomium90 commited on May 22

Upload configs/variants/init_xavier.yaml

04e11e6
verified

Atomium90 commited on May 22

Upload configs/variants/init_he.yaml

7afca1b
verified

Atomium90 commited on May 22

Upload configs/variants/init_deepnorm.yaml

e4e731b
verified

Atomium90 commited on May 22

Upload configs/variants/depth8.yaml

68a237d
verified

Atomium90 commited on May 22

Upload configs/variants/depth4.yaml

903beac
verified

Atomium90 commited on May 22

Upload configs/variants/depth16.yaml

e2e555f
verified

Atomium90 commited on May 22

Upload configs/variants/depth12.yaml

63440c8
verified

Atomium90 commited on May 22

Upload configs/variants/deepnorm_swiglu_depth16.yaml

d23f7f1
verified

Atomium90 commited on May 22

Upload configs/variants/deepnorm_depth16.yaml

7881e9e
verified

Atomium90 commited on May 22

Upload configs/variants/deepnorm_depth12.yaml

e5597db
verified

Atomium90 commited on May 22

Upload configs/variants/alibi_swiglu.yaml

2786b1f
verified

Atomium90 commited on May 22

Upload configs/variants/alibi.yaml

c073f53
verified

Atomium90 commited on May 22

Upload configs/variants/TEMPLATE.yaml

86170ba
verified

Atomium90 commited on May 22

Upload configs/multiclevr_d6-6w512.yaml

61aefd3
verified

Atomium90 commited on May 22

Upload swiglu_v1/checkpoint-30519.safetensors

5edd178
verified

Atomium90 commited on May 22

Upload swiglu_v1/checkpoint-final.safetensors

c69c8f8
verified

Atomium90 commited on May 22

Upload swiglu_depth8/checkpoint-22889.safetensors

5ae6939
verified

Atomium90 commited on May 22

Upload swiglu_depth8/checkpoint-final.safetensors

62971b2
verified

Atomium90 commited on May 22

Upload swiglu_depth16_rope_deepnorm_residual_depth/checkpoint-15259.safetensors

243e3bb
verified

Atomium90 commited on May 22

Upload swiglu_depth16_rope_deepnorm_residual_depth/checkpoint-final.safetensors

ad5357d
verified

Atomium90 commited on May 22

Upload swiglu_depth16_rope_deepnorm/checkpoint-15259.safetensors

663105d
verified

Atomium90 commited on May 22

Upload swiglu_depth16_rope_deepnorm/checkpoint-final.safetensors

fd33846
verified

Atomium90 commited on May 22

Upload swiglu_depth16_residual_depth_deepnorm/checkpoint-15259.safetensors

c579b5e
verified

Atomium90 commited on May 22

Upload swiglu_depth16_residual_depth_deepnorm/checkpoint-final.safetensors

b75955a
verified

Atomium90 commited on May 22

Upload swiglu_depth16_residual_depth/checkpoint-15259.safetensors

20b5f7c
verified

Atomium90 commited on May 22

Upload swiglu_depth16_residual_depth/checkpoint-final.safetensors

9892302
verified

Atomium90 commited on May 22

Upload swiglu_depth16/checkpoint-15259.safetensors

94a6dcd
verified

Atomium90 commited on May 22

Upload swiglu_depth16/checkpoint-final.safetensors

d20d50a
verified

Atomium90 commited on May 22

Upload swiglu_depth12/checkpoint-22889.safetensors

aee12e4
verified

Atomium90 commited on May 22

Upload swiglu_depth12/checkpoint-final.safetensors

d56aaa8
verified

Atomium90 commited on May 22

Upload rope_v1/checkpoint-final.safetensors

ae4bef0
verified

Atomium90 commited on May 22

Upload rope_swiglu_v1/checkpoint-30519.safetensors

8635ce6
verified

Atomium90 commited on May 22