`f` = 1e18 FLOPs. | run | step | params | wandb | |---|---|---|---| | arm/113M-100f | 104137 | 155,437,824 | [link](https://wandb.ai/marksmans/dlm/runs/05e8f627) | | arm/113M-10f | 10413 | 155,437,824 | [link](https://wandb.ai/marksmans/dlm/runs/6267ec3a) | | arm/113M-30f | 31241 | 155,437,824 | [link](https://wandb.ai/marksmans/dlm/runs/2815a9c5) | | arm/113M-60f | 62482 | 155,437,824 | [link](https://wandb.ai/marksmans/dlm/runs/19004b12) | | arm/113M-6f | 6248 | 155,437,824 | [link](https://wandb.ai/marksmans/dlm/runs/7e3c6d2b) | | arm/1233M-100f | 12083 | 1,271,060,224 | [link](https://wandb.ai/marksmans/dlm/runs/4e99db0b) | | arm/1233M-10f | 1208 | 1,271,060,224 | [link](https://wandb.ai/marksmans/dlm/runs/b2a7f2e4) | | arm/1233M-30f | 3624 | 1,271,060,224 | [link](https://wandb.ai/marksmans/dlm/runs/317e3d54) | | arm/1233M-60f | 7249 | 1,271,060,224 | [link](https://wandb.ai/marksmans/dlm/runs/a576010e) | | arm/1233M-6f | 724 | 1,271,060,224 | [link](https://wandb.ai/marksmans/dlm/runs/81b529e3) | | arm/170M-100f | 73072 | 208,531,200 | [link](https://wandb.ai/marksmans/dlm/runs/96a4f141) | | arm/170M-10f | 7307 | 208,531,200 | [link](https://wandb.ai/marksmans/dlm/runs/a681c70c) | | arm/170M-30f | 21921 | 208,531,200 | [link](https://wandb.ai/marksmans/dlm/runs/733111c7) | | arm/170M-60f | 43843 | 208,531,200 | [link](https://wandb.ai/marksmans/dlm/runs/546e1184) | | arm/170M-6f | 4384 | 208,531,200 | [link](https://wandb.ai/marksmans/dlm/runs/2eaee3cb) | | arm/336M-100f | 40144 | 380,281,856 | [link](https://wandb.ai/marksmans/dlm/runs/19b8f681) | | arm/336M-10f | 4014 | 380,281,856 | [link](https://wandb.ai/marksmans/dlm/runs/72b6e66a) | | arm/336M-30f | 12043 | 380,281,856 | [link](https://wandb.ai/marksmans/dlm/runs/4bbbee37) | | arm/336M-60f | 24086 | 380,281,856 | [link](https://wandb.ai/marksmans/dlm/runs/b825f0c3) | | arm/336M-6f | 2408 | 380,281,856 | [link](https://wandb.ai/marksmans/dlm/runs/af6cc85a) | | arm/472M-100f | 29462 | 524,499,200 | [link](https://wandb.ai/marksmans/dlm/runs/4bd0b799) | | arm/472M-10f | 2946 | 524,499,200 | [link](https://wandb.ai/marksmans/dlm/runs/e444698b) | | arm/472M-30f | 8838 | 524,499,200 | [link](https://wandb.ai/marksmans/dlm/runs/988cad3a) | | arm/472M-60f | 17677 | 524,499,200 | [link](https://wandb.ai/marksmans/dlm/runs/6ea8aa24) | | arm/472M-6f | 1767 | 524,499,200 | [link](https://wandb.ai/marksmans/dlm/runs/e8adf0f3) | | arm/629M-100f | 22588 | 671,970,560 | [link](https://wandb.ai/marksmans/dlm/runs/812425e3) | | arm/629M-10f | 2258 | 671,970,560 | [link](https://wandb.ai/marksmans/dlm/runs/61027ca4) | | arm/629M-30f | 6776 | 671,970,560 | [link](https://wandb.ai/marksmans/dlm/runs/93963428) | | arm/629M-60f | 13553 | 671,970,560 | [link](https://wandb.ai/marksmans/dlm/runs/178adad8) | | arm/629M-6f | 1355 | 671,970,560 | [link](https://wandb.ai/marksmans/dlm/runs/7a5b5d2d) | | arm/66M-10f | 16241 | 102,495,360 | [link](https://wandb.ai/marksmans/dlm/runs/0fd0e998) | | arm/66M-30f | 48724 | 102,495,360 | [link](https://wandb.ai/marksmans/dlm/runs/080db9bb) | | arm/66M-60f | 97449 | 102,495,360 | [link](https://wandb.ai/marksmans/dlm/runs/f0c93293) | | arm/66M-6f | 9744 | 102,495,360 | [link](https://wandb.ai/marksmans/dlm/runs/79ab5ffb) | | arm/944M-100f | 15467 | 983,314,944 | [link](https://wandb.ai/marksmans/dlm/runs/8a660db5) | | arm/944M-10f | 1546 | 983,314,944 | [link](https://wandb.ai/marksmans/dlm/runs/59ad9a8e) | | arm/944M-30f | 4640 | 983,314,944 | [link](https://wandb.ai/marksmans/dlm/runs/c2b04352) | | arm/944M-60f | 9280 | 983,314,944 | [link](https://wandb.ai/marksmans/dlm/runs/db7d6e67) | | arm/944M-6f | 928 | 983,314,944 | [link](https://wandb.ai/marksmans/dlm/runs/abd2629e) | | e2d2-w32/113M-100f | 93162 | 171,371,520 | [link](https://wandb.ai/marksmans/dlm/runs/11815232) | | e2d2-w32/170M-100f | 65485 | 233,316,096 | [link](https://wandb.ai/marksmans/dlm/runs/01826f73) | | e2d2-w32/336M-100f | 35628 | 427,485,184 | [link](https://wandb.ai/marksmans/dlm/runs/ffae6288) | | e2d2-w32/472M-100f | 26099 | 593,332,480 | [link](https://wandb.ai/marksmans/dlm/runs/e91a392d) | | e2d2-w32/629M-100f | 19844 | 765,386,240 | [link](https://wandb.ai/marksmans/dlm/runs/80c2d366) | | e2d2-w32/66M-60f | 88391 | 112,332,160 | [link](https://wandb.ai/marksmans/dlm/runs/054ceaa1) | | e2d2-w4/113M-100f | 95282 | 169,601,280 | [link](https://wandb.ai/marksmans/dlm/runs/cfad7e10) | | e2d2-w4/170M-100f | 66561 | 229,775,616 | [link](https://wandb.ai/marksmans/dlm/runs/c88f2d5a) | | e2d2-w4/336M-100f | 36185 | 421,191,680 | [link](https://wandb.ai/marksmans/dlm/runs/01fe245f) | | e2d2-w4/472M-100f | 26556 | 583,499,520 | [link](https://wandb.ai/marksmans/dlm/runs/2dcdde1e) | | e2d2-w4/66M-60f | 90605 | 109,873,280 | [link](https://wandb.ai/marksmans/dlm/runs/0aabab12) | | maskarm/113M-100f | 104137 | 155,437,824 | [link](https://wandb.ai/marksmans/dlm/runs/dcbba724) | | maskarm/170M-100f | 73072 | 208,531,200 | [link](https://wandb.ai/marksmans/dlm/runs/03692e1c) | | maskarm/66M-60f | 97449 | 102,495,360 | [link](https://wandb.ai/marksmans/dlm/runs/f73b8bfe) |