Hugging Face's logo

hoangp111
/
dlm

Safetensors
Model card Files
xet
 Community
1

Delete arm/60.0flop/arm-1233M-60.0flop/iter-032000-ckpt.pth with huggingface_hub

#1
by ngqtrung - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+0
-543
This view is limited to 50 files because it contains too many changes. See the raw diff here.
Files changed (50) hide show
  1. README.md +0 -53
  2. arm/113M-100f/model.safetensors +0 -3
  3. arm/113M-100f/run.json +0 -7
  4. arm/113M-10f/model.safetensors +0 -3
  5. arm/113M-10f/run.json +0 -7
  6. arm/113M-30f/model.safetensors +0 -3
  7. arm/113M-30f/run.json +0 -7
  8. arm/113M-60f/model.safetensors +0 -3
  9. arm/113M-60f/run.json +0 -7
  10. arm/113M-6f/model.safetensors +0 -3
  11. arm/113M-6f/run.json +0 -7
  12. arm/1233M-100f/model.safetensors +0 -3
  13. arm/1233M-100f/run.json +0 -7
  14. arm/1233M-10f/model.safetensors +0 -3
  15. arm/1233M-10f/run.json +0 -7
  16. arm/1233M-30f/model.safetensors +0 -3
  17. arm/1233M-30f/run.json +0 -7
  18. arm/1233M-60f/model.safetensors +0 -3
  19. arm/1233M-60f/run.json +0 -7
  20. arm/1233M-6f/model.safetensors +0 -3
  21. arm/1233M-6f/run.json +0 -7
  22. arm/170M-100f/model.safetensors +0 -3
  23. arm/170M-100f/run.json +0 -7
  24. arm/170M-10f/model.safetensors +0 -3
  25. arm/170M-10f/run.json +0 -7
  26. arm/170M-30f/model.safetensors +0 -3
  27. arm/170M-30f/run.json +0 -7
  28. arm/170M-60f/model.safetensors +0 -3
  29. arm/170M-60f/run.json +0 -7
  30. arm/170M-6f/model.safetensors +0 -3
  31. arm/170M-6f/run.json +0 -7
  32. arm/336M-100f/model.safetensors +0 -3
  33. arm/336M-100f/run.json +0 -7
  34. arm/336M-10f/model.safetensors +0 -3
  35. arm/336M-10f/run.json +0 -7
  36. arm/336M-30f/model.safetensors +0 -3
  37. arm/336M-30f/run.json +0 -7
  38. arm/336M-60f/model.safetensors +0 -3
  39. arm/336M-60f/run.json +0 -7
  40. arm/336M-6f/model.safetensors +0 -3
  41. arm/336M-6f/run.json +0 -7
  42. arm/472M-100f/model.safetensors +0 -3
  43. arm/472M-100f/run.json +0 -7
  44. arm/472M-10f/model.safetensors +0 -3
  45. arm/472M-10f/run.json +0 -7
  46. arm/472M-30f/model.safetensors +0 -3
  47. arm/472M-30f/run.json +0 -7
  48. arm/472M-60f/model.safetensors +0 -3
  49. arm/472M-60f/run.json +0 -7
  50. arm/472M-6f/model.safetensors +0 -3
README.md DELETED
@@ -1,53 +0,0 @@
1
- `f` = 1e18 FLOPs.
2
-
3
- | run | step | params | wandb |
4
- |---|---|---|---|
5
- | arm/113M-100f | 104137 | 155,437,824 | [link](https://wandb.ai/marksmans/dlm/runs/05e8f627) |
6
- | arm/113M-10f | 10413 | 155,437,824 | [link](https://wandb.ai/marksmans/dlm/runs/6267ec3a) |
7
- | arm/113M-30f | 31241 | 155,437,824 | [link](https://wandb.ai/marksmans/dlm/runs/2815a9c5) |
8
- | arm/113M-60f | 62482 | 155,437,824 | [link](https://wandb.ai/marksmans/dlm/runs/19004b12) |
9
- | arm/113M-6f | 6248 | 155,437,824 | [link](https://wandb.ai/marksmans/dlm/runs/7e3c6d2b) |
10
- | arm/1233M-100f | 12083 | 1,271,060,224 | [link](https://wandb.ai/marksmans/dlm/runs/4e99db0b) |
11
- | arm/1233M-10f | 1208 | 1,271,060,224 | [link](https://wandb.ai/marksmans/dlm/runs/b2a7f2e4) |
12
- | arm/1233M-30f | 3624 | 1,271,060,224 | [link](https://wandb.ai/marksmans/dlm/runs/317e3d54) |
13
- | arm/1233M-60f | 7249 | 1,271,060,224 | [link](https://wandb.ai/marksmans/dlm/runs/a576010e) |
14
- | arm/1233M-6f | 724 | 1,271,060,224 | [link](https://wandb.ai/marksmans/dlm/runs/81b529e3) |
15
- | arm/170M-100f | 73072 | 208,531,200 | [link](https://wandb.ai/marksmans/dlm/runs/96a4f141) |
16
- | arm/170M-10f | 7307 | 208,531,200 | [link](https://wandb.ai/marksmans/dlm/runs/a681c70c) |
17
- | arm/170M-30f | 21921 | 208,531,200 | [link](https://wandb.ai/marksmans/dlm/runs/733111c7) |
18
- | arm/170M-60f | 43843 | 208,531,200 | [link](https://wandb.ai/marksmans/dlm/runs/546e1184) |
19
- | arm/170M-6f | 4384 | 208,531,200 | [link](https://wandb.ai/marksmans/dlm/runs/2eaee3cb) |
20
- | arm/336M-100f | 40144 | 380,281,856 | [link](https://wandb.ai/marksmans/dlm/runs/19b8f681) |
21
- | arm/336M-10f | 4014 | 380,281,856 | [link](https://wandb.ai/marksmans/dlm/runs/72b6e66a) |
22
- | arm/336M-30f | 12043 | 380,281,856 | [link](https://wandb.ai/marksmans/dlm/runs/4bbbee37) |
23
- | arm/336M-60f | 24086 | 380,281,856 | [link](https://wandb.ai/marksmans/dlm/runs/b825f0c3) |
24
- | arm/336M-6f | 2408 | 380,281,856 | [link](https://wandb.ai/marksmans/dlm/runs/af6cc85a) |
25
- | arm/472M-100f | 29462 | 524,499,200 | [link](https://wandb.ai/marksmans/dlm/runs/4bd0b799) |
26
- | arm/472M-10f | 2946 | 524,499,200 | [link](https://wandb.ai/marksmans/dlm/runs/e444698b) |
27
- | arm/472M-30f | 8838 | 524,499,200 | [link](https://wandb.ai/marksmans/dlm/runs/988cad3a) |
28
- | arm/472M-60f | 17677 | 524,499,200 | [link](https://wandb.ai/marksmans/dlm/runs/6ea8aa24) |
29
- | arm/472M-6f | 1767 | 524,499,200 | [link](https://wandb.ai/marksmans/dlm/runs/e8adf0f3) |
30
- | arm/629M-100f | 22588 | 671,970,560 | [link](https://wandb.ai/marksmans/dlm/runs/812425e3) |
31
- | arm/629M-10f | 2258 | 671,970,560 | [link](https://wandb.ai/marksmans/dlm/runs/61027ca4) |
32
- | arm/629M-30f | 6776 | 671,970,560 | [link](https://wandb.ai/marksmans/dlm/runs/93963428) |
33
- | arm/629M-60f | 13553 | 671,970,560 | [link](https://wandb.ai/marksmans/dlm/runs/178adad8) |
34
- | arm/629M-6f | 1355 | 671,970,560 | [link](https://wandb.ai/marksmans/dlm/runs/7a5b5d2d) |
35
- | arm/66M-10f | 16241 | 102,495,360 | [link](https://wandb.ai/marksmans/dlm/runs/0fd0e998) |
36
- | arm/66M-30f | 48724 | 102,495,360 | [link](https://wandb.ai/marksmans/dlm/runs/080db9bb) |
37
- | arm/66M-60f | 97449 | 102,495,360 | [link](https://wandb.ai/marksmans/dlm/runs/f0c93293) |
38
- | arm/66M-6f | 9744 | 102,495,360 | [link](https://wandb.ai/marksmans/dlm/runs/79ab5ffb) |
39
- | arm/944M-100f | 15467 | 983,314,944 | [link](https://wandb.ai/marksmans/dlm/runs/8a660db5) |
40
- | arm/944M-10f | 1546 | 983,314,944 | [link](https://wandb.ai/marksmans/dlm/runs/59ad9a8e) |
41
- | arm/944M-30f | 4640 | 983,314,944 | [link](https://wandb.ai/marksmans/dlm/runs/c2b04352) |
42
- | arm/944M-60f | 9280 | 983,314,944 | [link](https://wandb.ai/marksmans/dlm/runs/db7d6e67) |
43
- | arm/944M-6f | 928 | 983,314,944 | [link](https://wandb.ai/marksmans/dlm/runs/abd2629e) |
44
- | e2d2-w32/113M-100f | 93162 | 171,371,520 | [link](https://wandb.ai/marksmans/dlm/runs/11815232) |
45
- | e2d2-w32/170M-100f | 65485 | 233,316,096 | [link](https://wandb.ai/marksmans/dlm/runs/01826f73) |
46
- | e2d2-w32/336M-100f | 35628 | 427,485,184 | [link](https://wandb.ai/marksmans/dlm/runs/ffae6288) |
47
- | e2d2-w32/66M-60f | 88391 | 112,332,160 | [link](https://wandb.ai/marksmans/dlm/runs/054ceaa1) |
48
- | e2d2-w4/113M-100f | 95282 | 169,601,280 | [link](https://wandb.ai/marksmans/dlm/runs/cfad7e10) |
49
- | e2d2-w4/170M-100f | 66561 | 229,775,616 | [link](https://wandb.ai/marksmans/dlm/runs/c88f2d5a) |
50
- | e2d2-w4/336M-100f | 36185 | 421,191,680 | [link](https://wandb.ai/marksmans/dlm/runs/01fe245f) |
51
- | e2d2-w4/66M-60f | 90605 | 109,873,280 | [link](https://wandb.ai/marksmans/dlm/runs/0aabab12) |
52
- | maskarm/113M-100f | 104137 | 155,437,824 | [link](https://wandb.ai/marksmans/dlm/runs/dcbba724) |
53
- | maskarm/66M-60f | 97449 | 102,495,360 | [link](https://wandb.ai/marksmans/dlm/runs/f73b8bfe) |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
arm/113M-100f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:73337fbffe39b215afdb26bba77e52425464cb3fdd5138f036ad5beee2163ed9
3
- size 310884952
 
 
 
 
arm/113M-100f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/113M-100f",
3
- "run_dir": "arm-113M-100.0flop-SSSL-qknorm-noaffine-gqa6-n4096-docmask",
4
- "step": 104137,
5
- "params": 155437824,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/05e8f627"
7
- }
 
 
 
 
 
 
 
 
arm/113M-10f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:78d9d005a29302e352427d73ad55b0003908f41984c8bf2e47eb51a1fe64fe62
3
- size 310884952
 
 
 
 
arm/113M-10f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/113M-10f",
3
- "run_dir": "arm-113M-10.0flop-SSSL-qknorm-noaffine-gqa6-n4096-docmask",
4
- "step": 10413,
5
- "params": 155437824,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/6267ec3a"
7
- }
 
 
 
 
 
 
 
 
arm/113M-30f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:19187c564ac0b927f14167fe49094559cf9b34969242fab4acfd11f2520fe061
3
- size 310884952
 
 
 
 
arm/113M-30f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/113M-30f",
3
- "run_dir": "arm-113M-30.0flop-SSSL-qknorm-noaffine-gqa6-n4096-docmask",
4
- "step": 31241,
5
- "params": 155437824,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/2815a9c5"
7
- }
 
 
 
 
 
 
 
 
arm/113M-60f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:8f29ae614b33723e3734add525662452155a70b04ed5fb16a55b69de69fa27e1
3
- size 310884952
 
 
 
 
arm/113M-60f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/113M-60f",
3
- "run_dir": "arm-113M-60.0flop-SSSL-qknorm-noaffine-gqa6-n4096-docmask",
4
- "step": 62482,
5
- "params": 155437824,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/19004b12"
7
- }
 
 
 
 
 
 
 
 
arm/113M-6f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:2eefa2828d54afa5183452bd24035903771ae4a3bf843fc2dcb482f239bfb326
3
- size 310884952
 
 
 
 
arm/113M-6f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/113M-6f",
3
- "run_dir": "arm-113M-6.0flop-SSSL-qknorm-noaffine-gqa6-n4096-docmask",
4
- "step": 6248,
5
- "params": 155437824,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/7e3c6d2b"
7
- }
 
 
 
 
 
 
 
 
arm/1233M-100f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:577dde70afa34c317489f1e2f41936bef13c3d2d10e19405cfed00d76a2da312
3
- size 2542139296
 
 
 
 
arm/1233M-100f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/1233M-100f",
3
- "run_dir": "arm-1233M-100.0flop-SSSL-qknorm-noaffine-gqa7-n4096-docmask",
4
- "step": 12083,
5
- "params": 1271060224,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/4e99db0b"
7
- }
 
 
 
 
 
 
 
 
arm/1233M-10f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:486d061a4360c87e02992b0baecf57ab10e59d13a055190b9b81e88a0a23533c
3
- size 2542139296
 
 
 
 
arm/1233M-10f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/1233M-10f",
3
- "run_dir": "arm-1233M-10.0flop-SSSL-qknorm-noaffine-gqa7-n4096-docmask",
4
- "step": 1208,
5
- "params": 1271060224,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/b2a7f2e4"
7
- }
 
 
 
 
 
 
 
 
arm/1233M-30f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:1a8c2532cfb5bfc5e5e4fa1b20ae883afd62b333529294cd4d3e53692485fb0e
3
- size 2542139296
 
 
 
 
arm/1233M-30f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/1233M-30f",
3
- "run_dir": "arm-1233M-30.0flop-SSSL-qknorm-noaffine-gqa7-n4096-docmask",
4
- "step": 3624,
5
- "params": 1271060224,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/317e3d54"
7
- }
 
 
 
 
 
 
 
 
arm/1233M-60f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:b6717b12ad2d076e8d5233fdee82aa367774ca05ce090d96be5fd718d68787e5
3
- size 2542139296
 
 
 
 
arm/1233M-60f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/1233M-60f",
3
- "run_dir": "arm-1233M-60.0flop-SSSL-qknorm-noaffine-gqa7-n4096-docmask",
4
- "step": 7249,
5
- "params": 1271060224,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/a576010e"
7
- }
 
 
 
 
 
 
 
 
arm/1233M-6f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:6dccbb397510169af60c515fe82981a17b4258d375a97a3b213e4ceabbe4e9af
3
- size 2542139296
 
 
 
 
arm/1233M-6f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/1233M-6f",
3
- "run_dir": "arm-1233M-6.0flop-SSSL-qknorm-noaffine-gqa7-n4096-docmask",
4
- "step": 724,
5
- "params": 1271060224,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/81b529e3"
7
- }
 
 
 
 
 
 
 
 
arm/170M-100f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:3bd001281be0281d91b6ea20336466c94e26b2428a92f90b263837cc2eeb9957
3
- size 417076256
 
 
 
 
arm/170M-100f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/170M-100f",
3
- "run_dir": "arm-170M-100.0flop-SSSL-qknorm-noaffine-gqa6-n4096-docmask",
4
- "step": 73072,
5
- "params": 208531200,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/96a4f141"
7
- }
 
 
 
 
 
 
 
 
arm/170M-10f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:25518d443375c92a58a3512dc2f6285bda70ca0dd87a446d171ed7f3d655b2d7
3
- size 417076256
 
 
 
 
arm/170M-10f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/170M-10f",
3
- "run_dir": "arm-170M-10.0flop-SSSL-qknorm-noaffine-gqa6-n4096-docmask",
4
- "step": 7307,
5
- "params": 208531200,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/a681c70c"
7
- }
 
 
 
 
 
 
 
 
arm/170M-30f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:b5a49915a2cc24442a0ff54bd26c028d38ae750d7949b8c2cf4cc5b058e78bf4
3
- size 417076256
 
 
 
 
arm/170M-30f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/170M-30f",
3
- "run_dir": "arm-170M-30.0flop-SSSL-qknorm-noaffine-gqa6-n4096-docmask",
4
- "step": 21921,
5
- "params": 208531200,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/733111c7"
7
- }
 
 
 
 
 
 
 
 
arm/170M-60f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:89ccda08cba92cc7bdaa7907439a2d54d9754dfeb9833b6fee4773db409f0a6f
3
- size 417076256
 
 
 
 
arm/170M-60f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/170M-60f",
3
- "run_dir": "arm-170M-60.0flop-SSSL-qknorm-noaffine-gqa6-n4096-docmask",
4
- "step": 43843,
5
- "params": 208531200,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/546e1184"
7
- }
 
 
 
 
 
 
 
 
arm/170M-6f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:901dd06d5c190465f67827efa2f74aff272b0273b1606b1802f66d9635b94ccb
3
- size 417076256
 
 
 
 
arm/170M-6f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/170M-6f",
3
- "run_dir": "arm-170M-6.0flop-SSSL-qknorm-noaffine-gqa6-n4096-docmask",
4
- "step": 4384,
5
- "params": 208531200,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/2eaee3cb"
7
- }
 
 
 
 
 
 
 
 
arm/336M-100f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:9ec7bee77ecf759a2c4e03e8547f50c28cedcf1fa51762efd18e08a16e4e8331
3
- size 760579272
 
 
 
 
arm/336M-100f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/336M-100f",
3
- "run_dir": "arm-336M-100.0flop-SSSL-qknorm-noaffine-gqa8-n4096-docmask",
4
- "step": 40144,
5
- "params": 380281856,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/19b8f681"
7
- }
 
 
 
 
 
 
 
 
arm/336M-10f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:432cb69a3bee1f09733a2e62337c2c6adacc113d796d392ac1821c51b8b5c47c
3
- size 760579272
 
 
 
 
arm/336M-10f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/336M-10f",
3
- "run_dir": "arm-336M-10.0flop-SSSL-qknorm-noaffine-gqa8-n4096-docmask",
4
- "step": 4014,
5
- "params": 380281856,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/72b6e66a"
7
- }
 
 
 
 
 
 
 
 
arm/336M-30f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:cf87d29d60735dc3de165be66eb24a9e14e233ac37edaa061a89b342f559a0a6
3
- size 760579272
 
 
 
 
arm/336M-30f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/336M-30f",
3
- "run_dir": "arm-336M-30.0flop-SSSL-qknorm-noaffine-gqa8-n4096-docmask",
4
- "step": 12043,
5
- "params": 380281856,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/4bbbee37"
7
- }
 
 
 
 
 
 
 
 
arm/336M-60f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:0931e813a7722ce340aa9ccc0998dfac23cbf26c555e597e1adfb368b8b10da5
3
- size 760579272
 
 
 
 
arm/336M-60f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/336M-60f",
3
- "run_dir": "arm-336M-60.0flop-SSSL-qknorm-noaffine-gqa8-n4096-docmask",
4
- "step": 24086,
5
- "params": 380281856,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/b825f0c3"
7
- }
 
 
 
 
 
 
 
 
arm/336M-6f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:153d55f2c545f32f5e35a6b07b17baf70e9cd557e0022364f5fb0ad2b91184d3
3
- size 760579272
 
 
 
 
arm/336M-6f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/336M-6f",
3
- "run_dir": "arm-336M-6.0flop-SSSL-qknorm-noaffine-gqa8-n4096-docmask",
4
- "step": 2408,
5
- "params": 380281856,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/af6cc85a"
7
- }
 
 
 
 
 
 
 
 
arm/472M-100f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:92cc19851c04351f84bc5a13d1032551a18b5f4cd19d5e49245e76e07e81410c
3
- size 1049012432
 
 
 
 
arm/472M-100f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/472M-100f",
3
- "run_dir": "arm-472M-100.0flop-SSSL-qknorm-noaffine-gqa5-n4096-docmask",
4
- "step": 29462,
5
- "params": 524499200,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/4bd0b799"
7
- }
 
 
 
 
 
 
 
 
arm/472M-10f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:13cc602b5126e417efeeaaa6ad6fbbc76b6d1ecacba2d35675127d3e0f0b7cd6
3
- size 1049012432
 
 
 
 
arm/472M-10f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/472M-10f",
3
- "run_dir": "arm-472M-10.0flop-SSSL-qknorm-noaffine-gqa5-n4096-docmask",
4
- "step": 2946,
5
- "params": 524499200,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/e444698b"
7
- }
 
 
 
 
 
 
 
 
arm/472M-30f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:40bd8b709952c9fa27ee896c4e5606b5a8c24c64e273996ef8e5ddcd8c045699
3
- size 1049012432
 
 
 
 
arm/472M-30f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/472M-30f",
3
- "run_dir": "arm-472M-30.0flop-SSSL-qknorm-noaffine-gqa5-n4096-docmask",
4
- "step": 8838,
5
- "params": 524499200,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/988cad3a"
7
- }
 
 
 
 
 
 
 
 
arm/472M-60f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:997398450f6a69c2e4eab78e6b93c9efc3068e15278614bb895ab08e64f696f8
3
- size 1049012432
 
 
 
 
arm/472M-60f/run.json DELETED
@@ -1,7 +0,0 @@
1
- {
2
- "path": "arm/472M-60f",
3
- "run_dir": "arm-472M-60.0flop-SSSL-qknorm-noaffine-gqa5-n4096-docmask",
4
- "step": 17677,
5
- "params": 524499200,
6
- "wandb": "https://wandb.ai/marksmans/dlm/runs/6ea8aa24"
7
- }
 
 
 
 
 
 
 
 
arm/472M-6f/model.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:c6646a7b33c524d2f5a9aaaeae95cade8b296f79419211fe4b6355ccc018e24b
3
- size 1049012432