O2iginal commited on
Commit
09cfed2
·
verified ·
1 Parent(s): 5d791cc

Add files using upload-large-folder tool

Browse files
Files changed (50) hide show
  1. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1040.log +0 -0
  2. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1120.log +0 -0
  3. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1200.log +0 -0
  4. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1280.log +0 -0
  5. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1360.log +0 -0
  6. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1520.log +0 -0
  7. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter160.log +0 -0
  8. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1600.log +0 -0
  9. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1760.log +0 -0
  10. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1840.log +0 -0
  11. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1920.log +0 -0
  12. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter2000.log +0 -0
  13. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter2240.log +0 -0
  14. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter2320.log +0 -0
  15. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter2384.log +0 -0
  16. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter40.log +0 -0
  17. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter400.log +0 -0
  18. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter480.log +0 -0
  19. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter560.log +0 -0
  20. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter640.log +0 -0
  21. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter720.log +0 -0
  22. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter80.log +0 -0
  23. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter880.log +0 -0
  24. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000040.done +0 -0
  25. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000080.done +0 -0
  26. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000160.done +0 -0
  27. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000240.done +0 -0
  28. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000320.done +0 -0
  29. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000400.done +0 -0
  30. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000480.done +0 -0
  31. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000560.done +0 -0
  32. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000640.done +0 -0
  33. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000800.done +0 -0
  34. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000880.done +0 -0
  35. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000960.done +0 -0
  36. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001120.done +0 -0
  37. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001200.done +0 -0
  38. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001280.done +0 -0
  39. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001360.done +0 -0
  40. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001440.done +0 -0
  41. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001520.done +0 -0
  42. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001600.done +0 -0
  43. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001760.done +0 -0
  44. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001840.done +0 -0
  45. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001920.done +0 -0
  46. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0002000.done +0 -0
  47. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0002240.done +0 -0
  48. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0002320.done +0 -0
  49. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0002384.done +0 -0
  50. f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/hf_export_daemon_stage16a.log +132 -0
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1040.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1120.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1200.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1280.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1360.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1520.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter160.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1600.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1760.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1840.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter1920.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter2000.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter2240.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter2320.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter2384.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter40.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter400.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter480.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter560.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter640.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter720.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter80.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/convert_iter880.log ADDED
The diff for this file is too large to render. See raw diff
 
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000040.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000080.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000160.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000240.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000320.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000400.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000480.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000560.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000640.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000800.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000880.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0000960.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001120.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001200.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001280.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001360.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001440.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001520.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001600.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001760.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001840.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0001920.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0002000.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0002240.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0002320.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/done/0002384.done ADDED
File without changes
f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/hf_export_logs/hf_export_daemon_stage16a.log ADDED
@@ -0,0 +1,132 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [2026-10-11 16:57:28] daemon start: ckpt=/mnt/ssd/cpt/moe-cpt-ebcloud/formal3/launcher_logs/f3-plain-shortconv-adamh-from32780-20260915a/stage16a_40B_8node_gdnlralpha_off_20261010a/checkpoints interval=80 s3=s3://yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf
2
+ [2026-10-11 18:52:40] iter 80: preserving ckpt (hardlinks)...
3
+ [2026-10-11 18:52:40] iter 80: converting to HF (CPU)...
4
+ [2026-10-11 19:01:42] iter 80: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000080-hf ...
5
+ [2026-10-11 19:13:40] iter 80: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000080-hf (verified 68231323822 bytes), local cleaned
6
+ [2026-10-11 23:55:12] iter 160: preserving ckpt (hardlinks)...
7
+ [2026-10-11 23:55:12] iter 160: converting to HF (CPU)...
8
+ [2026-10-12 00:04:43] iter 160: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000160-hf ...
9
+ [2026-10-12 00:15:55] iter 160: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000160-hf (verified 68231323822 bytes), local cleaned
10
+ [2026-10-12 04:58:28] iter 240: preserving ckpt (hardlinks)...
11
+ [2026-10-12 04:58:28] iter 240: converting to HF (CPU)...
12
+ [2026-10-12 05:07:52] iter 240: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000240-hf ...
13
+ [2026-10-12 05:18:16] iter 240: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000240-hf (verified 68231323822 bytes), local cleaned
14
+ [2026-10-12 10:01:49] iter 320: preserving ckpt (hardlinks)...
15
+ [2026-10-12 10:01:50] iter 320: converting to HF (CPU)...
16
+ [2026-10-12 10:11:19] iter 320: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000320-hf ...
17
+ [2026-10-12 10:21:39] iter 320: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000320-hf (verified 68231323822 bytes), local cleaned
18
+ [2026-10-12 15:03:12] iter 400: preserving ckpt (hardlinks)...
19
+ [2026-10-12 15:03:12] iter 400: converting to HF (CPU)...
20
+ [2026-10-12 15:12:45] iter 400: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000400-hf ...
21
+ [2026-10-12 15:22:54] iter 400: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000400-hf (verified 68231323822 bytes), local cleaned
22
+ [2026-10-12 20:06:33] iter 480: preserving ckpt (hardlinks)...
23
+ [2026-10-12 20:06:33] iter 480: converting to HF (CPU)...
24
+ [2026-10-12 20:16:02] iter 480: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000480-hf ...
25
+ [2026-10-12 20:26:44] iter 480: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000480-hf (verified 68231323822 bytes), local cleaned
26
+ [2026-10-13 01:09:32] iter 560: preserving ckpt (hardlinks)...
27
+ [2026-10-13 01:09:33] iter 560: converting to HF (CPU)...
28
+ [2026-10-13 01:19:18] iter 560: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000560-hf ...
29
+ [2026-10-13 01:29:53] iter 560: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000560-hf (verified 68231323822 bytes), local cleaned
30
+ [2026-10-13 06:11:27] iter 640: preserving ckpt (hardlinks)...
31
+ [2026-10-13 06:11:28] iter 640: converting to HF (CPU)...
32
+ [2026-10-13 06:21:05] iter 640: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000640-hf ...
33
+ [2026-10-13 06:31:13] iter 640: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000640-hf (verified 68231323822 bytes), local cleaned
34
+ [2026-10-13 11:12:47] iter 720: preserving ckpt (hardlinks)...
35
+ [2026-10-13 11:12:47] iter 720: converting to HF (CPU)...
36
+ [2026-10-13 11:13:57] iter 720: CONVERSION FAILED (rc=1), keeping preserve for debug
37
+ [2026-10-13 11:14:57] iter 720: preserving ckpt (hardlinks)...
38
+ [2026-10-13 11:14:58] iter 720: converting to HF (CPU)...
39
+ [2026-10-13 11:24:11] iter 720: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000720-hf ...
40
+ [2026-10-13 11:35:21] iter 720: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000720-hf (verified 68231323822 bytes), local cleaned
41
+ [2026-10-13 16:14:55] iter 800: preserving ckpt (hardlinks)...
42
+ [2026-10-13 16:14:55] iter 800: converting to HF (CPU)...
43
+ [2026-10-13 16:24:20] iter 800: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000800-hf ...
44
+ [2026-10-13 16:35:06] iter 800: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000800-hf (verified 68231323822 bytes), local cleaned
45
+ [2026-10-13 21:16:40] iter 880: preserving ckpt (hardlinks)...
46
+ [2026-10-13 21:16:40] iter 880: converting to HF (CPU)...
47
+ [2026-10-13 21:27:24] iter 880: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000880-hf ...
48
+ [2026-10-13 21:38:07] iter 880: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000880-hf (verified 68231323822 bytes), local cleaned
49
+ [2026-10-14 02:18:40] iter 960: preserving ckpt (hardlinks)...
50
+ [2026-10-14 02:18:40] iter 960: converting to HF (CPU)...
51
+ [2026-10-14 02:29:47] iter 960: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000960-hf ...
52
+ [2026-10-14 02:39:58] iter 960: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0000960-hf (verified 68231323822 bytes), local cleaned
53
+ [2026-10-14 07:20:31] iter 1040: preserving ckpt (hardlinks)...
54
+ [2026-10-14 07:20:31] iter 1040: converting to HF (CPU)...
55
+ [2026-10-14 07:32:07] iter 1040: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001040-hf ...
56
+ [2026-10-14 07:42:38] iter 1040: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001040-hf (verified 68231323822 bytes), local cleaned
57
+ [2026-10-14 12:23:11] iter 1120: preserving ckpt (hardlinks)...
58
+ [2026-10-14 12:23:11] iter 1120: converting to HF (CPU)...
59
+ [2026-10-14 12:32:40] iter 1120: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001120-hf ...
60
+ [2026-10-14 12:43:23] iter 1120: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001120-hf (verified 68231323822 bytes), local cleaned
61
+ [2026-10-14 17:24:58] iter 1200: preserving ckpt (hardlinks)...
62
+ [2026-10-14 17:24:58] iter 1200: converting to HF (CPU)...
63
+ [2026-10-14 17:34:39] iter 1200: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001200-hf ...
64
+ [2026-10-14 17:45:34] iter 1200: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001200-hf (verified 68231323822 bytes), local cleaned
65
+ [2026-10-14 22:26:08] iter 1280: preserving ckpt (hardlinks)...
66
+ [2026-10-14 22:26:08] iter 1280: converting to HF (CPU)...
67
+ [2026-10-14 22:36:31] iter 1280: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001280-hf ...
68
+ [2026-10-14 22:47:40] iter 1280: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001280-hf (verified 68231323822 bytes), local cleaned
69
+ [2026-10-15 03:28:13] iter 1360: preserving ckpt (hardlinks)...
70
+ [2026-10-15 03:28:13] iter 1360: converting to HF (CPU)...
71
+ [2026-10-15 03:37:27] iter 1360: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001360-hf ...
72
+ [2026-10-15 03:47:53] iter 1360: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001360-hf (verified 68231323822 bytes), local cleaned
73
+ [2026-10-15 08:28:25] iter 1440: preserving ckpt (hardlinks)...
74
+ [2026-10-15 08:28:25] iter 1440: converting to HF (CPU)...
75
+ [2026-10-15 08:37:56] iter 1440: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001440-hf ...
76
+ [2026-10-15 08:48:26] iter 1440: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001440-hf (verified 68231323822 bytes), local cleaned
77
+ [2026-10-15 13:29:59] iter 1520: preserving ckpt (hardlinks)...
78
+ [2026-10-15 13:29:59] iter 1520: converting to HF (CPU)...
79
+ [2026-10-15 13:39:05] iter 1520: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001520-hf ...
80
+ [2026-10-15 13:49:32] iter 1520: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001520-hf (verified 68231323822 bytes), local cleaned
81
+ [2026-10-15 18:32:07] iter 1600: preserving ckpt (hardlinks)...
82
+ [2026-10-15 18:32:07] iter 1600: converting to HF (CPU)...
83
+ [2026-10-15 18:41:25] iter 1600: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001600-hf ...
84
+ [2026-10-15 18:51:35] iter 1600: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001600-hf (verified 68231323822 bytes), local cleaned
85
+ [2026-10-15 23:33:08] iter 1680: preserving ckpt (hardlinks)...
86
+ [2026-10-15 23:33:08] iter 1680: converting to HF (CPU)...
87
+ [2026-10-15 23:42:41] iter 1680: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001680-hf ...
88
+ [2026-10-15 23:53:11] iter 1680: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001680-hf (verified 68231323822 bytes), local cleaned
89
+ [2026-10-16 04:34:44] iter 1760: preserving ckpt (hardlinks)...
90
+ [2026-10-16 04:34:44] iter 1760: converting to HF (CPU)...
91
+ [2026-10-16 04:35:50] iter 1760: CONVERSION FAILED (rc=1), keeping preserve for debug
92
+ [2026-10-16 04:36:51] iter 1760: preserving ckpt (hardlinks)...
93
+ [2026-10-16 04:36:51] iter 1760: converting to HF (CPU)...
94
+ [2026-10-16 04:45:40] iter 1760: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001760-hf ...
95
+ [2026-10-16 04:56:05] iter 1760: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001760-hf (verified 68231323822 bytes), local cleaned
96
+ [2026-10-16 09:36:38] iter 1840: preserving ckpt (hardlinks)...
97
+ [2026-10-16 09:36:38] iter 1840: converting to HF (CPU)...
98
+ [2026-10-16 09:46:09] iter 1840: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001840-hf ...
99
+ [2026-10-16 09:56:44] iter 1840: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001840-hf (verified 68231323822 bytes), local cleaned
100
+ [2026-10-16 14:37:18] iter 1920: preserving ckpt (hardlinks)...
101
+ [2026-10-16 14:37:18] iter 1920: converting to HF (CPU)...
102
+ [2026-10-16 14:46:49] iter 1920: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001920-hf ...
103
+ [2026-10-16 14:57:21] iter 1920: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0001920-hf (verified 68231323822 bytes), local cleaned
104
+ [2026-10-16 19:38:54] iter 2000: preserving ckpt (hardlinks)...
105
+ [2026-10-16 19:38:55] iter 2000: converting to HF (CPU)...
106
+ [2026-10-16 19:48:40] iter 2000: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0002000-hf ...
107
+ [2026-10-16 19:59:01] iter 2000: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0002000-hf (verified 68231323822 bytes), local cleaned
108
+ [2026-10-17 00:39:34] iter 2080: preserving ckpt (hardlinks)...
109
+ [2026-10-17 00:39:34] iter 2080: converting to HF (CPU)...
110
+ [2026-10-17 00:40:41] iter 2080: CONVERSION FAILED (rc=1), keeping preserve for debug
111
+ [2026-10-17 00:41:41] iter 2080: preserving ckpt (hardlinks)...
112
+ [2026-10-17 00:41:41] iter 2080: converting to HF (CPU)...
113
+ [2026-10-17 00:50:55] iter 2080: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0002080-hf ...
114
+ [2026-10-17 01:01:15] iter 2080: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0002080-hf (verified 68231323822 bytes), local cleaned
115
+ [2026-10-17 05:40:48] iter 2160: preserving ckpt (hardlinks)...
116
+ [2026-10-17 05:40:48] iter 2160: converting to HF (CPU)...
117
+ [2026-10-17 05:50:12] iter 2160: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0002160-hf ...
118
+ [2026-10-17 06:00:35] iter 2160: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0002160-hf (verified 68231323822 bytes), local cleaned
119
+ [2026-10-17 10:42:08] iter 2240: preserving ckpt (hardlinks)...
120
+ [2026-10-17 10:42:09] iter 2240: converting to HF (CPU)...
121
+ [2026-10-17 10:51:33] iter 2240: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0002240-hf ...
122
+ [2026-10-17 11:02:02] iter 2240: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0002240-hf (verified 68231323822 bytes), local cleaned
123
+ [2026-10-17 15:42:34] iter 2320: preserving ckpt (hardlinks)...
124
+ [2026-10-17 15:42:34] iter 2320: converting to HF (CPU)...
125
+ [2026-10-17 15:52:11] iter 2320: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0002320-hf ...
126
+ [2026-10-17 16:03:06] iter 2320: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0002320-hf (verified 68231323822 bytes), local cleaned
127
+ [2026-10-17 19:50:33] no training process detected; latest iter=2384
128
+ [2026-10-17 19:50:33] iter 2384: preserving ckpt (hardlinks)...
129
+ [2026-10-17 19:50:33] iter 2384: converting to HF (CPU)...
130
+ [2026-10-17 19:59:32] iter 2384: uploading to s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0002384-hf ...
131
+ [2026-10-17 20:10:34] iter 2384: exported -> s3:yulan/f3-plain-shortconv-adamh-stage16a-cp32-512k-hf/iter_0002384-hf (verified 68231323822 bytes), local cleaned
132
+ [2026-10-17 20:10:34] final iter 2384 exported; daemon exit