Buckets:
| [17:14:42] local size before: | |
| 54G /home/hice1/gmatlin3/scratch/n10b/scores | |
| [17:14:49] creating bucket HCAI-Lab/trackstar-scores-base-tom-n10b (ok if exists) | |
| Bucket created: https://huggingface.co/buckets/HCAI-Lab/trackstar-scores-base-tom-n10b (handle: hf://buckets/HCAI-Lab/trackstar-scores-base-tom-n10b) | |
| [17:14:50] syncing /home/hice1/gmatlin3/scratch/n10b/scores -> hf://buckets/HCAI-Lab/trackstar-scores-base-tom-n10b | |
| ...bbh_snarks/shard_0300.npy: 100%|██████████| 12.8MB / 12.8MB [A[A[A[A[A[A[A[A[A[A[A ...ssing Files (12660 / 12660): 100%|██████████| 57.6GB / 57.6GB, 0.00B/s | |
| New Data Upload : 100%|██████████| 51.3GB / 51.3GB, 0.00B/s | |
| ...s/shard_0296_doc_ids.json: 100%|██████████| 348kB / 348kB | |
| ...bbh_snarks/shard_0295.npy: 100%|██████████| 12.8MB / 12.8MB | |
| ...s/shard_0297_doc_ids.json: 100%|██████████| 348kB / 348kB | |
| ...bbh_snarks/shard_0296.npy: 100%|██████████| 12.8MB / 12.8MB | |
| ...s/shard_0298_doc_ids.json: 100%|██████████| 348kB / 348kB | |
| ...bbh_snarks/shard_0298.npy: 100%|██████████| 12.8MB / 12.8MB | |
| ...bbh_snarks/shard_0299.npy: 100%|██████████| 12.8MB / 12.8MB | |
| ...s/shard_0299_doc_ids.json: 100%|██████████| 348kB / 348kB | |
| ...s/shard_0300_doc_ids.json: 100%|██████████| 348kB / 348kB | |
| ...bbh_snarks/shard_0300.npy: 100%|██████████| 12.8MB / 12.8MB | |
| Sync completed. | |
| [17:26:01] sync exit code: 0 | |
| [17:26:01] verify: remote file count + size | |
| { | |
| "id": "HCAI-Lab/trackstar-scores-base-tom-n10b", | |
| "private": false, | |
| "created_at": "2026-05-25T21:14:50+00:00", | |
| "size": 55104952718, | |
| "total_files": 12600 | |
| } | |
| [17:26:04] local .npy=6320 remote .npy=6320 | |
| [17:26:04] VERIFIED (6320 >= 6320). Deleting local scores. | |
| [17:26:07] DELETED. scratch now: | |
| 167G / 300G | |
| BACKUP_AND_DELETE_OK | |
Xet Storage Details
- Size:
- 2.16 kB
- Xet hash:
- a0e17a0e9028f01650e7d03d5c3dced75b1ed51c3ba96942d44fe9335deddbec
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.