Buckets:

HCAI-Lab/tom-n10b-artifacts / n10b /scores_backup.log
glennmatlin's picture
download
raw
2.16 kB
[17:14:42] local size before:
54G /home/hice1/gmatlin3/scratch/n10b/scores
[17:14:49] creating bucket HCAI-Lab/trackstar-scores-base-tom-n10b (ok if exists)
Bucket created: https://huggingface.co/buckets/HCAI-Lab/trackstar-scores-base-tom-n10b (handle: hf://buckets/HCAI-Lab/trackstar-scores-base-tom-n10b)
[17:14:50] syncing /home/hice1/gmatlin3/scratch/n10b/scores -> hf://buckets/HCAI-Lab/trackstar-scores-base-tom-n10b
...bbh_snarks/shard_0300.npy: 100%|██████████| 12.8MB / 12.8MB  ...ssing Files (12660 / 12660): 100%|██████████| 57.6GB / 57.6GB, 0.00B/s
New Data Upload : 100%|██████████| 51.3GB / 51.3GB, 0.00B/s
...s/shard_0296_doc_ids.json: 100%|██████████| 348kB / 348kB
...bbh_snarks/shard_0295.npy: 100%|██████████| 12.8MB / 12.8MB
...s/shard_0297_doc_ids.json: 100%|██████████| 348kB / 348kB
...bbh_snarks/shard_0296.npy: 100%|██████████| 12.8MB / 12.8MB
...s/shard_0298_doc_ids.json: 100%|██████████| 348kB / 348kB
...bbh_snarks/shard_0298.npy: 100%|██████████| 12.8MB / 12.8MB
...bbh_snarks/shard_0299.npy: 100%|██████████| 12.8MB / 12.8MB
...s/shard_0299_doc_ids.json: 100%|██████████| 348kB / 348kB
...s/shard_0300_doc_ids.json: 100%|██████████| 348kB / 348kB
...bbh_snarks/shard_0300.npy: 100%|██████████| 12.8MB / 12.8MB
Sync completed.
[17:26:01] sync exit code: 0
[17:26:01] verify: remote file count + size
{
"id": "HCAI-Lab/trackstar-scores-base-tom-n10b",
"private": false,
"created_at": "2026-05-25T21:14:50+00:00",
"size": 55104952718,
"total_files": 12600
}
[17:26:04] local .npy=6320 remote .npy=6320
[17:26:04] VERIFIED (6320 >= 6320). Deleting local scores.
[17:26:07] DELETED. scratch now:
167G / 300G
BACKUP_AND_DELETE_OK

Xet Storage Details

Size:
2.16 kB
·
Xet hash:
a0e17a0e9028f01650e7d03d5c3dced75b1ed51c3ba96942d44fe9335deddbec

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.