Buckets:

glutamatt's picture
download
raw
463 Bytes
{
"custom_metas": null,
"dp": 64,
"metas": {
"consumed_train_samples": 256000,
"data_stages": [
{
"consumed_tokens_per_dataset_folder": {
"/scratch/joel_niklaus/tmp/finephrase/dataset/math_1b_dclm": 1048576000
},
"consumed_train_samples": 256000,
"name": "stable",
"start_training_step": 1
}
],
"last_stage_idx": 0,
"last_train_step": 500
},
"tp": 1,
"version": "1.4"
}

Xet Storage Details

Size:
463 Bytes
·
Xet hash:
4343259b241665cec5e5507efd7e049bc53059cfc04abe46b1016e3ea9e13132

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.