Buckets:
| { | |
| "dataset": "HuggingFaceFW/fineweb", | |
| "configuration": "sample-10BT", | |
| "tokenizer": "GPT-2/tiktoken", | |
| "target_tokens": 3000000, | |
| "train_tokens": 2700000, | |
| "validation_tokens": 300000, | |
| "documents_streamed": 4346, | |
| "split_policy": "first 90% train, final 10% validation after deterministic streaming" | |
| } | |
Xet Storage Details
- Size:
- 313 Bytes
- Xet hash:
- 1ccc5f5f1e8203cd4ae68f19e860a1416571e3e2373bc16147faa62232996ca1
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.