[Texts] 10,941,572 samples

[Checkpoint] 10,941,572 samples | 10.94%

Clear: tokenizer_config.json

Clear: tokenizer.json

Clear: ckpt_latest/texts.jsonl.gz

Clear: ckpt_latest/meta.json

Clear: README.md

Clear: .gitattributes

[Texts] 63,105,152 samples

[Checkpoint] 63,105,152 samples | 63.11%

[Texts] 53,005,329 samples

[Checkpoint] 53,005,329 samples | 53.01%

[Texts] 42,828,986 samples

[Checkpoint] 42,828,986 samples | 42.83%

[Texts] 32,013,617 samples

[Checkpoint] 32,013,617 samples | 32.01%

[Texts] 20,943,132 samples

[Checkpoint] 20,943,132 samples | 20.94%

[Texts] 10,941,572 samples

[Checkpoint] 10,941,572 samples | 10.94%

Upload tokenizer

initial commit