dignity045
/

grandline

dataset-preprocessing

llm-pretraining

Model card Files Files and versions

grandline / state

245 Bytes

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

dignity045's picture

Initial GrandLine implementation: deterministic shard-first dataset preprocessing for LLM pretraining

ed59144 verified 1 day ago

.gitkeep

245 Bytes
Initial GrandLine implementation: deterministic shard-first dataset preprocessing for LLM pretraining 1 day ago