tobdeu's picture
checkpoint 015000
ad94dbf verified
Raw History Blame Contribute Delete
226 Bytes
{
"step": 15000,
"dp_world_size": 1,
"batch_size": 16,
"grad_accum_steps": 1,
"parallelism": {
"dp_replicate": 1,
"dp_shard": 1,
"ring_degree": 1,
"ulysses_degree": 1
}
}