temp / outputs /runtime_config.json
PriyaMishra's picture
Copy model from AjayRangoji/temp
f5d6a7c verified
Raw History Blame Contribute Delete
294 Bytes
{
"world_size": 1,
"effective_batch_size": 32,
"train_examples": 23122,
"validation_examples": 2892,
"packing": false,
"sampling": "group_by_length",
"average_tokens_across_devices": true,
"pad_to_multiple_of": 8,
"content_max_length": 1730,
"fused_convolution_layers": 48
}