Any Estimation on When 65B will come?
#10
by DrNicefellow - opened
Looking forward to it.
Hopefully within the next month but it depends on queue times... lots of other groups using the LUMI supercomputer right now as well, and the job time limit is 48 hours. So at most we can only run for 48 hours at a time before sitting in the queue again.
shanearora changed discussion status to closed
@epwalsh BTW, it may be beneficial to the community if you release the intermediate checkpoints before the model is fully trained.
Just pushing this after some time has gone now, is the release of the 65B model still planned?