JavRedstone's picture
download
raw
215 Bytes
# evaluate the base gpt2
# n_layer=36, n_head=20, n_embd=1280
# 774M parameters
batch_size = 8
eval_iters = 500 # use more iterations to get good estimate
eval_only = True
wandb_log = False
init_from = 'gpt2-large'

Xet Storage Details

Size:
215 Bytes
·
Xet hash:
e28de70646fc43a1d08ba47ea8b401edbc4477339c8677213142caa71ac07aa9

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.