farguney commited on
Commit
025cb20
·
verified ·
1 Parent(s): 0a86073

Upload transformer/progress.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. transformer/progress.json +1 -0
transformer/progress.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"run_name": "transformer", "events": [{"event": "validity", "val_tokens": 200000, "real_data": true, "kinds": ["transformer"], "d_model": 768, "n_layers": 12, "ref_params": 124009728, "param_match": {"transformer": {"d_model": 768, "params": 124009728, "rel_delta": 0.0}}}]}