Hnet-code / eval_results /metrics_initial_checkpoint.txt
narySt's picture
Add files using upload-large-folder tool
1385408 verified
Checkpoint: initial_checkpoint
================================================================================
exact_match: 0.0
token_accuracy: 0.271145197775755
bleu: 0.9972500288664534
perplexity: 692.8179589486938
num_samples: 37592
gen_wall_time_s: 1295.358363037696
gen_samples_per_s: 29.020540626181944
gen_time_per_sample_ms: 34.45835185778081
gen_chars_per_s: 6565.4140527230375
gen_batch_mean_ms: 1591.4535461574537
gen_batch_p50_ms: 1370.1162645593286
gen_batch_p95_ms: 2956.742995430247
gen_batch_max_ms: 5253.758145030588
gen_num_batches: 784