| Checkpoint: model_final.pt | |
| ================================================================================ | |
| exact_match: 0.30424026388593317 | |
| token_accuracy: 0.32938592933726274 | |
| bleu: 16.77594859433153 | |
| perplexity: 345.29677910351904 | |
| num_samples: 37592 | |
| gen_wall_time_s: 567.1426304173656 | |
| gen_samples_per_s: 66.28314992356631 | |
| gen_time_per_sample_ms: 15.086790551643052 | |
| gen_chars_per_s: 1735.0432628840697 | |
| gen_batch_mean_ms: 482.674579078609 | |
| gen_batch_p50_ms: 393.75559194013476 | |
| gen_batch_p95_ms: 993.2783101685345 | |
| gen_batch_max_ms: 3275.991577655077 | |
| gen_num_batches: 1175 | |