Spaces:
Runtime error
Runtime error
| # Network | |
| MODEL_USE: mfb | |
| HIGH_ORDER: True # True for MFH, False for MFB | |
| HIDDEN_SIZE: 512 | |
| MFB_K: 5 | |
| MFB_O: 1000 | |
| LSTM_OUT_SIZE: 1024 | |
| DROPOUT_R: 0.1 | |
| I_GLIMPSES: 2 | |
| Q_GLIMPSES: 2 | |
| # Execution | |
| BATCH_SIZE: 64 | |
| LR_BASE: 0.0007 | |
| LR_DECAY_R: 0.25 | |
| LR_DECAY_LIST: [10, 12] | |
| WARMUP_EPOCH: 3 | |
| MAX_EPOCH: 13 | |
| GRAD_NORM_CLIP: -1 | |
| GRAD_ACCU_STEPS: 1 | |
| LOSS_FUNC: kld | |
| LOSS_REDUCTION: sum | |
| OPT: Adam | |
| OPT_PARAMS: {betas: '(0.9, 0.99)', eps: '1e-9'} | |