Viharikvs commited on
Commit
3363076
·
verified ·
1 Parent(s): 99efe14

Model card updated after epoch 1

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -17,8 +17,8 @@ metrics: [loss, lm_loss, ponder_loss, perplexity_lm]
17
  Note: This model uses the T5 SentencePiece tokenizer. Perplexity numbers on WT103
18
  reported here are not directly comparable to GPT-2 BPE-based PPLs.
19
 
20
- ### Latest Performance (Epoch 0)
21
- - **Validation Loss**: 4.8829
22
- - **Validation LM Loss**: 4.8728
23
- - **Validation Ponder Loss**: 1.0091
24
- - **Validation Perplexity (LM-only)**: 130.69
 
17
  Note: This model uses the T5 SentencePiece tokenizer. Perplexity numbers on WT103
18
  reported here are not directly comparable to GPT-2 BPE-based PPLs.
19
 
20
+ ### Latest Performance (Epoch 1)
21
+ - **Validation Loss**: 4.8248
22
+ - **Validation LM Loss**: 4.8149
23
+ - **Validation Ponder Loss**: 1.0064
24
+ - **Validation Perplexity (LM-only)**: 123.34