Hugging Face's logo

Mxode
/
NanoExperiment-Models

Translation
Transformers
Safetensors
English
Chinese
Model card Files
xet
 Community
Mxode commited on
Commit
503c5bd
·
verified ·
1 Parent(s): 087d7a1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -34,7 +34,7 @@ license: gpl-3.0
34
  | Warmup Ratio | 0.01 |
35
  | Decay Ratio | 0.35 |
36
  | Decay Progress | Exponential |
37
- | Min Decay LR | 0.01 \times \text{MaxLR} |
38
  | Optimizer | AdamW |
39
  | Weight Decay | 0.1 |
40
  | Max Grad Norm | 1.0 |
 
34
  | Warmup Ratio | 0.01 |
35
  | Decay Ratio | 0.35 |
36
  | Decay Progress | Exponential |
37
+ | Min Decay LR | 0.01 * Max LR |
38
  | Optimizer | AdamW |
39
  | Weight Decay | 0.1 |
40
  | Max Grad Norm | 1.0 |