Yurim0507 commited on
Commit
8965ec5
·
verified ·
1 Parent(s): b536707

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -65,7 +65,7 @@ $$
65
  \nabla_{\theta} \mathcal{L} \leftarrow \frac{\nabla_{\theta} \mathcal{L}}{\max(1, \frac{\|\nabla_{\theta} \mathcal{L}\|}{C})}
66
  $$
67
 
68
- where \( C \) is the clipping threshold (`grad_norm_clip` in the code).
69
 
70
 
71
 
 
65
  \nabla_{\theta} \mathcal{L} \leftarrow \frac{\nabla_{\theta} \mathcal{L}}{\max(1, \frac{\|\nabla_{\theta} \mathcal{L}\|}{C})}
66
  $$
67
 
68
+ where \( C \) is the clipping threshold.
69
 
70
 
71