Update README.md
Browse files
README.md
CHANGED
|
@@ -84,6 +84,7 @@ number of tokens. It's [both dumb and ignorant](https://www.gilesthomas.com/202
|
|
| 84 |
- **Micro-batch size:** 28
|
| 85 |
- **Global batch size:** 224
|
| 86 |
- **Dropout:** 0.1
|
|
|
|
| 87 |
- **Learning rate:** 0.0004
|
| 88 |
- **Schedule learning rate:** False
|
| 89 |
- **Weight decay:** 0.1
|
|
|
|
| 84 |
- **Micro-batch size:** 28
|
| 85 |
- **Global batch size:** 224
|
| 86 |
- **Dropout:** 0.1
|
| 87 |
+
- **Gradient clipping**: None
|
| 88 |
- **Learning rate:** 0.0004
|
| 89 |
- **Schedule learning rate:** False
|
| 90 |
- **Weight decay:** 0.1
|