Fix typo in README (#39)
Browse files- Fix typo (2011ba7c94c3b84294af3a8031eb4bc6817dd26e)
Co-authored-by: Joshua <Xenova@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -32,7 +32,7 @@ Mistral Nemo is a transformer model, with the following architecture choices:
|
|
| 32 |
- **Layers:** 40
|
| 33 |
- **Dim:** 5,120
|
| 34 |
- **Head dim:** 128
|
| 35 |
-
- **Hidden dim:** 14,
|
| 36 |
- **Activation Function:** SwiGLU
|
| 37 |
- **Number of heads:** 32
|
| 38 |
- **Number of kv-heads:** 8 (GQA)
|
|
|
|
| 32 |
- **Layers:** 40
|
| 33 |
- **Dim:** 5,120
|
| 34 |
- **Head dim:** 128
|
| 35 |
+
- **Hidden dim:** 14,336
|
| 36 |
- **Activation Function:** SwiGLU
|
| 37 |
- **Number of heads:** 32
|
| 38 |
- **Number of kv-heads:** 8 (GQA)
|