Update README.md
Browse files
README.md
CHANGED
|
@@ -156,8 +156,13 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
|
|
| 156 |
## Technical Specifications [optional]
|
| 157 |
|
| 158 |
### Model Architecture and Objective
|
| 159 |
-
|
| 160 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 161 |
|
| 162 |
### Compute Infrastructure
|
| 163 |
|
|
|
|
| 156 |
## Technical Specifications [optional]
|
| 157 |
|
| 158 |
### Model Architecture and Objective
|
| 159 |
+
| | |
|
| 160 |
+
|---------------------------------|----:|
|
| 161 |
+
|Layers |24|
|
| 162 |
+
|Heads |16|
|
| 163 |
+
|Embeddings |1280|
|
| 164 |
+
|Context Window |16384 tokens|
|
| 165 |
+
|Tokenizer |cl100k_base|
|
| 166 |
|
| 167 |
### Compute Infrastructure
|
| 168 |
|