Update README.md
Browse files
README.md
CHANGED
|
@@ -11,11 +11,11 @@ license: apache-2.0
|
|
| 11 |
|
| 12 |
# Sky610TX
|
| 13 |
|
| 14 |
-
**Sky610TX** is a custom
|
| 15 |
|
| 16 |
## Model Details
|
| 17 |
- **Architecture:** GPT-2 Style (Custom Ascendant Config)
|
| 18 |
-
- **Parameters:** ~
|
| 19 |
- **Context Window:** 1024 Tokens
|
| 20 |
- **Was made as a test, new 1B parameter model coming soon!**
|
| 21 |
|
|
|
|
| 11 |
|
| 12 |
# Sky610TX
|
| 13 |
|
| 14 |
+
**Sky610TX** is a custom 389 Million parameter language model trained on the Sky dataset.
|
| 15 |
|
| 16 |
## Model Details
|
| 17 |
- **Architecture:** GPT-2 Style (Custom Ascendant Config)
|
| 18 |
+
- **Parameters:** ~389 Million
|
| 19 |
- **Context Window:** 1024 Tokens
|
| 20 |
- **Was made as a test, new 1B parameter model coming soon!**
|
| 21 |
|