8BitStudio commited on
Commit
015c6a8
·
verified ·
1 Parent(s): 988f42a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -16,12 +16,14 @@ tags:
16
  ## Model Details
17
  - **Architecture:** GPT-2 Style (Custom Ascendant Config)
18
  - **Parameters:** ~389 Million
 
19
  - **Context Window:** 1024 Tokens
20
  - **50k iterations**
21
 
22
  ## The Future
23
 
24
- **Work has started on a new, 1b parametr model. It will be much better at coding, reasoning, facts, and conversation. It is currently in development and is expected to release soon**
 
25
 
26
  ## How to Use
27
  ```python
 
16
  ## Model Details
17
  - **Architecture:** GPT-2 Style (Custom Ascendant Config)
18
  - **Parameters:** ~389 Million
19
+ - **Training tokens:** 1.3 Billion
20
  - **Context Window:** 1024 Tokens
21
  - **50k iterations**
22
 
23
  ## The Future
24
 
25
+ **Work has started on a new, 1b parameter model. It will be much better at coding, reasoning, facts, and conversation with 7B tokens! It is currently in development and is expected to release soon**
26
+
27
 
28
  ## How to Use
29
  ```python