HDTenEightyP commited on
Commit
165f0d0
·
verified ·
1 Parent(s): 4fc2332

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -7
README.md CHANGED
@@ -8,16 +8,12 @@ tags:
8
  - GPT
9
  ---
10
  ![6cex5h9ls0ug1](https://cdn-uploads.huggingface.co/production/uploads/64b7618e2f5a966b972e9978/c0k3vYt-5cq0dIVTdKNTi.png)
11
- # GPT-sZero
12
- GPT-sZero is a text generation model meant to answer the question: "How strong of a model can Google Colab create?"
13
 
14
  ### Model Description
15
- GPT-sZero has 16 heads, 24 layers, and 1280 embeddings, similar to GPT2-Large, with a context window of 16,384 tokens. This maximized GPU VRAM while balancing size and functionality.
16
  It was trained on a diverse corpus of over 17 billion tokens.
17
- - **Developed by:** HDTenEightyP
18
- - **Model type:** Large Language Model with cl100k_base
19
- - **Language:** English
20
- - **License:** MIT
21
 
22
  ### Model Architecture
23
  | | |
 
8
  - GPT
9
  ---
10
  ![6cex5h9ls0ug1](https://cdn-uploads.huggingface.co/production/uploads/64b7618e2f5a966b972e9978/c0k3vYt-5cq0dIVTdKNTi.png)
11
+ # GPT-Compact
12
+ GPT-Compact is a text generation model meant to answer the question: "How strong of a model can Google Colab create?"
13
 
14
  ### Model Description
15
+ GPT-Compact has 16 heads, 24 layers, and 1280 embeddings, similar to GPT2-Large, with a context window of 16,384 tokens. This maximized GPU VRAM while balancing size and functionality.
16
  It was trained on a diverse corpus of over 17 billion tokens.
 
 
 
 
17
 
18
  ### Model Architecture
19
  | | |