Update README.md
Browse files
README.md
CHANGED
|
@@ -33,7 +33,7 @@ model-index:
|
|
| 33 |
|
| 34 |
# QED-Base-v3
|
| 35 |
|
| 36 |
-
QED-Base-v3 is a **~
|
| 37 |
|
| 38 |
## Model Details
|
| 39 |
|
|
@@ -50,7 +50,7 @@ QED-Base-v3 is a **~154M parameter causal language model** pretrained from scrat
|
|
| 50 |
| Tokenizer | QED-B3 tokenizer |
|
| 51 |
| Vocabulary size | 56,000 |
|
| 52 |
| Model type | Decoder-only Transformer |
|
| 53 |
-
| Parameters | ~
|
| 54 |
| Hidden size | 768 |
|
| 55 |
| Layers | 12 |
|
| 56 |
| Attention heads | 12 |
|
|
|
|
| 33 |
|
| 34 |
# QED-Base-v3
|
| 35 |
|
| 36 |
+
QED-Base-v3 is a **~111M parameter causal language model** pretrained from scratch by **Qarvexium**. It is a base model — it has not been instruction-tuned or aligned for chat, and is designed to continue text rather than follow instructions or hold a conversation.
|
| 37 |
|
| 38 |
## Model Details
|
| 39 |
|
|
|
|
| 50 |
| Tokenizer | QED-B3 tokenizer |
|
| 51 |
| Vocabulary size | 56,000 |
|
| 52 |
| Model type | Decoder-only Transformer |
|
| 53 |
+
| Parameters | ~111M |
|
| 54 |
| Hidden size | 768 |
|
| 55 |
| Layers | 12 |
|
| 56 |
| Attention heads | 12 |
|