Update README.md
Browse files
README.md
CHANGED
|
@@ -20,9 +20,9 @@ This AI is crafted to push the boundaries of gameplay, reasoning, and multi-lang
|
|
| 20 |
|
| 21 |
# Overview
|
| 22 |
|
| 23 |
-
Andy-4-base is an 8B parameter model
|
| 24 |
|
| 25 |
-
It has been
|
| 26 |
|
| 27 |
The model underwent 2 epochs on the first dataset with a higher learning rate and 4 epochs on the second dataset with a much lower learning rate, ensuring a balanced and robust learning process.
|
| 28 |
|
|
|
|
| 20 |
|
| 21 |
# Overview
|
| 22 |
|
| 23 |
+
Andy-4-base is an 8B parameter model tuned from Llama3.1 8B.
|
| 24 |
|
| 25 |
+
It has been trained over three weeks on a single RTX 3090 using two carefully curated datasets.
|
| 26 |
|
| 27 |
The model underwent 2 epochs on the first dataset with a higher learning rate and 4 epochs on the second dataset with a much lower learning rate, ensuring a balanced and robust learning process.
|
| 28 |
|