Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
|
| 3 |
+
# ⛏️ Andy-4-micro-base-LoRA ⛏️
|
| 4 |
+
|
| 5 |
+
Andy-4-micro is a 1.7b version of Andy-4, it shows off how incredible the Andy-4 dataset can make models, even in tiny packages.
|
| 6 |
+
|
| 7 |
+
|
| 8 |
+
## Model Details
|
| 9 |
+
|
| 10 |
+
This is a Small version of Andy-4, which is 1.7b parameters, and will release in all facets around two weeks from the full Andy-4 release.
|
| 11 |
+
|
| 12 |
+
This model used an optimal training environment for smaller models, as well as the same datasets as the full Andy-4 model.
|
| 13 |
+
|
| 14 |
+
**Andy-4:** 7b or 8b parameters
|
| 15 |
+
|
| 16 |
+
**Andy-4-micro:** 1.7b parameters.
|
| 17 |
+
|
| 18 |
+
# Additional detail
|
| 19 |
+
|
| 20 |
+
In preliminary testing of Andy-4-base and Andy-4-micro-base, Andy-4-micro-base showed to be only slightly worse than Andy-4, and sometimes on-par with non-building examples
|
| 21 |
+
|
| 22 |
+
Andy-4-micro shows off its incredible ability to play when allowed to reason, this is because the model is able to walk through step by step of what it should do, instead of relying on what it "remembers" for what it should do
|
| 23 |
+
|
| 24 |
+
In the preliminary testing, both non-reasoning and reasoning modes were used. Again, this was using Andy-4-micro-base and Andy-4-base, not the final versions.
|
| 25 |
+
|
| 26 |
+
Using this LoRA to continue to train a model falls under the ruling of the [Andy License](LICENSE), as in the final model must include `Andy` in it somewhere, and credit to be posted to I, Sweaterdog, in the model repo.
|
| 27 |
+
|
| 28 |
+
This is a base model, meaning it is not meant to play Minecraft with you, and is only for training updates to the model, as Mindcraft is not finished, we need to have a rolling update system
|
| 29 |
+
|
| 30 |
+
```
|
| 31 |
+
## License
|
| 32 |
+
This model is licensed under the Andy 1.0 License.
|
| 33 |
+
Credit: https://huggingface.co/Sweaterdog
|
| 34 |
+
Acknowledgment: This work uses data and models created by @Sweaterdog.
|
| 35 |
+
```
|