Sweaterdog commited on
Commit
6ce7b90
·
verified ·
1 Parent(s): 8b3dc82

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+
3
+ # ⛏️ Andy-4-micro-base-LoRA ⛏️
4
+
5
+ Andy-4-micro is a 1.7b version of Andy-4, it shows off how incredible the Andy-4 dataset can make models, even in tiny packages.
6
+
7
+
8
+ ## Model Details
9
+
10
+ This is a Small version of Andy-4, which is 1.7b parameters, and will release in all facets around two weeks from the full Andy-4 release.
11
+
12
+ This model used an optimal training environment for smaller models, as well as the same datasets as the full Andy-4 model.
13
+
14
+ **Andy-4:** 7b or 8b parameters
15
+
16
+ **Andy-4-micro:** 1.7b parameters.
17
+
18
+ # Additional detail
19
+
20
+ In preliminary testing of Andy-4-base and Andy-4-micro-base, Andy-4-micro-base showed to be only slightly worse than Andy-4, and sometimes on-par with non-building examples
21
+
22
+ Andy-4-micro shows off its incredible ability to play when allowed to reason, this is because the model is able to walk through step by step of what it should do, instead of relying on what it "remembers" for what it should do
23
+
24
+ In the preliminary testing, both non-reasoning and reasoning modes were used. Again, this was using Andy-4-micro-base and Andy-4-base, not the final versions.
25
+
26
+ Using this LoRA to continue to train a model falls under the ruling of the [Andy License](LICENSE), as in the final model must include `Andy` in it somewhere, and credit to be posted to I, Sweaterdog, in the model repo.
27
+
28
+ This is a base model, meaning it is not meant to play Minecraft with you, and is only for training updates to the model, as Mindcraft is not finished, we need to have a rolling update system
29
+
30
+ ```
31
+ ## License
32
+ This model is licensed under the Andy 1.0 License.
33
+ Credit: https://huggingface.co/Sweaterdog
34
+ Acknowledgment: This work uses data and models created by @Sweaterdog.
35
+ ```