Update soup_maker.py
Browse files- soup_maker.py +11 -0
soup_maker.py
CHANGED
|
@@ -3,6 +3,17 @@
|
|
| 3 |
BASE TIER PATCHWORK SOUP
|
| 4 |
|
| 5 |
First we make the soup, then we refine it into stew, and then crystalize it into matter.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
=========================
|
| 7 |
3 experts, all 768-d, no dimensional mismatch:
|
| 8 |
clip_l14_openai — semantic (text-supervised)
|
|
|
|
| 3 |
BASE TIER PATCHWORK SOUP
|
| 4 |
|
| 5 |
First we make the soup, then we refine it into stew, and then crystalize it into matter.
|
| 6 |
+
|
| 7 |
+
Parmas in current configuration:
|
| 8 |
+
|
| 9 |
+
Parameters:
|
| 10 |
+
projectors : 296,064
|
| 11 |
+
constellation : 32,768
|
| 12 |
+
patchwork : 100,864
|
| 13 |
+
classifier : 370,256
|
| 14 |
+
total : 799,952
|
| 15 |
+
|
| 16 |
+
|
| 17 |
=========================
|
| 18 |
3 experts, all 768-d, no dimensional mismatch:
|
| 19 |
clip_l14_openai — semantic (text-supervised)
|