muooon commited on
Commit
89a05ae
·
verified ·
1 Parent(s): 740c67b

Upload profile.txt

Browse files
Files changed (1) hide show
  1. AMP-compatible/profile.txt +37 -0
AMP-compatible/profile.txt ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ AMP-compatible / AMP対応版
2
+
3
+ emonavi 及び emoファミリーについて紹介します
4
+ emonavi は、RefAdamWmini-ScheduleFree を作成し機能向上を試行錯誤するうちにできた感情機構を持つオプティマイザです
5
+ emonavi is an optimizer equipped with an emotional mechanism,
6
+ developed through trial and error while creating and enhancing the functionality of RefAdamWmini-ScheduleFree.
7
+ https://github.com/muooon/ref-adamw-mini-ScheduleFree
8
+
9
+ RefAdamWmini は、ema、scaler、shadow、を持ちますが限定的な活用でした
10
+ これを改善していくなかでたどり着いたのが感情機構という新しい仕組みです
11
+ 以下、emonavi から順に紹介します
12
+ RefAdamWmini incorporated EMA, scaler, and shadow, but their application was limited.
13
+ Through our efforts to enhance this, we developed a novel mechanism: the emotional mechanism.
14
+ We'll introduce them in order, starting with emonavi.
15
+
16
+ 三姉妹 / The Three Sisters
17
+ emonavi:長女/Adam参考 The eldest daughter, referencing Adam.
18
+ emofact:次女/Adafactor参考 The second daughter, referencing Adafactor.
19
+ emolynx:三女/Lion・Tiger参考 The youngest daughter, referencing Lion and Tiger.
20
+
21
+ emoclan:統合/三姉妹に役割分担をさせた統合型 An integrated model where roles are assigned to the three sisters.
22
+
23
+ 三姉妹の従妹 / Cousins of the Three Sisters
24
+ emozeal:長女/emofact参考/双子の姉 The elder twin sister, referencing emofact.
25
+ emoneco:次女/emolynx参考/双子の妹 The younger twin sister, referencing emolynx.
26
+
27
+ emoclanという統合から三姉妹の従妹へ発展します
28
+ emozeal と emoneco はそれぞれ場面に応じて更新方法を選択します
29
+ The emoclan integration serves as the foundation for the development of the three sisters' cousins.
30
+ emozeal and emoneco each select their update method based on the specific situation.
31
+
32
+ それぞれ同一の"感情機構"を持ちます
33
+ emozeal は Adafactor系に情熱を持たせました
34
+ emoneco は Lion系にしなやかさを持たせました
35
+ Each possesses the same "emotional mechanism."
36
+ emozeal imbues Adafactor-based models with passion.
37
+ emoneco instills flexibility in Lion-based models.