aixk commited on
Commit
d79a823
·
verified ·
1 Parent(s): df882fe

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +177 -27
README.md CHANGED
@@ -1,29 +1,179 @@
1
- # kosmo-TEST (Transformers)
 
 
 
 
 
 
 
 
 
 
 
 
2
 
3
- ## Purpose
4
- - Daily conversation model
5
- - Non-coding assistant behavior
 
 
6
 
7
- ## Architecture
8
- - Custom architecture: KosmoForCausalLM
9
-
10
- - hidden_size: 576
11
- - intermediate_size: 1536
12
- - layers: 30
13
- - heads: 9
14
- - kv_heads: 3
15
- - max_seq_len: 2048
16
- - rope_theta: 10000
17
- - qk_norm: True
18
- - local_mixer: True
19
- - neftune_alpha: 0.0
20
-
21
- ## Base Model
22
- - Reference base: `HuggingFaceTB/SmolLM2-135M`
23
- - Training recipe: SmolLM2-compatible continual training at 135M profile
24
- - Target size: approximately 135M parameters
25
-
26
- ## Expansion
27
- - The original SmolLM2-135M stack is reused as the initialization base.
28
- - No mandatory layer expansion is applied in the default 135M profile.
29
- - This model is trained as a 135M-structured derivative.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ pipeline_tag: text-generation
3
+ language:
4
+ - en
5
+ - ko
6
+ - ja
7
+ - es
8
+ - ru
9
+ - fr
10
+ - pt
11
+ ---
12
+ <div align="center">
13
+ <img src="https://cdn.jsdelivr.net/gh/sllkx/icons@main/logo/isai2.png" alt="ISAI Logo" width="160" style="border-radius: 30px; box-shadow: 0 4px 12px rgba(0,0,0,0.15); margin-bottom: 15px;">
14
 
15
+ <h2><b>ISAI - The Integrated AI Service Platform</b></h2>
16
+ <p style="color: #333; font-size: 12px">
17
+ ISAI is a comprehensive AI portal offering a variety of practical artificial intelligence services for everyday life.<br>
18
+ Discover our diverse family sites and services that enhance convenience and create new digital experiences.
19
+ </p>
20
 
21
+ <table align="center" width="100%" style="border: none; border-collapse: separate; border-spacing: 15px; text-align: left; max-width: 1100px;">
22
+ <tr>
23
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
24
+ <a href="https://isai.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
25
+ <span>ISAI</span>
26
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
27
+ </a>
28
+ </td>
29
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
30
+ <a href="https://ollapp.isai.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
31
+ <span>ollapp</span>
32
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
33
+ </a>
34
+ </td>
35
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
36
+ <a href="https://addly.isai.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
37
+ <span>Addly</span>
38
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
39
+ </a>
40
+ </td>
41
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
42
+ <a href="https://blog.099.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
43
+ <span>blogig</span>
44
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
45
+ </a>
46
+ </td>
47
+ </tr>
48
+ <tr>
49
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
50
+ <a href="https://logig.im/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
51
+ <span>logig</span>
52
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
53
+ </a>
54
+ </td>
55
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
56
+ <a href="https://099.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
57
+ <span>AI Magician</span>
58
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
59
+ </a>
60
+ </td>
61
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
62
+ <a href="https://99s.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
63
+ <span>99s</span>
64
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
65
+ </a>
66
+ </td>
67
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
68
+ <a href="https://199.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
69
+ <span>Global Stock</span>
70
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
71
+ </a>
72
+ </td>
73
+ </tr>
74
+ <tr>
75
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
76
+ <a href="https://archi.veai.workers.dev/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
77
+ <span>AI Archive</span>
78
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
79
+ </a>
80
+ </td>
81
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
82
+ <a href="https://www.wikiwi.workers.dev/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
83
+ <span>wikiwi</span>
84
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
85
+ </a>
86
+ </td>
87
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
88
+ <a href="https://www.wwwiki.workers.dev/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
89
+ <span>wwwiki</span>
90
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
91
+ </a>
92
+ </td>
93
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
94
+ <a href="https://oduc.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
95
+ <span>Oduck</span>
96
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
97
+ </a>
98
+ </td>
99
+ </tr>
100
+ <tr>
101
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
102
+ <a href="https://lai.oduc.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
103
+ <span>lai</span>
104
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
105
+ </a>
106
+ </td>
107
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
108
+ <a href="https://spirit-browser.isai.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
109
+ <span>spirit browser</span>
110
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
111
+ </a>
112
+ </td>
113
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
114
+ <a href="https://799.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
115
+ <span>799</span>
116
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
117
+ </a>
118
+ </td>
119
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
120
+ <a href="https://thedeo.uk" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
121
+ <span>thedeouk</span>
122
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
123
+ </a>
124
+ </td>
125
+ </tr>
126
+ <tr>
127
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
128
+ <a href="https://wallpaper.ko-kr.workers.dev/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
129
+ <span>wallpaper forum</span>
130
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
131
+ </a>
132
+ </td>
133
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
134
+ <a href="https://webbar.isai.kr" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
135
+ <span>webbar</span>
136
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
137
+ </a>
138
+ </td>
139
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
140
+ <a href="https://stode.isai.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
141
+ <span>Stode</span>
142
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
143
+ </a>
144
+ </td>
145
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
146
+ <a href="https://omap.isai.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
147
+ <span>OMAP</span>
148
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
149
+ </a>
150
+ </td>
151
+ </tr>
152
+ <tr>
153
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
154
+ <a href="https://manatoki.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
155
+ <span>hummorabbit</span>
156
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
157
+ </a>
158
+ </td>
159
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
160
+ <a href="https://spirit-browser.isai.kr/ollone/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
161
+ <span>ollone</span>
162
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
163
+ </a>
164
+ </td>
165
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
166
+ <a href="https://ranovel.kr/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
167
+ <span>ranovel.kr</span>
168
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
169
+ </a>
170
+ </td>
171
+ <td width="25%" style="padding: 12px 16px; background: #f8f9fa; border-radius: 8px;">
172
+ <a href="https://adsense.ko-kr.workers.dev/" style="text-decoration: none; color: #222; display: flex; justify-content: space-between; align-items: center; font-size: 14px; line-height: 1.2; font-weight: bold; width: 100%;">
173
+ <span>adsense forum</span>
174
+ <img src="https://cdn.jsdelivr.net/npm/remixicon@4.9.1/icons/Arrows/arrow-right-up-line.svg" width="18" style="opacity: 0.6;" alt="link">
175
+ </a>
176
+ </td>
177
+ </tr>
178
+ </table>
179
+ </div>