dragonkue commited on
Commit
a5cc22b
·
0 Parent(s):

Squash history

Browse files
.gitattributes ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
2
+ *.bin filter=lfs diff=lfs merge=lfs -text
3
+ *.pt filter=lfs diff=lfs merge=lfs -text
4
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
1_Pooling/config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "embedding_dimension": 4096,
3
+ "pooling_mode": "lasttoken",
4
+ "include_prompt": true
5
+ }
LICENSE ADDED
@@ -0,0 +1,238 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ comsat-embed-ko-8b-preview — License
2
+ ================================
3
+
4
+ 1. Model weights (this fine-tuned model)
5
+ ----------------------------------------
6
+ The fine-tuned model weights in this repository are licensed under the
7
+ Creative Commons Attribution-NonCommercial 4.0 International License
8
+ (CC BY-NC 4.0).
9
+
10
+ - Human-readable summary: https://creativecommons.org/licenses/by-nc/4.0/
11
+ - Full legal code: https://creativecommons.org/licenses/by-nc/4.0/legalcode
12
+
13
+ You are free to share and adapt the material for NON-COMMERCIAL purposes,
14
+ under the terms of attribution as described in the license. Commercial use is
15
+ not permitted under this license.
16
+
17
+ 2. Third-party components and attribution
18
+ -----------------------------------------
19
+ This model is a fine-tuned derivative of:
20
+
21
+ Qwen/Qwen3-Embedding-8B (https://huggingface.co/Qwen/Qwen3-Embedding-8B)
22
+ Copyright (c) Alibaba Cloud (the Qwen team)
23
+ Licensed under the Apache License, Version 2.0.
24
+
25
+ A copy of the Apache License, Version 2.0 is available at:
26
+ http://www.apache.org/licenses/LICENSE-2.0
27
+
28
+ In accordance with the Apache License 2.0, the above copyright and license
29
+ notice for Qwen3-Embedding-8B is retained. See the accompanying NOTICE file
30
+ for the required attribution notices.
31
+
32
+
33
+ 3. Full license text of the base model (Apache License 2.0)
34
+ -----------------------------------------------------------
35
+ The base model Qwen/Qwen3-Embedding-8B is licensed under the Apache License,
36
+ Version 2.0. Its full text is reproduced below in compliance with Section 4.
37
+
38
+ Apache License
39
+ Version 2.0, January 2004
40
+ http://www.apache.org/licenses/
41
+
42
+ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
43
+
44
+ 1. Definitions.
45
+
46
+ "License" shall mean the terms and conditions for use, reproduction,
47
+ and distribution as defined by Sections 1 through 9 of this document.
48
+
49
+ "Licensor" shall mean the copyright owner or entity authorized by
50
+ the copyright owner that is granting the License.
51
+
52
+ "Legal Entity" shall mean the union of the acting entity and all
53
+ other entities that control, are controlled by, or are under common
54
+ control with that entity. For the purposes of this definition,
55
+ "control" means (i) the power, direct or indirect, to cause the
56
+ direction or management of such entity, whether by contract or
57
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
58
+ outstanding shares, or (iii) beneficial ownership of such entity.
59
+
60
+ "You" (or "Your") shall mean an individual or Legal Entity
61
+ exercising permissions granted by this License.
62
+
63
+ "Source" form shall mean the preferred form for making modifications,
64
+ including but not limited to software source code, documentation
65
+ source, and configuration files.
66
+
67
+ "Object" form shall mean any form resulting from mechanical
68
+ transformation or translation of a Source form, including but
69
+ not limited to compiled object code, generated documentation,
70
+ and conversions to other media types.
71
+
72
+ "Work" shall mean the work of authorship, whether in Source or
73
+ Object form, made available under the License, as indicated by a
74
+ copyright notice that is included in or attached to the work
75
+ (an example is provided in the Appendix below).
76
+
77
+ "Derivative Works" shall mean any work, whether in Source or Object
78
+ form, that is based on (or derived from) the Work and for which the
79
+ editorial revisions, annotations, elaborations, or other modifications
80
+ represent, as a whole, an original work of authorship. For the purposes
81
+ of this License, Derivative Works shall not include works that remain
82
+ separable from, or merely link (or bind by name) to the interfaces of,
83
+ the Work and Derivative Works thereof.
84
+
85
+ "Contribution" shall mean any work of authorship, including
86
+ the original version of the Work and any modifications or additions
87
+ to that Work or Derivative Works thereof, that is intentionally
88
+ submitted to Licensor for inclusion in the Work by the copyright owner
89
+ or by an individual or Legal Entity authorized to submit on behalf of
90
+ the copyright owner. For the purposes of this definition, "submitted"
91
+ means any form of electronic, verbal, or written communication sent
92
+ to the Licensor or its representatives, including but not limited to
93
+ communication on electronic mailing lists, source code control systems,
94
+ and issue tracking systems that are managed by, or on behalf of, the
95
+ Licensor for the purpose of discussing and improving the Work, but
96
+ excluding communication that is conspicuously marked or otherwise
97
+ designated in writing by the copyright owner as "Not a Contribution."
98
+
99
+ "Contributor" shall mean Licensor and any individual or Legal Entity
100
+ on behalf of whom a Contribution has been received by Licensor and
101
+ subsequently incorporated within the Work.
102
+
103
+ 2. Grant of Copyright License. Subject to the terms and conditions of
104
+ this License, each Contributor hereby grants to You a perpetual,
105
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
106
+ copyright license to reproduce, prepare Derivative Works of,
107
+ publicly display, publicly perform, sublicense, and distribute the
108
+ Work and such Derivative Works in Source or Object form.
109
+
110
+ 3. Grant of Patent License. Subject to the terms and conditions of
111
+ this License, each Contributor hereby grants to You a perpetual,
112
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
113
+ (except as stated in this section) patent license to make, have made,
114
+ use, offer to sell, sell, import, and otherwise transfer the Work,
115
+ where such license applies only to those patent claims licensable
116
+ by such Contributor that are necessarily infringed by their
117
+ Contribution(s) alone or by combination of their Contribution(s)
118
+ with the Work to which such Contribution(s) was submitted. If You
119
+ institute patent litigation against any entity (including a
120
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
121
+ or a Contribution incorporated within the Work constitutes direct
122
+ or contributory patent infringement, then any patent licenses
123
+ granted to You under this License for that Work shall terminate
124
+ as of the date such litigation is filed.
125
+
126
+ 4. Redistribution. You may reproduce and distribute copies of the
127
+ Work or Derivative Works thereof in any medium, with or without
128
+ modifications, and in Source or Object form, provided that You
129
+ meet the following conditions:
130
+
131
+ (a) You must give any other recipients of the Work or
132
+ Derivative Works a copy of this License; and
133
+
134
+ (b) You must cause any modified files to carry prominent notices
135
+ stating that You changed the files; and
136
+
137
+ (c) You must retain, in the Source form of any Derivative Works
138
+ that You distribute, all copyright, patent, trademark, and
139
+ attribution notices from the Source form of the Work,
140
+ excluding those notices that do not pertain to any part of
141
+ the Derivative Works; and
142
+
143
+ (d) If the Work includes a "NOTICE" text file as part of its
144
+ distribution, then any Derivative Works that You distribute must
145
+ include a readable copy of the attribution notices contained
146
+ within such NOTICE file, excluding those notices that do not
147
+ pertain to any part of the Derivative Works, in at least one
148
+ of the following places: within a NOTICE text file distributed
149
+ as part of the Derivative Works; within the Source form or
150
+ documentation, if provided along with the Derivative Works; or,
151
+ within a display generated by the Derivative Works, if and
152
+ wherever such third-party notices normally appear. The contents
153
+ of the NOTICE file are for informational purposes only and
154
+ do not modify the License. You may add Your own attribution
155
+ notices within Derivative Works that You distribute, alongside
156
+ or as an addendum to the NOTICE text from the Work, provided
157
+ that such additional attribution notices cannot be construed
158
+ as modifying the License.
159
+
160
+ You may add Your own copyright statement to Your modifications and
161
+ may provide additional or different license terms and conditions
162
+ for use, reproduction, or distribution of Your modifications, or
163
+ for any such Derivative Works as a whole, provided Your use,
164
+ reproduction, and distribution of the Work otherwise complies with
165
+ the conditions stated in this License.
166
+
167
+ 5. Submission of Contributions. Unless You explicitly state otherwise,
168
+ any Contribution intentionally submitted for inclusion in the Work
169
+ by You to the Licensor shall be under the terms and conditions of
170
+ this License, without any additional terms or conditions.
171
+ Notwithstanding the above, nothing herein shall supersede or modify
172
+ the terms of any separate license agreement you may have executed
173
+ with Licensor regarding such Contributions.
174
+
175
+ 6. Trademarks. This License does not grant permission to use the trade
176
+ names, trademarks, service marks, or product names of the Licensor,
177
+ except as required for reasonable and customary use in describing the
178
+ origin of the Work and reproducing the content of the NOTICE file.
179
+
180
+ 7. Disclaimer of Warranty. Unless required by applicable law or
181
+ agreed to in writing, Licensor provides the Work (and each
182
+ Contributor provides its Contributions) on an "AS IS" BASIS,
183
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
184
+ implied, including, without limitation, any warranties or conditions
185
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
186
+ PARTICULAR PURPOSE. You are solely responsible for determining the
187
+ appropriateness of using or redistributing the Work and assume any
188
+ risks associated with Your exercise of permissions under this License.
189
+
190
+ 8. Limitation of Liability. In no event and under no legal theory,
191
+ whether in tort (including negligence), contract, or otherwise,
192
+ unless required by applicable law (such as deliberate and grossly
193
+ negligent acts) or agreed to in writing, shall any Contributor be
194
+ liable to You for damages, including any direct, indirect, special,
195
+ incidental, or consequential damages of any character arising as a
196
+ result of this License or out of the use or inability to use the
197
+ Work (including but not limited to damages for loss of goodwill,
198
+ work stoppage, computer failure or malfunction, or any and all
199
+ other commercial damages or losses), even if such Contributor
200
+ has been advised of the possibility of such damages.
201
+
202
+ 9. Accepting Warranty or Additional Liability. While redistributing
203
+ the Work or Derivative Works thereof, You may choose to offer,
204
+ and charge a fee for, acceptance of support, warranty, indemnity,
205
+ or other liability obligations and/or rights consistent with this
206
+ License. However, in accepting such obligations, You may act only
207
+ on Your own behalf and on Your sole responsibility, not on behalf
208
+ of any other Contributor, and only if You agree to indemnify,
209
+ defend, and hold each Contributor harmless for any liability
210
+ incurred by, or claims asserted against, such Contributor by reason
211
+ of your accepting any such warranty or additional liability.
212
+
213
+ END OF TERMS AND CONDITIONS
214
+
215
+ APPENDIX: How to apply the Apache License to your work.
216
+
217
+ To apply the Apache License to your work, attach the following
218
+ boilerplate notice, with the fields enclosed by brackets "[]"
219
+ replaced with your own identifying information. (Don't include
220
+ the brackets!) The text should be enclosed in the appropriate
221
+ comment syntax for the file format. We also recommend that a
222
+ file or class name and description of purpose be included on the
223
+ same "printed page" as the copyright notice for easier
224
+ identification within third-party archives.
225
+
226
+ Copyright 2024 Alibaba Cloud
227
+
228
+ Licensed under the Apache License, Version 2.0 (the "License");
229
+ you may not use this file except in compliance with the License.
230
+ You may obtain a copy of the License at
231
+
232
+ http://www.apache.org/licenses/LICENSE-2.0
233
+
234
+ Unless required by applicable law or agreed to in writing, software
235
+ distributed under the License is distributed on an "AS IS" BASIS,
236
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
237
+ See the License for the specific language governing permissions and
238
+ limitations under the License.
NOTICE ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ comsat-embed-ko-8b-preview
2
+ Copyright (c) 2026 Sionic AI
3
+
4
+ This model is a fine-tuned derivative of Qwen/Qwen3-Embedding-8B
5
+ (https://huggingface.co/Qwen/Qwen3-Embedding-8B).
6
+
7
+ The base model weights, tokenizer, and configuration are:
8
+ Copyright (c) Alibaba Cloud (the Qwen team)
9
+ Licensed under the Apache License, Version 2.0 (the "License").
10
+ You may obtain a copy of the License at:
11
+ http://www.apache.org/licenses/LICENSE-2.0
12
+
13
+ Modifications from the base model were made by Sionic AI.
14
+ The fine-tuned model weights are distributed under CC BY-NC 4.0 (see LICENSE).
README.md ADDED
@@ -0,0 +1,169 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ base_model: Qwen/Qwen3-Embedding-8B
4
+ base_model_relation: finetune
5
+ language:
6
+ - ko
7
+ - en
8
+ library_name: sentence-transformers
9
+ pipeline_tag: sentence-similarity
10
+ tags:
11
+ - sentence-transformers
12
+ - feature-extraction
13
+ - sentence-similarity
14
+ - mteb
15
+ - korean
16
+ - retrieval
17
+ ---
18
+
19
+ <p align="center">
20
+ <img src="assets/sionic_ai.png" alt="Sionic AI" width="480"/>
21
+ </p>
22
+
23
+ # comsat-embed-ko-8b-preview
24
+
25
+ **comsat-embed-ko-8b-preview** is a decoder-based embedding model developed by **Sionic AI**, optimized for Korean semantic retrieval tasks. Trained on **over 1M Korean examples**, it encodes queries and documents into vectors so that the most relevant documents can be found by similarity. The model is designed to provide high-quality text representations for real-world information retrieval scenarios, including document search, question answering, knowledge base retrieval, and enterprise semantic search. By leveraging Korean retrieval-oriented training data, comsat-embed-ko-8b-preview delivers robust performance across Korean search environments where accurate semantic matching is essential.
26
+
27
+ ## Highlights
28
+
29
+ - **Korean-specialized** — trained on 1M+ Korean examples and tuned for Korean search; achieves **state-of-the-art average NDCG@10 (0.7930)** on the 9-subset MTEB Korean retrieval benchmark among the compared models.
30
+ - **Long context** — handles inputs up to 8,192 tokens, well suited to long-document retrieval.
31
+ - **Instruction-aware queries** — queries are encoded with a task-instruction prompt to improve retrieval quality; documents need no prefix.
32
+ - **High-dimensional embeddings** — 4096-dimensional, last-token pooled and L2-normalized, compared with cosine similarity.
33
+
34
+ ## Usage
35
+
36
+ First install the Sentence Transformers library
37
+
38
+ ```bash
39
+ pip install -U sentence-transformers
40
+ ```
41
+
42
+ ### Sentence Transformers Usage
43
+
44
+ > ⚠️ Queries **must** be encoded with the query prompt; documents are encoded **without** any prefix. (Skipping the query prompt slightly degrades retrieval quality.)
45
+
46
+ ```python
47
+ from sentence_transformers import SentenceTransformer
48
+
49
+ model = SentenceTransformer("sionic-ai/comsat-embed-ko-8b-preview")
50
+
51
+ queries = ["한국의 수도는 어디인가?"]
52
+ passages = ["대한민국의 수도는 서울특별시이다."]
53
+
54
+ # Option 1) pass the query prompt explicitly (query only; documents get no prefix)
55
+ q_emb = model.encode(queries, prompt_name="query", normalize_embeddings=True)
56
+ d_emb = model.encode(passages, normalize_embeddings=True)
57
+
58
+ # Option 2) sentence-transformers 5.x helper API (equivalent result)
59
+ # q_emb = model.encode_query(queries)
60
+ # d_emb = model.encode_document(passages)
61
+
62
+ scores = q_emb @ d_emb.T # cosine similarity
63
+ print(scores)
64
+ ```
65
+
66
+ ### Transformers Usage
67
+
68
+ ```python
69
+ # Requires transformers>=4.51.0
70
+
71
+ import torch
72
+ import torch.nn.functional as F
73
+
74
+ from torch import Tensor
75
+ from transformers import AutoTokenizer, AutoModel
76
+
77
+
78
+ def last_token_pool(last_hidden_states: Tensor,
79
+ attention_mask: Tensor) -> Tensor:
80
+ left_padding = (attention_mask[:, -1].sum() == attention_mask.shape[0])
81
+ if left_padding:
82
+ return last_hidden_states[:, -1]
83
+ else:
84
+ sequence_lengths = attention_mask.sum(dim=1) - 1
85
+ batch_size = last_hidden_states.shape[0]
86
+ return last_hidden_states[torch.arange(batch_size, device=last_hidden_states.device), sequence_lengths]
87
+
88
+
89
+ def get_detailed_instruct(task_description: str, query: str) -> str:
90
+ return f'Instruct: {task_description}\nQuery:{query}'
91
+
92
+ # Each query must come with a one-sentence instruction that describes the task
93
+ task = 'Given a web search query, retrieve relevant passages that answer the query'
94
+
95
+ queries = [
96
+ get_detailed_instruct(task, '한국의 수도는 어디인가?'),
97
+ get_detailed_instruct(task, '광합성은 어떻게 일어나는가?')
98
+ ]
99
+ # No need to add instruction for retrieval documents
100
+ documents = [
101
+ "대한민국의 수도는 서울특별시이다.",
102
+ "광합성은 식물이 빛 에너지를 이용해 이산화탄소와 물로 포도당을 합성하는 과정이다."
103
+ ]
104
+ input_texts = queries + documents
105
+
106
+ tokenizer = AutoTokenizer.from_pretrained('sionic-ai/comsat-embed-ko-8b-preview', padding_side='left')
107
+ model = AutoModel.from_pretrained('sionic-ai/comsat-embed-ko-8b-preview')
108
+
109
+ # We recommend enabling flash_attention_2 for better acceleration and memory saving.
110
+ # model = AutoModel.from_pretrained('sionic-ai/comsat-embed-ko-8b-preview', attn_implementation="flash_attention_2", torch_dtype=torch.bfloat16).cuda()
111
+
112
+ max_length = 8192
113
+
114
+ # Tokenize the input texts
115
+ batch_dict = tokenizer(
116
+ input_texts,
117
+ padding=True,
118
+ truncation=True,
119
+ max_length=max_length,
120
+ return_tensors="pt",
121
+ )
122
+ batch_dict.to(model.device)
123
+ outputs = model(**batch_dict)
124
+ embeddings = last_token_pool(outputs.last_hidden_state, batch_dict['attention_mask'])
125
+
126
+ # normalize embeddings
127
+ embeddings = F.normalize(embeddings, p=2, dim=1)
128
+ scores = (embeddings[:2] @ embeddings[2:].T)
129
+ print(scores.tolist())
130
+ ```
131
+
132
+ ### Korean Retrieval Benchmark
133
+ - [LawIRKo](https://huggingface.co/datasets/on-and-on/lawgov_ir-ko): A **Korean legal-domain retrieval dataset** for finding statutes and precedents relevant to legal queries.
134
+ - [SQuADKorV1Retrieval](https://huggingface.co/datasets/yjoonjang/squad_kor_v1): A **Korean Wikipedia passage retrieval dataset** based on Korean SQuAD v1.
135
+ - [AutoRAGRetrieval](https://huggingface.co/datasets/yjoonjang/markers_bm): A **Korean document retrieval dataset** constructed by parsing PDFs from five domains: **finance, public, medical, legal, and commerce**.
136
+ - [Ko-StrategyQA](https://huggingface.co/datasets/taeminlee/Ko-StrategyQA): A Korean **ODQA multi-hop retrieval dataset**, translated from StrategyQA.
137
+ - [PublicHealthQA](https://huggingface.co/datasets/xhluca/publichealth-qa): A **retrieval dataset** focused on **medical and public health domains** in Korean.
138
+ - [BelebeleRetrieval](https://huggingface.co/datasets/mteb/belebele): A **Korean document retrieval dataset** based on FLORES-200.
139
+ - [MultiLongDocRetrieval](https://huggingface.co/datasets/mteb/MultiLongDocRetrieval): A **long-document retrieval dataset** covering various domains in Korean.
140
+ - [MIRACLRetrieval](https://huggingface.co/datasets/mteb/MIRACLRetrieval): A **Korean document retrieval dataset** based on Wikipedia.
141
+ - [MrTidyRetrieval](https://huggingface.co/datasets/mteb/mrtidy): A **Wikipedia-based Korean document retrieval dataset**.
142
+
143
+ ## Performance (MTEB Korean Retrieval, NDCG@10)
144
+
145
+ All scores are NDCG@10 on the **full corpus**, measured with the standard MTEB evaluation pipeline. For multilingual tasks the Korean subset is used (MLDR=ko, MIRACL/MrTidy=ko, Belebele=kor-kor).
146
+
147
+ | Model | Avg | MIRACL | MrTidy | MLDR | AutoRAG | Ko-StrategyQA | PublicHealthQA | Belebele | SQuADKorV1 | LawIRKo |
148
+ |---|---|---|---|---|---|---|---|---|---|---|
149
+ | **comsat-embed-ko-8b-preview** | **0.7930** | 0.6964 | 0.6253 | 0.5183 | 0.8518 | 0.8394 | 0.8871 | 0.9853 | 0.9168 | 0.8164 |
150
+ | Qwen/Qwen3-Embedding-8B | 0.7825 | 0.6783 | 0.6187 | 0.5036 | 0.8276 | 0.8363 | 0.8721 | 0.9828 | 0.9063 | 0.8171 |
151
+ | Qwen/Qwen3-Embedding-4B | 0.7718 | 0.6803 | 0.6076 | 0.4895 | 0.8431 | 0.8270 | 0.8693 | 0.9479 | 0.9044 | 0.7769 |
152
+ | upstage/solar-embedding-1-large | 0.7674 | 0.6703 | 0.5766 | 0.3850 | 0.8833 | 0.8366 | 0.8787 | 0.9684 | 0.9521 | 0.7557 |
153
+ | microsoft/harrier-oss-v1-27b | 0.7669 | 0.6653 | 0.5306 | 0.4073 | 0.8176 | 0.8361 | 0.8971 | 0.9538 | 0.9204 | 0.8737 |
154
+ | dragonkue/snowflake-arctic-embed-l-v2.0-ko | 0.7636 | 0.6685 | 0.5712 | 0.4150 | 0.9093 | 0.8050 | 0.8337 | 0.9518 | 0.9447 | 0.7735 |
155
+ | codefuse-ai/F2LLM-v2-8B | 0.7621 | 0.6311 | 0.6162 | 0.3950 | 0.7678 | 0.8371 | 0.9332 | 0.9509 | 0.8874 | 0.8405 |
156
+ | nlpai-lab/KURE-v1 | 0.7603 | 0.6816 | 0.5909 | 0.4521 | 0.8708 | 0.7999 | 0.8193 | 0.9502 | 0.9357 | 0.7426 |
157
+ | telepix/PIXIE-Rune-v1.5 | 0.7602 | 0.6393 | 0.5492 | 0.4340 | 0.8927 | 0.8064 | 0.8426 | 0.9617 | 0.9457 | 0.7705 |
158
+ | nvidia/llama-nemotron-embed-vl-1b-v2 | 0.7579 | 0.6975 | 0.5998 | 0.3704 | 0.8773 | 0.8084 | 0.8223 | 0.9584 | 0.9360 | 0.7513 |
159
+ | dragonkue/BGE-m3-ko | 0.7534 | 0.6833 | 0.6099 | 0.3784 | 0.8738 | 0.7959 | 0.8155 | 0.9503 | 0.9414 | 0.7322 |
160
+ | BAAI/bge-m3 | 0.7508 | 0.7015 | 0.6471 | 0.4273 | 0.8301 | 0.7941 | 0.8041 | 0.9316 | 0.9038 | 0.7174 |
161
+ | intfloat/multilingual-e5-large | 0.7333 | 0.6649 | 0.6421 | 0.2708 | 0.8134 | 0.8035 | 0.8253 | 0.9450 | 0.9056 | 0.7293 |
162
+ | nlpai-lab/KoE5 | 0.7329 | 0.6235 | 0.5841 | 0.2942 | 0.8434 | 0.8001 | 0.8351 | 0.9425 | 0.8980 | 0.7756 |
163
+
164
+ > Avg is the mean over the 9 subsets (higher is better).
165
+ > Reproduction: evaluated with the MTEB retrieval pipeline (NDCG@10, full corpus); the query prompt is applied to queries only (documents get no prefix).
166
+
167
+ ## License
168
+
169
+ - Model weights: **cc-by-nc-4.0** (non-commercial use).
assets/sionic_ai.png ADDED
config.json ADDED
@@ -0,0 +1,71 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3Model"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "bos_token_id": 151643,
8
+ "dtype": "bfloat16",
9
+ "eos_token_id": 151645,
10
+ "head_dim": 128,
11
+ "hidden_act": "silu",
12
+ "hidden_size": 4096,
13
+ "initializer_range": 0.02,
14
+ "intermediate_size": 12288,
15
+ "layer_types": [
16
+ "full_attention",
17
+ "full_attention",
18
+ "full_attention",
19
+ "full_attention",
20
+ "full_attention",
21
+ "full_attention",
22
+ "full_attention",
23
+ "full_attention",
24
+ "full_attention",
25
+ "full_attention",
26
+ "full_attention",
27
+ "full_attention",
28
+ "full_attention",
29
+ "full_attention",
30
+ "full_attention",
31
+ "full_attention",
32
+ "full_attention",
33
+ "full_attention",
34
+ "full_attention",
35
+ "full_attention",
36
+ "full_attention",
37
+ "full_attention",
38
+ "full_attention",
39
+ "full_attention",
40
+ "full_attention",
41
+ "full_attention",
42
+ "full_attention",
43
+ "full_attention",
44
+ "full_attention",
45
+ "full_attention",
46
+ "full_attention",
47
+ "full_attention",
48
+ "full_attention",
49
+ "full_attention",
50
+ "full_attention",
51
+ "full_attention"
52
+ ],
53
+ "max_position_embeddings": 40960,
54
+ "max_window_layers": 36,
55
+ "model_type": "qwen3",
56
+ "num_attention_heads": 32,
57
+ "num_hidden_layers": 36,
58
+ "num_key_value_heads": 8,
59
+ "pad_token_id": null,
60
+ "rms_norm_eps": 1e-06,
61
+ "rope_parameters": {
62
+ "rope_theta": 1000000,
63
+ "rope_type": "default"
64
+ },
65
+ "sliding_window": null,
66
+ "tie_word_embeddings": false,
67
+ "transformers_version": "5.9.0",
68
+ "use_cache": true,
69
+ "use_sliding_window": false,
70
+ "vocab_size": 151665
71
+ }
config_sentence_transformers.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "__version__": {
3
+ "pytorch": "2.11.0+cu128",
4
+ "sentence_transformers": "5.5.1",
5
+ "transformers": "5.9.0"
6
+ },
7
+ "default_prompt_name": null,
8
+ "model_type": "SentenceTransformer",
9
+ "prompts": {
10
+ "document": "",
11
+ "query": "Instruct: Given a web search query, retrieve relevant passages that answer the query\nQuery:"
12
+ },
13
+ "similarity_fn_name": "cosine"
14
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59185a9c38dc31edf85dcaa93276989bcea825cadad7e432e66296a34bc5c3e4
3
+ size 15134634912
modules.json ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "idx": 0,
4
+ "name": "0",
5
+ "path": "",
6
+ "type": "sentence_transformers.base.modules.transformer.Transformer"
7
+ },
8
+ {
9
+ "idx": 1,
10
+ "name": "1",
11
+ "path": "1_Pooling",
12
+ "type": "sentence_transformers.sentence_transformer.modules.pooling.Pooling"
13
+ },
14
+ {
15
+ "idx": 2,
16
+ "name": "2",
17
+ "path": "2_Normalize",
18
+ "type": "sentence_transformers.sentence_transformer.modules.normalize.Normalize"
19
+ }
20
+ ]
sentence_bert_config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "transformer_task": "feature-extraction",
3
+ "modality_config": {
4
+ "text": {
5
+ "method": "forward",
6
+ "method_output_name": "last_hidden_state"
7
+ }
8
+ },
9
+ "module_output_name": "token_embeddings"
10
+ }
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31f82e8f8c173bff1b34626d065393d33938f6d27a7448cfb706bbf9d3c0e651
3
+ size 11422943
tokenizer_config.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "backend": "tokenizers",
4
+ "bos_token": null,
5
+ "clean_up_tokenization_spaces": false,
6
+ "eos_token": "<|im_end|>",
7
+ "errors": "replace",
8
+ "is_local": false,
9
+ "local_files_only": false,
10
+ "model_max_length": 8192,
11
+ "pad_token": "<|endoftext|>",
12
+ "split_special_tokens": false,
13
+ "tokenizer_class": "Qwen2Tokenizer",
14
+ "unk_token": null
15
+ }