TheKostins commited on
Commit
3ac8691
·
verified ·
1 Parent(s): b1e6d18

Upload model

Browse files
1_Pooling/config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "embedding_dimension": 1024,
3
+ "pooling_mode": "mean",
4
+ "include_prompt": true
5
+ }
2_Dense/config.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "in_features": 1024,
3
+ "out_features": 1792,
4
+ "bias": true,
5
+ "activation_function": "torch.nn.modules.linear.Identity",
6
+ "module_input_name": "sentence_embedding",
7
+ "module_output_name": "sentence_embedding"
8
+ }
2_Dense/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a93f2b0d7a9370ac679f1d0aead979e26ba6e76dd006c6c440d7fc3b238974c0
3
+ size 3673768
README.md ADDED
@@ -0,0 +1,1036 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - unsloth
4
+ - sentence-transformers
5
+ - sentence-similarity
6
+ - feature-extraction
7
+ - generated_from_trainer
8
+ - dataset_size:164633
9
+ - loss:MatryoshkaLoss
10
+ - loss:MultipleNegativesRankingLoss
11
+ base_model: IEITYuan/Yuan-embedding-2.0-zh
12
+ widget:
13
+ - source_sentence: 小狗憋不住尿
14
+ sentences:
15
+ - "狗憋不住尿是什么问题\n1、发育不完善\n\n如果是年龄较小的狗狗,由于排尿中枢发育不完善,就有可能会出现憋不住尿的情况。不过这种情况一般随着狗狗年龄的增长,憋尿时间也会得到进一步延长,所以主人不用太过担心。\n\
16
+ \n\t\n\n\n \n\n2、喝太多水\n\n如果狗狗近期喝了太多的水,或者吃了含水量较多的食物 ,狗狗的膀胱就会时刻饱满充盈着尿液,从而法控制尿液。这种情况也是正常的,只要狗狗正常吃喝,精神状态好,就不用太过紧张。\n\
17
+ \n\t\n\n\n \n\n3、受到惊吓\n\n有一些胆子比较小的狗狗,在受到惊吓之后也会出现憋不住尿或者漏尿的情况。这种情况属于机体正常的生理反馈,一般在狗狗惊吓过后就可以自行恢复,不需要特殊的处理,但主人平时也要尽量避免这种情况发生。\n\
18
+ \n\t\n\n\n \n\n4、年龄大\n\n随着狗狗的年龄不断增长,狗狗的神经系统的反应能力也会降低,这时狗狗对于自己尿液的控制能力也会下降,所以就会出现憋不住尿的情况。这种情况几乎没有很好的解决办法,可以尝试性进行针灸或激光理疗,但效果难以保证。\n\
19
+ \n \n\n\t\n\n\n5、患有泌尿系统疾病\n\n如果狗狗除了出现憋不住尿的问题之外,还伴有尿频、尿痛、尿淋漓等症状,那就很可能是患有泌尿系统疾病,比如尿道炎、膀胱炎、尿结石等等。由于结石和炎症长时间刺激泌尿系统相关区域的粘膜,进而导致狗狗无法长时间憋尿,出现尿频的情况。这种问题十分严重,建议主人一旦发现就及时带狗狗到宠物医院治疗。 #新手养狗[话题]#  #养狗经验分享[话题]#  #养狗攻略[话题]# "
20
+ - '离得肝病的人远点,别被传染?
21
+
22
+ 离得肝病的人远点,别被传染?
23
+
24
+
25
+ 我们要知道并不是所有的疾病都具有传染性,肝病也是这样。肝病有很多种,常见的有甲肝、乙肝、丙肝这种病毒感染导致的病毒性肝炎,也有脂肪肝酒精肝这种不良生活习惯导致的肝病,还有一些自身免疫性的肝病等等。但是具有传染性的就只有病毒性肝炎,其他的是不具有传染性的。现在传染性最强也最广泛的就是乙肝,目前国内80%肝病患者都是因为感染了乙肝病毒,现阶段医疗水平还没有达到能完全消灭乙肝的水平,所以乙肝病毒的攻克依然是一个严峻的问题。对于肝病患者来说我们要注意防护,注意日常生活饮食,尽可能地让我们的身体处于一个较好的水平,等待新技术,新药的应用。对于健康人群,我们要做好日常的防护,碗筷消毒,不共用毛巾,水杯等生活用品,我们也不要去歧视和贬低肝病患者,己所不欲勿施于人! #山东[话题]#  #肝病[话题]#  #健康科普[话题]# 
26
+
27
+
28
+ '
29
+ - "快抄作业✍️结婚必拍爆\U0001F525的喜嫁风婚纱照\n喜嫁婚纱照|新中式婚纱照|婚纱照风格\n\U0001F4F8拍摄:@玛萨婚纱照 \n-\n小红书热拍\U0001F525\
30
+ 喜嫁婚纱照合集\n各种类型的喜嫁婚纱照\n不挑人 i人e人轻松驾驭\U0001F90F\n东方新娘结婚必拍\U0001F4E3\n-\n主纱 新中式 复古\
31
+ \ 俏皮都有的喜嫁婚纱照\n\U0001F514满足各种风格的新人们\n✅建议备婚的收藏哦~\n-\n25年的新娘们备婚不走弯路\U0001F92B\U0001F92B\
32
+ \n必选好看不踩雷的喜嫁婚纱照\n百搭且特别实用\U0001F44B\n-\n更多类型婚纱照戳主页哦‼️\n咨询拍摄\U0001F251戳@玛萨婚纱照 \n\
33
+ 抢先获取 >>惊喜优惠[红包R]\n[打卡R]了解套餐/预约进店 评论\U0001F522\n-\n#芜湖婚纱照[话题]#|#芜湖婚纱照推荐[话题]#|#婚纱摄影[话题]#\n\
34
+ #婚纱照风格[话题]#|#芜湖婚纱摄影[话题]#|#喜嫁婚纱照[话题]#\n#新中式婚纱照[话题]#|#汉服婚纱照[话题]#|#复古婚纱照[话题]#"
35
+ - source_sentence: 生日快乐文案
36
+ sentences:
37
+ - '高级小众的生日祝福
38
+
39
+ 🎈🎈
40
+
41
+ 01
42
+
43
+ 生日快乐
44
+
45
+ 长岁常安
46
+
47
+ ·
48
+
49
+ 02
50
+
51
+ 一岁一礼
52
+
53
+ 一寸欢喜
54
+
55
+ ·
56
+
57
+ 03
58
+
59
+ 这一岁
60
+
61
+ 要找到生活中最温柔的光
62
+
63
+ ·
64
+
65
+ 04
66
+
67
+ 生活明朗一路追光
68
+
69
+ 可爱一如往常
70
+
71
+ ·
72
+
73
+ 05
74
+
75
+ 朝暮与年岁并往
76
+
77
+ 希望热爱与平淡共存
78
+
79
+ ·
80
+
81
+ 06
82
+
83
+ 生而自由,日日欢愉
84
+
85
+ 快意人生,乐得自在
86
+
87
+ ·
88
+
89
+ 07
90
+
91
+ 生日快乐
92
+
93
+ 前路浩浩荡荡
94
+
95
+ 万事尽可期待
96
+
97
+ ·
98
+
99
+ 08
100
+
101
+ 祝你一生明朗,无惧岁月冗长
102
+
103
+ 前���的路上,温柔闪光
104
+
105
+ ·
106
+
107
+ 09
108
+
109
+ 何其有幸,年岁并进
110
+
111
+ 前路浩浩荡荡,万事尽可期待
112
+
113
+ ·
114
+
115
+ 10
116
+
117
+ 渐入佳境
118
+
119
+ 大概是我对人生最好的祝愿了
120
+
121
+ 生日快乐
122
+
123
+ ·
124
+
125
+ 11
126
+
127
+ 祝你常拾理想,终得浪漫
128
+
129
+ 在朝朝暮暮里岁岁长安
130
+
131
+ ·
132
+
133
+ 12
134
+
135
+ 年年岁岁,承蒙时光不弃
136
+
137
+ 岁岁年年,万喜万般皆宜
138
+
139
+ ·
140
+
141
+ 13
142
+
143
+ 祝你温柔浪漫,不失爱与果敢
144
+
145
+ 朝朝如愿,岁岁如意平安
146
+
147
+ ·
148
+
149
+ 14
150
+
151
+ 希望你继续兴致盎然地与世界交手
152
+
153
+ 一直走在充满鲜花的道路上
154
+
155
+ ·
156
+
157
+ 15
158
+
159
+ 新的一岁,愿生活:
160
+
161
+ 风平浪静,柳暗花明
162
+
163
+ 三分惊喜,七分尽兴
164
+
165
+ ·
166
+
167
+ 16
168
+
169
+ 祝你早日找到小宇宙
170
+
171
+ 在自己的小天地做喜欢的事
172
+
173
+ 生日快乐
174
+
175
+ ·
176
+
177
+ ✨✨
178
+
179
+ —The end—
180
+
181
+ 🌈感谢阅读
182
+
183
+ #生日快乐[话题]# #生日文案[话题]# #文字素材分享[话题]# #生日[话题]# #文字语录[话题]# #文案[话题]# #速写人间万象[话题]# #浪漫生活的记录者[话题]#
184
+ #生日祝福[话题]# '
185
+ - 'nan
186
+
187
+ 王安宇:撞我枪口上了,我粤语非常好[笑哭R][笑哭R][笑哭R]咋会这么搞笑#王安宇[话题]# #正在追的综艺[话题]# #现在就出发2[话题]# #非原创[话题]#
188
+ #沈腾[话题]# #胡先煦[话题]# #金晨[话题]# #宋亚轩[话题]# '
189
+ - '库迪星尘厚乳拿铁里的晶球是酸的吗?
190
+
191
+ 太久没喝了,忘记原来啥味道了[捂脸R]
192
+
193
+ 这杯感觉酸酸的,里面的晶球好酸,不会坏了吧,
194
+
195
+ 有没有经常喝的人知道哇[皱眉R]
196
+
197
+ 还是说,酸是正常的?#库迪[话题]# #库迪咖啡[话题]# #星尘厚乳拿铁[话题]# #咖啡日常[话题]# '
198
+ - source_sentence: 莞城美食平价
199
+ sentences:
200
+ - "家人们!来评论区许愿!\n活动规则:点赞+评论本条视频的高考毕业生,从高中→大学的第一幅美瞳我来送[飞吻R]\n抽奖产品:店内美瞳任选4个花色[萌萌哒R]\n\
201
+ 活动时间:2024年6月8日-2024年6月10日\n\t\n\n家人们许愿的时候\n不要忘记关注oon\n助力小o完成涨粉目标[哇R]\n#高考[话题]#\
202
+ \ #oon美瞳[话题]# #人生第一幅美瞳[话题]# #抽奖活动[话题]# #半年抛美瞳[话题]# "
203
+ - '🔥东莞莞城美食地图大公开🗺️
204
+
205
+ [派对R]友友们,我带着莞城逛吃版攻略来啦!准备好跟我一起开启美食之旅了吗?[哇R]
206
+
207
+ ✅第一站: 猪宝饼家🍞
208
+
209
+ 这里的鲜奶蛋挞和菠萝包🍞是绝对不能错过的。蛋挞的奶味浓郁,让人回味无穷😍。这次尝试的金枪鱼面包则是咸口面包,但是没有特别突出。要记得早点去,不然像菠萝包这样的热门产品可能会售罄哦。
210
+
211
+ ✅第二站: 街边茶档🧋
212
+
213
+ 位于猪宝饼家隔壁的这家街边茶档,虽然店面不起眼,但却是隐藏版的奶茶天堂。这里的奶茶种类虽然不多,但每一款都能与香港正宗茶餐厅的饮料相媲美。特别是港奶和冻柠茶,味道浓郁,让人一喝难忘。别忘了欣赏一下帅气的老板🤩哦!
214
+
215
+ ✅第三站: 芹菜糖糕点🍮
216
+
217
+ 虽然这家店位于市场的小巷子里,但人气却一点也不低。开导航就能轻松找到。这里的糕点都是糯叽叽的,特别推荐油煎蛋黄卷和糯米糍。蛋黄卷煎得热热的,配上香甜的内馅,简直美味极了😋!而糯米糍则有丰富的口味选择,豆沙和奶黄馅都很赞,甜度适中☺️。
218
+
219
+ ✅第四站: 炸蛋小超人🍢
220
+
221
+ 这家炸嘢店在莞城可是家喻户晓的。人气旺盛,总是需要排队等候。裹粉鸡翅汁水丰富,炸金针菇酥脆可口。如果犹豫不决的宝宝们,按照菜单上的推荐点准没错。虽然等待时间可能会有些长😭,但美食总是值得等待的。
222
+
223
+ ✅第五站: 超级棒🍧
224
+
225
+ 来到莞城怎么能错过这家刨冰🍧店呢?童年回忆的刨冰店!芒果🥭红豆牛奶冰是最受推荐的选择。炼乳浓郁,芒果丰富多汁,红豆也是满满的。芒果🥭与红豆的搭配简直是绝配!强烈安利这款刨冰🍧给你!
226
+
227
+ 最后附上我的宝藏打卡店铺地图🗺️!这次的莞城逛吃版City Walk之旅真的太有feel了!
228
+
229
+ 💕喜欢的宝宝们快别错过了这样的莞城美食之旅!
230
+
231
+ #东莞美食[话题]# #东莞旅游美食[话题]# #莞城美食[话题]# #美食日常[话题]# #东莞探店[话题]# #莞城探店[话题]# #莞城[话题]# #东莞[话题]#
232
+ #东莞莞城美食[话题]# #东莞莞城[话题]# #东莞美食攻略[话题]# #东莞美食探店[话题]# '
233
+ - "119\U0001F19A219|两款lena直板夹区别在哪\U0001F914\n\U0001F4B0119 经典款:小\U0001F360爆款直板夹\n\
234
+ 性价比之选 各方面无短板\n-\n\U0001F4B0219 无感款:高级有质感 博主爱用款\n使用频率高 预算充足可选\n\t\n#lena[话题]# #直板夹[话题]#\
235
+ \ #lena直板夹[话题]# #直板夹测评[话题]# #直板夹推荐[话题]# #直板夹卷发[话题]# #极限二选一[话题]# #选哪个[话题]# #夹板[话题]#\
236
+ \ #1年1度购物狂欢[话题]#"
237
+ - source_sentence: 宣传工作个人述职
238
+ sentences:
239
+ - "原来超赞的述职报告这么好写\U0001F525\n述职报告写不好?不会写?\n看这一篇就对了!\n戳[向右R][向右R][向右R]【立刻咨询】匹配1v1写作老师\n\
240
+ \t\n那么述职报告到底如何写好呢?\n[一R]简明扼要,提高报告的可读性和说服力\n[二R]突出重点,对履行职责深入分析及研究\n[三R]全面报告,为后续内容做好铺垫\n\
241
+ [四R]客观分析,概述任职期间主要成绩\n[五R]解决方案,展现个人解决问题的能力\n\t\n如果还担心写不好,来不及[可怜R]\n也可以戳[向右R][向右R][向右R]【立刻咨询】解锁立刻1v1写作老师!\n\
242
+ \t\n[星R]专业团队,经验丰富、效率高\n[星R]一对一贴心指导,手把手教会你如何文章优化\n[星R]24小时全天在线,随时解答你的问题难点\n[星R]收费公道透明,性价比高\n\
243
+ \t\n还在为文章没方向,内容写不出来,时间紧任务重而担心的宝子们~\n点击   [向右R][向右R][向右R]【立刻咨询】即刻匹配专业老师为你解决文章难题!!!\n\
244
+ \t\n#述职报告[话题]# #述职报告工作总结[话题]# #述职报告ppt[话题]# #年终述职[话题]# #转正述职报告[话题]# #晋升述职[话题]#\
245
+ \ #银行副职述职竞聘报告[话题]# "
246
+ - '人生第一条鱼王居然是臭水沟钓的?
247
+
248
+ 我说这把钥匙是干嘛的原来是开下水道的,而且下水道通往城镇哎,实现地图闪现哈哈哈哈,我万万没想到第一条鱼王是在下水道的臭水沟里钓到的哈哈哈哈收藏起来,没想到还挺好钓的,为什么其他的鱼王这么难钓阿,下水道那还可以拿💰换职业,果然💰是万能的哇!
249
+
250
+ 还有这个小黑好可爱,好想带回家养着![萌萌哒R]
251
+
252
+ 又嫖到了一个星之果实🌟#星露谷[话题]# #星露谷新手[话题]# #星露谷下水道[话题]# '
253
+ - '咔乐加动感猫眼胶好灰啊
254
+
255
+ 个人玩家测评。今天快递到了赶忙去拿随手涂了一下,动感系列的都会发灰,没涂打底色直接涂的胶周圈一边黑色可不好看,单看猫眼颜色挺好看的#猫眼[话题]# #咔乐加猫眼胶[话题]#
256
+ #平价猫眼胶[话题]##美甲[话题]##原相机[话题]#'
257
+ - source_sentence: 上学文具分享
258
+ sentences:
259
+ - '云南丽江~ 束河古镇风景(上)
260
+
261
+ 拍于2023年11.19哦~
262
+
263
+ 从白沙坐公交去的束河古镇
264
+
265
+ 进门的时候忘记拍牌楼了[笑哭R]
266
+
267
+ 刚进门不久走到了茶马古道博物馆但是是关闭状态的
268
+
269
+ 不走人多的地方风景很不错
270
+
271
+ 图上那只松鼠的表情真的笑死
272
+
273
+ 看起来比香格里拉和雨崩的可爱
274
+
275
+ 建议沿着水流走 风景不会太差
276
+
277
+ #云南[话题]# #云南游[话题]# #云南丽江[话题]# #束河古镇[话题]# '
278
+ - "准初三生的书包里有啥\U0001F609\U0001F449\U0001F3FB\U0001F497\n都是一些很真实的东西哈哈哈 \n我就问有谁懂…?\n\
279
+ #笔袋[话题]# #笔袋介绍[话题]# #我的文具分享[话题]# \n#晒晒我的书桌[话题]# #我的日常[话题]# \n#whatsinmybag[话题]#\
280
+ \ #书包里面装什么[话题]# \n#书包[话题]# "
281
+ - '下辈子我也要当仓鼠
282
+
283
+ 傻傻的胖胖的不知道悲伤……#珍藏的宠物照[话题]# #侏儒仓鼠[话题]# #鼠鼠教[话题]# #宠物[话题]# #宠物日常[话题]# '
284
+ pipeline_tag: sentence-similarity
285
+ library_name: sentence-transformers
286
+ metrics:
287
+ - cosine_accuracy@1
288
+ - cosine_accuracy@3
289
+ - cosine_accuracy@5
290
+ - cosine_accuracy@10
291
+ - cosine_precision@1
292
+ - cosine_precision@3
293
+ - cosine_precision@5
294
+ - cosine_precision@10
295
+ - cosine_recall@1
296
+ - cosine_recall@3
297
+ - cosine_recall@5
298
+ - cosine_recall@10
299
+ - cosine_ndcg@10
300
+ - cosine_ndcg@100
301
+ - cosine_mrr@10
302
+ - cosine_mrr@100
303
+ - cosine_map@10
304
+ - cosine_map@100
305
+ model-index:
306
+ - name: SentenceTransformer based on IEITYuan/Yuan-embedding-2.0-zh
307
+ results:
308
+ - task:
309
+ type: information-retrieval
310
+ name: Information Retrieval
311
+ dataset:
312
+ name: query note test
313
+ type: query_note_test
314
+ metrics:
315
+ - type: cosine_accuracy@1
316
+ value: 0.23479758828596037
317
+ name: Cosine Accuracy@1
318
+ - type: cosine_accuracy@3
319
+ value: 0.46718346253229975
320
+ name: Cosine Accuracy@3
321
+ - type: cosine_accuracy@5
322
+ value: 0.5714039621016366
323
+ name: Cosine Accuracy@5
324
+ - type: cosine_accuracy@10
325
+ value: 0.6919896640826874
326
+ name: Cosine Accuracy@10
327
+ - type: cosine_precision@1
328
+ value: 0.23479758828596037
329
+ name: Cosine Precision@1
330
+ - type: cosine_precision@3
331
+ value: 0.20160780935974734
332
+ name: Cosine Precision@3
333
+ - type: cosine_precision@5
334
+ value: 0.1750904392764858
335
+ name: Cosine Precision@5
336
+ - type: cosine_precision@10
337
+ value: 0.1343152454780362
338
+ name: Cosine Precision@10
339
+ - type: cosine_recall@1
340
+ value: 0.089571995809469
341
+ name: Cosine Recall@1
342
+ - type: cosine_recall@3
343
+ value: 0.21276711060827266
344
+ name: Cosine Recall@3
345
+ - type: cosine_recall@5
346
+ value: 0.290847859967523
347
+ name: Cosine Recall@5
348
+ - type: cosine_recall@10
349
+ value: 0.4043580098850914
350
+ name: Cosine Recall@10
351
+ - type: cosine_ndcg@10
352
+ value: 0.31369612431129706
353
+ name: Cosine Ndcg@10
354
+ - type: cosine_ndcg@100
355
+ value: 0.4213142361215435
356
+ name: Cosine Ndcg@100
357
+ - type: cosine_mrr@10
358
+ value: 0.3758652229194859
359
+ name: Cosine Mrr@10
360
+ - type: cosine_mrr@100
361
+ value: 0.38581415116789297
362
+ name: Cosine Mrr@100
363
+ - type: cosine_map@10
364
+ value: 0.2185657312084243
365
+ name: Cosine Map@10
366
+ - type: cosine_map@100
367
+ value: 0.254050567242055
368
+ name: Cosine Map@100
369
+ - task:
370
+ type: information-retrieval
371
+ name: Information Retrieval
372
+ dataset:
373
+ name: query note test 256
374
+ type: query_note_test_256
375
+ metrics:
376
+ - type: cosine_accuracy@1
377
+ value: 0.22997416020671835
378
+ name: Cosine Accuracy@1
379
+ - type: cosine_accuracy@3
380
+ value: 0.446167097329888
381
+ name: Cosine Accuracy@3
382
+ - type: cosine_accuracy@5
383
+ value: 0.5488372093023256
384
+ name: Cosine Accuracy@5
385
+ - type: cosine_accuracy@10
386
+ value: 0.6690783807062877
387
+ name: Cosine Accuracy@10
388
+ - type: cosine_precision@1
389
+ value: 0.22997416020671835
390
+ name: Cosine Precision@1
391
+ - type: cosine_precision@3
392
+ value: 0.19092736146999711
393
+ name: Cosine Precision@3
394
+ - type: cosine_precision@5
395
+ value: 0.16675279931093884
396
+ name: Cosine Precision@5
397
+ - type: cosine_precision@10
398
+ value: 0.12809646856158485
399
+ name: Cosine Precision@10
400
+ - type: cosine_recall@1
401
+ value: 0.08578555881472219
402
+ name: Cosine Recall@1
403
+ - type: cosine_recall@3
404
+ value: 0.20298188200672027
405
+ name: Cosine Recall@3
406
+ - type: cosine_recall@5
407
+ value: 0.27491914047529314
408
+ name: Cosine Recall@5
409
+ - type: cosine_recall@10
410
+ value: 0.38317051407751485
411
+ name: Cosine Recall@10
412
+ - type: cosine_ndcg@10
413
+ value: 0.2987742813298307
414
+ name: Cosine Ndcg@10
415
+ - type: cosine_ndcg@100
416
+ value: 0.4019666587503052
417
+ name: Cosine Ndcg@100
418
+ - type: cosine_mrr@10
419
+ value: 0.36383679914687544
420
+ name: Cosine Mrr@10
421
+ - type: cosine_mrr@100
422
+ value: 0.37401737089804155
423
+ name: Cosine Mrr@100
424
+ - type: cosine_map@10
425
+ value: 0.20713694797471097
426
+ name: Cosine Map@10
427
+ - type: cosine_map@100
428
+ value: 0.23981106920718018
429
+ name: Cosine Map@100
430
+ - task:
431
+ type: information-retrieval
432
+ name: Information Retrieval
433
+ dataset:
434
+ name: query note val
435
+ type: query_note_val
436
+ metrics:
437
+ - type: cosine_accuracy@1
438
+ value: 0.2973365617433414
439
+ name: Cosine Accuracy@1
440
+ - type: cosine_accuracy@3
441
+ value: 0.5941888619854722
442
+ name: Cosine Accuracy@3
443
+ - type: cosine_accuracy@5
444
+ value: 0.7297820823244552
445
+ name: Cosine Accuracy@5
446
+ - type: cosine_accuracy@10
447
+ value: 0.85181598062954
448
+ name: Cosine Accuracy@10
449
+ - type: cosine_precision@1
450
+ value: 0.2973365617433414
451
+ name: Cosine Precision@1
452
+ - type: cosine_precision@3
453
+ value: 0.2687651331719128
454
+ name: Cosine Precision@3
455
+ - type: cosine_precision@5
456
+ value: 0.235544794188862
457
+ name: Cosine Precision@5
458
+ - type: cosine_precision@10
459
+ value: 0.178498789346247
460
+ name: Cosine Precision@10
461
+ - type: cosine_recall@1
462
+ value: 0.12551538574264365
463
+ name: Cosine Recall@1
464
+ - type: cosine_recall@3
465
+ value: 0.32960528205430656
466
+ name: Cosine Recall@3
467
+ - type: cosine_recall@5
468
+ value: 0.45124208285458633
469
+ name: Cosine Recall@5
470
+ - type: cosine_recall@10
471
+ value: 0.6155340966297885
472
+ name: Cosine Recall@10
473
+ - type: cosine_ndcg@10
474
+ value: 0.45092052083837153
475
+ name: Cosine Ndcg@10
476
+ - type: cosine_ndcg@100
477
+ value: 0.5626402106691932
478
+ name: Cosine Ndcg@100
479
+ - type: cosine_mrr@10
480
+ value: 0.47398516468734525
481
+ name: Cosine Mrr@10
482
+ - type: cosine_mrr@100
483
+ value: 0.4808673110081914
484
+ name: Cosine Mrr@100
485
+ - type: cosine_map@10
486
+ value: 0.33275259014017233
487
+ name: Cosine Map@10
488
+ - type: cosine_map@100
489
+ value: 0.3795452213509927
490
+ name: Cosine Map@100
491
+ - task:
492
+ type: information-retrieval
493
+ name: Information Retrieval
494
+ dataset:
495
+ name: query note val 256
496
+ type: query_note_val_256
497
+ metrics:
498
+ - type: cosine_accuracy@1
499
+ value: 0.2963680387409201
500
+ name: Cosine Accuracy@1
501
+ - type: cosine_accuracy@3
502
+ value: 0.5932203389830508
503
+ name: Cosine Accuracy@3
504
+ - type: cosine_accuracy@5
505
+ value: 0.7220338983050848
506
+ name: Cosine Accuracy@5
507
+ - type: cosine_accuracy@10
508
+ value: 0.847457627118644
509
+ name: Cosine Accuracy@10
510
+ - type: cosine_precision@1
511
+ value: 0.2963680387409201
512
+ name: Cosine Precision@1
513
+ - type: cosine_precision@3
514
+ value: 0.26682808716707024
515
+ name: Cosine Precision@3
516
+ - type: cosine_precision@5
517
+ value: 0.233317191283293
518
+ name: Cosine Precision@5
519
+ - type: cosine_precision@10
520
+ value: 0.1764164648910412
521
+ name: Cosine Precision@10
522
+ - type: cosine_recall@1
523
+ value: 0.12586104987005262
524
+ name: Cosine Recall@1
525
+ - type: cosine_recall@3
526
+ value: 0.32797772143937326
527
+ name: Cosine Recall@3
528
+ - type: cosine_recall@5
529
+ value: 0.4473090263384894
530
+ name: Cosine Recall@5
531
+ - type: cosine_recall@10
532
+ value: 0.6070124305129267
533
+ name: Cosine Recall@10
534
+ - type: cosine_ndcg@10
535
+ value: 0.44746749042985406
536
+ name: Cosine Ndcg@10
537
+ - type: cosine_ndcg@100
538
+ value: 0.5585225512719426
539
+ name: Cosine Ndcg@100
540
+ - type: cosine_mrr@10
541
+ value: 0.47298935393366487
542
+ name: Cosine Mrr@10
543
+ - type: cosine_mrr@100
544
+ value: 0.47991217157767396
545
+ name: Cosine Mrr@100
546
+ - type: cosine_map@10
547
+ value: 0.33037623162438684
548
+ name: Cosine Map@10
549
+ - type: cosine_map@100
550
+ value: 0.3769025263387124
551
+ name: Cosine Map@100
552
+ ---
553
+
554
+ # SentenceTransformer
555
+
556
+ This model was finetuned with [Unsloth](https://github.com/unslothai/unsloth).
557
+
558
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
559
+ based on IEITYuan/Yuan-embedding-2.0-zh
560
+
561
+ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [IEITYuan/Yuan-embedding-2.0-zh](https://huggingface.co/IEITYuan/Yuan-embedding-2.0-zh). It maps sentences & paragraphs to a 1792-dimensional dense vector space and can be used for retrieval.
562
+
563
+ ## Model Details
564
+
565
+ ### Model Description
566
+ - **Model Type:** Sentence Transformer
567
+ - **Base model:** [IEITYuan/Yuan-embedding-2.0-zh](https://huggingface.co/IEITYuan/Yuan-embedding-2.0-zh) <!-- at revision fb4ab1ed9d3447b64c79e305c8913340327668b5 -->
568
+ - **Maximum Sequence Length:** 512 tokens
569
+ - **Output Dimensionality:** 1792 dimensions
570
+ - **Similarity Function:** Cosine Similarity
571
+ - **Supported Modality:** Text
572
+ <!-- - **Training Dataset:** Unknown -->
573
+ <!-- - **Language:** Unknown -->
574
+ <!-- - **License:** Unknown -->
575
+
576
+ ### Model Sources
577
+
578
+ - **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
579
+ - **Repository:** [Sentence Transformers on GitHub](https://github.com/huggingface/sentence-transformers)
580
+ - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
581
+
582
+ ### Full Model Architecture
583
+
584
+ ```
585
+ SentenceTransformer(
586
+ (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'BertModel'})
587
+ (1): Pooling({'embedding_dimension': 1024, 'pooling_mode': 'mean', 'include_prompt': True})
588
+ (2): Dense({'in_features': 1024, 'out_features': 1792, 'bias': True, 'activation_function': 'torch.nn.modules.linear.Identity', 'module_input_name': 'sentence_embedding', 'module_output_name': 'sentence_embedding'})
589
+ )
590
+ ```
591
+
592
+ ## Usage
593
+
594
+ ### Direct Usage (Sentence Transformers)
595
+
596
+ First install the Sentence Transformers library:
597
+
598
+ ```bash
599
+ pip install -U sentence-transformers
600
+ ```
601
+ Then you can load this model and run inference.
602
+ ```python
603
+ from sentence_transformers import SentenceTransformer
604
+
605
+ # Download from the 🤗 Hub
606
+ model = SentenceTransformer("sentence_transformers_model_id")
607
+ # Run inference
608
+ queries = [
609
+ '上学文具分享',
610
+ ]
611
+ documents = [
612
+ '准初三生的书包里有啥😉👉🏻💗\n都是一些很真实的东西哈哈哈 \n我就问有谁懂…?\n#笔袋[话题]# #笔袋介绍[话题]# #我的文具分享[话题]# \n#晒晒我的书桌[话题]# #我的日常[话题]# \n#whatsinmybag[话题]# #书包里面装什么[话题]# \n#书包[话题]# ',
613
+ '下辈子我也要当仓鼠\n傻傻的胖胖的不知道悲伤……#珍藏的宠物照[话题]# #侏儒仓鼠[话题]# #鼠鼠教[话题]# #宠物[话题]# #宠物日常[话题]# ',
614
+ '云南丽江~ 束河古镇风景(上)\n拍于2023年11.19哦~\n从白沙坐公交去的束河古镇\n进门的时候忘记拍牌楼了[笑哭R]\n刚进门不久走到了茶马古道博物馆但是是关闭状态的\n不走人多的地方风景很不错\n图上那只松鼠的表情真的笑死\n看起来比香格里拉和雨崩的可爱\n建议沿着水流走 风景不会太差\n#云南[话题]# #云南游[话题]# #云南丽江[话题]# #束河古镇[话题]# ',
615
+ ]
616
+ query_embeddings = model.encode_query(queries)
617
+ document_embeddings = model.encode_document(documents)
618
+ print(query_embeddings.shape, document_embeddings.shape)
619
+ # [1, 1792] [3, 1792]
620
+
621
+ # Get the similarity scores for the embeddings
622
+ similarities = model.similarity(query_embeddings, document_embeddings)
623
+ print(similarities)
624
+ # tensor([[ 0.6349, 0.0464, -0.0339]])
625
+ ```
626
+ <!--
627
+ ### Direct Usage (Transformers)
628
+
629
+ <details><summary>Click to see the direct usage in Transformers</summary>
630
+
631
+ </details>
632
+ -->
633
+
634
+ <!--
635
+ ### Downstream Usage (Sentence Transformers)
636
+
637
+ You can finetune this model on your own dataset.
638
+
639
+ <details><summary>Click to expand</summary>
640
+
641
+ </details>
642
+ -->
643
+
644
+ <!--
645
+ ### Out-of-Scope Use
646
+
647
+ *List how the model may foreseeably be misused and address what users ought not to do with the model.*
648
+ -->
649
+
650
+ ## Evaluation
651
+
652
+ ### Metrics
653
+
654
+ #### Information Retrieval
655
+
656
+ * Datasets: `query_note_test` and `query_note_val`
657
+ * Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.sentence_transformer.evaluation.InformationRetrievalEvaluator)
658
+
659
+ | Metric | query_note_test | query_note_val |
660
+ |:--------------------|:----------------|:---------------|
661
+ | cosine_accuracy@1 | 0.2348 | 0.2973 |
662
+ | cosine_accuracy@3 | 0.4672 | 0.5942 |
663
+ | cosine_accuracy@5 | 0.5714 | 0.7298 |
664
+ | cosine_accuracy@10 | 0.692 | 0.8518 |
665
+ | cosine_precision@1 | 0.2348 | 0.2973 |
666
+ | cosine_precision@3 | 0.2016 | 0.2688 |
667
+ | cosine_precision@5 | 0.1751 | 0.2355 |
668
+ | cosine_precision@10 | 0.1343 | 0.1785 |
669
+ | cosine_recall@1 | 0.0896 | 0.1255 |
670
+ | cosine_recall@3 | 0.2128 | 0.3296 |
671
+ | cosine_recall@5 | 0.2908 | 0.4512 |
672
+ | cosine_recall@10 | 0.4044 | 0.6155 |
673
+ | cosine_ndcg@10 | 0.3137 | 0.4509 |
674
+ | **cosine_ndcg@100** | **0.4213** | **0.5626** |
675
+ | cosine_mrr@10 | 0.3759 | 0.474 |
676
+ | cosine_mrr@100 | 0.3858 | 0.4809 |
677
+ | cosine_map@10 | 0.2186 | 0.3328 |
678
+ | cosine_map@100 | 0.2541 | 0.3795 |
679
+
680
+ #### Information Retrieval
681
+
682
+ * Datasets: `query_note_test_256` and `query_note_val_256`
683
+ * Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.sentence_transformer.evaluation.InformationRetrievalEvaluator) with these parameters:
684
+ ```json
685
+ {
686
+ "truncate_dim": 256
687
+ }
688
+ ```
689
+
690
+ | Metric | query_note_test_256 | query_note_val_256 |
691
+ |:--------------------|:--------------------|:-------------------|
692
+ | cosine_accuracy@1 | 0.23 | 0.2964 |
693
+ | cosine_accuracy@3 | 0.4462 | 0.5932 |
694
+ | cosine_accuracy@5 | 0.5488 | 0.722 |
695
+ | cosine_accuracy@10 | 0.6691 | 0.8475 |
696
+ | cosine_precision@1 | 0.23 | 0.2964 |
697
+ | cosine_precision@3 | 0.1909 | 0.2668 |
698
+ | cosine_precision@5 | 0.1668 | 0.2333 |
699
+ | cosine_precision@10 | 0.1281 | 0.1764 |
700
+ | cosine_recall@1 | 0.0858 | 0.1259 |
701
+ | cosine_recall@3 | 0.203 | 0.328 |
702
+ | cosine_recall@5 | 0.2749 | 0.4473 |
703
+ | cosine_recall@10 | 0.3832 | 0.607 |
704
+ | cosine_ndcg@10 | 0.2988 | 0.4475 |
705
+ | **cosine_ndcg@100** | **0.402** | **0.5585** |
706
+ | cosine_mrr@10 | 0.3638 | 0.473 |
707
+ | cosine_mrr@100 | 0.374 | 0.4799 |
708
+ | cosine_map@10 | 0.2071 | 0.3304 |
709
+ | cosine_map@100 | 0.2398 | 0.3769 |
710
+
711
+ <!--
712
+ ## Bias, Risks and Limitations
713
+
714
+ *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
715
+ -->
716
+
717
+ <!--
718
+ ### Recommendations
719
+
720
+ *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
721
+ -->
722
+
723
+ ## Training Details
724
+
725
+ ### Training Dataset
726
+
727
+ #### Unnamed Dataset
728
+
729
+ * Size: 164,633 training samples
730
+ * Columns: <code>anchor</code> and <code>positive</code>
731
+ * Approximate statistics based on the first 100 samples:
732
+ | | anchor | positive |
733
+ |:---------|:---------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
734
+ | type | string | string |
735
+ | modality | text | text |
736
+ | details | <ul><li>min: 3 tokens</li><li>mean: 8.78 tokens</li><li>max: 17 tokens</li></ul> | <ul><li>min: 38 tokens</li><li>mean: 308.37 tokens</li><li>max: 512 tokens</li></ul> |
737
+ * Samples:
738
+ | anchor | positive |
739
+ |:-------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
740
+ | <code>jeep冲锋衣属于档次</code> | <code>🧥吉普冲锋衣,秋季必备🍂<br>Jeep吉普官方正品,品质有保障👍。 <br> <br>卡其色/M码,适合90-110斤,款式时尚百搭。 <br> <br>防风防水设计,适合户外活动,保暖又舒适😊。 <br> <br>秋季穿搭必备,你值得拥有! #小红书秋日焕新[话题]# #jeep[话题]# #冲锋衣[话题]# #秋季外套[话题]# #正品保证[话题]# #防风防水[话题]# #户外穿搭[话题]# #时尚百搭[话题]# #品质选择[话题]#</code> |
741
+ | <code>喝酒文案微醺</code> | <code>秋冬时刻需要威士忌 \| 见面吗?!<br>🍽️<br>属于我和先生的浪漫约会日常<br>便是放下孩子后的小酌怡情~<br> 刚好最近气温骤降,多了些凉意<br>想来一杯Whisky的心情达到上限<br> 🍽️<br>听闻格兰菲迪最近和MU·慕有出合作套餐<br>与先生的couple vacation时刻瞬间启动~<br>在轻奢环境下更适合开一瓶格兰菲迪22年单一麦芽苏格兰威士忌<br>@格兰菲迪 Glenfiddich <br>作为在全球屡获殊荣的单一麦芽苏格兰威士忌品牌<br>自诞生起就从未停止探索的脚步<br>不断探究威士忌与餐食搭配的新风味<br> 🍽️<br>当杯中深红琥珀色的酒体<br>在灯光下衬得更加迷人时<br>黑巧克力以及葡萄果干的浓郁香气也同时散发<br>象拔蚌和波士顿龙虾的上场<br>将视觉的色与口感的香瞬间突出<br>薄如刀片的爽脆蚌肉和Q弹龙虾肉<br>在酒精的碰撞下太立体太美好<br> <br>余韵的温润柑橘果香和馥郁水果蛋糕香<br>像是激情生活之后的源远流长<br>搭配新西兰羊排嫩多汁的奶香气息<br>像是被酒精注入新的灵感和层次<br> 🤎<br>婚后的微醺节奏<br>同样能拉近彼此的距离<br>大家也可以打卡格兰菲迪合作餐厅哦<br>用一杯格兰菲迪杯找寻浪漫~找寻生活吧<br>#广州探店[话题]# #福鹿结伴山海寻鲜[话题]# #威士忌推荐[话题]# #格兰菲迪[话题]# #格兰菲迪单一麦芽威士忌[话题]#</code> |
742
+ | <code>长沙酒吧</code> | <code>长沙一定要去的6️⃣大夜店!!!<br>长沙夜生活 蹦迪💃酒吧 再多的攻略都不及去亲身体验一次!!<br> <br>✅长沙一定要去的夜店❗️❗️<br>1️⃣X-sta:长沙最火爆的高空edm场 声光电体验感强 非常具有科技感 总投资1.8亿[赞R] 四五六楼是包厢 娱乐综合体<br>2️⃣one9:小厅bounce场 韩国江南风夜店 前身是火爆长沙的NBEK 喜欢小厅的朋友不要错过啦[派对R]<br>3️⃣FTF:新开业中型edm/bounce酒吧 位置在海信广场 以前的超级猴子[派对R]<br>4️⃣kok:网红爆品小厅 每晚都有男团演出与玩家们互动 人气也一直居高不下[自拍R]<br>5️⃣猩猩地堡:连锁品牌 打卡的人很多 长沙年轻人的聚集地<br>6️⃣试音:长沙hiphop吧天花板 嘉宾众多气氛火爆 值得打卡<br> <br>🌿住宿推荐<br>建议住五一广场/开���区万达广场(去哪都方便)<br> <br>⚠️温馨提示:想去长沙夜店玩的朋友记得提前做好攻略,提前找销售预约好门店避免排队!<br> <br>希望这些对您有所帮助!<br>图片来源于网络 侵删!<br>#长沙酒吧[话题]# #长沙酒吧推荐[话题]# #长沙酒吧订台[话题]# #长沙旅游[话题]# #长沙蹦迪[话题]#</code> |
743
+ * Loss: [<code>MatryoshkaLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#matryoshkaloss) with these parameters:
744
+ ```json
745
+ {
746
+ "loss": "MultipleNegativesRankingLoss",
747
+ "matryoshka_dims": [
748
+ 1024,
749
+ 256
750
+ ],
751
+ "matryoshka_weights": [
752
+ 1,
753
+ 1
754
+ ],
755
+ "n_dims_per_step": -1
756
+ }
757
+ ```
758
+
759
+ ### Training Hyperparameters
760
+ #### Non-Default Hyperparameters
761
+
762
+ - `per_device_train_batch_size`: 256
763
+ - `learning_rate`: 0.0001
764
+ - `weight_decay`: 0.01
765
+ - `num_train_epochs`: 1
766
+ - `lr_scheduler_type`: cosine
767
+ - `warmup_ratio`: 0.05
768
+ - `seed`: 3407
769
+ - `bf16`: True
770
+ - `batch_sampler`: no_duplicates
771
+
772
+ #### All Hyperparameters
773
+ <details><summary>Click to expand</summary>
774
+
775
+ - `overwrite_output_dir`: False
776
+ - `do_predict`: False
777
+ - `prediction_loss_only`: True
778
+ - `per_device_train_batch_size`: 256
779
+ - `per_device_eval_batch_size`: 8
780
+ - `per_gpu_train_batch_size`: None
781
+ - `per_gpu_eval_batch_size`: None
782
+ - `gradient_accumulation_steps`: 1
783
+ - `eval_accumulation_steps`: None
784
+ - `torch_empty_cache_steps`: None
785
+ - `learning_rate`: 0.0001
786
+ - `weight_decay`: 0.01
787
+ - `adam_beta1`: 0.9
788
+ - `adam_beta2`: 0.999
789
+ - `adam_epsilon`: 1e-08
790
+ - `max_grad_norm`: 1.0
791
+ - `num_train_epochs`: 1
792
+ - `max_steps`: -1
793
+ - `lr_scheduler_type`: cosine
794
+ - `lr_scheduler_kwargs`: {}
795
+ - `warmup_ratio`: 0.05
796
+ - `warmup_steps`: 0
797
+ - `log_level`: passive
798
+ - `log_level_replica`: warning
799
+ - `log_on_each_node`: True
800
+ - `logging_nan_inf_filter`: True
801
+ - `save_safetensors`: True
802
+ - `save_on_each_node`: False
803
+ - `save_only_model`: False
804
+ - `restore_callback_states_from_checkpoint`: False
805
+ - `no_cuda`: False
806
+ - `use_cpu`: False
807
+ - `use_mps_device`: False
808
+ - `seed`: 3407
809
+ - `data_seed`: None
810
+ - `jit_mode_eval`: False
811
+ - `use_ipex`: False
812
+ - `bf16`: True
813
+ - `fp16`: False
814
+ - `fp16_opt_level`: O1
815
+ - `half_precision_backend`: auto
816
+ - `bf16_full_eval`: False
817
+ - `fp16_full_eval`: False
818
+ - `tf32`: None
819
+ - `local_rank`: 0
820
+ - `ddp_backend`: None
821
+ - `tpu_num_cores`: None
822
+ - `tpu_metrics_debug`: False
823
+ - `debug`: []
824
+ - `dataloader_drop_last`: False
825
+ - `dataloader_num_workers`: 0
826
+ - `dataloader_prefetch_factor`: None
827
+ - `past_index`: -1
828
+ - `disable_tqdm`: False
829
+ - `remove_unused_columns`: True
830
+ - `label_names`: None
831
+ - `load_best_model_at_end`: False
832
+ - `ignore_data_skip`: False
833
+ - `fsdp`: []
834
+ - `fsdp_min_num_params`: 0
835
+ - `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
836
+ - `fsdp_transformer_layer_cls_to_wrap`: None
837
+ - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
838
+ - `parallelism_config`: None
839
+ - `deepspeed`: None
840
+ - `label_smoothing_factor`: 0.0
841
+ - `optim`: adamw_torch_fused
842
+ - `optim_args`: None
843
+ - `adafactor`: False
844
+ - `group_by_length`: False
845
+ - `length_column_name`: length
846
+ - `ddp_find_unused_parameters`: None
847
+ - `ddp_bucket_cap_mb`: None
848
+ - `ddp_broadcast_buffers`: False
849
+ - `dataloader_pin_memory`: True
850
+ - `dataloader_persistent_workers`: False
851
+ - `skip_memory_metrics`: True
852
+ - `use_legacy_prediction_loop`: False
853
+ - `push_to_hub`: False
854
+ - `resume_from_checkpoint`: None
855
+ - `hub_model_id`: None
856
+ - `hub_strategy`: every_save
857
+ - `hub_private_repo`: None
858
+ - `hub_always_push`: False
859
+ - `hub_revision`: None
860
+ - `gradient_checkpointing`: False
861
+ - `gradient_checkpointing_kwargs`: None
862
+ - `include_inputs_for_metrics`: False
863
+ - `include_for_metrics`: []
864
+ - `eval_do_concat_batches`: True
865
+ - `fp16_backend`: auto
866
+ - `push_to_hub_model_id`: None
867
+ - `push_to_hub_organization`: None
868
+ - `mp_parameters`:
869
+ - `auto_find_batch_size`: False
870
+ - `full_determinism`: False
871
+ - `torchdynamo`: None
872
+ - `ray_scope`: last
873
+ - `ddp_timeout`: 1800
874
+ - `torch_compile`: False
875
+ - `torch_compile_backend`: None
876
+ - `torch_compile_mode`: None
877
+ - `include_tokens_per_second`: False
878
+ - `include_num_input_tokens_seen`: False
879
+ - `neftune_noise_alpha`: None
880
+ - `optim_target_modules`: None
881
+ - `batch_eval_metrics`: False
882
+ - `eval_on_start`: False
883
+ - `use_liger_kernel`: False
884
+ - `liger_kernel_config`: None
885
+ - `eval_use_gather_object`: False
886
+ - `average_tokens_across_devices`: False
887
+ - `prompts`: None
888
+ - `batch_sampler`: no_duplicates
889
+ - `multi_dataset_batch_sampler`: proportional
890
+ - `router_mapping`: {}
891
+ - `learning_rate_mapping`: {}
892
+
893
+ </details>
894
+
895
+ ### Training Logs
896
+ | Epoch | Step | Training Loss | query_note_test_cosine_ndcg@100 | query_note_test_256_cosine_ndcg@100 | query_note_val_cosine_ndcg@100 | query_note_val_256_cosine_ndcg@100 |
897
+ |:------:|:----:|:-------------:|:-------------------------------:|:-----------------------------------:|:------------------------------:|:----------------------------------:|
898
+ | -1 | -1 | - | 0.4213 | 0.4020 | - | - |
899
+ | 0.0155 | 10 | 3.6018 | - | - | - | - |
900
+ | 0.0311 | 20 | 2.5033 | - | - | - | - |
901
+ | 0.0466 | 30 | 1.1976 | - | - | - | - |
902
+ | 0.0621 | 40 | 1.0096 | - | - | - | - |
903
+ | 0.0776 | 50 | 0.8353 | - | - | - | - |
904
+ | 0.0932 | 60 | 0.8335 | - | - | - | - |
905
+ | 0.1087 | 70 | 0.8197 | - | - | - | - |
906
+ | 0.1242 | 80 | 0.7655 | - | - | - | - |
907
+ | 0.1398 | 90 | 0.7013 | - | - | - | - |
908
+ | 0.1553 | 100 | 0.7359 | - | - | - | - |
909
+ | 0.1708 | 110 | 0.7523 | - | - | - | - |
910
+ | 0.1863 | 120 | 0.7146 | - | - | - | - |
911
+ | 0.2019 | 130 | 0.7609 | - | - | - | - |
912
+ | 0.2174 | 140 | 0.751 | - | - | - | - |
913
+ | 0.2329 | 150 | 0.6394 | - | - | - | - |
914
+ | 0.2484 | 160 | 0.7417 | - | - | - | - |
915
+ | 0.2640 | 170 | 0.7253 | - | - | - | - |
916
+ | 0.2795 | 180 | 0.7553 | - | - | - | - |
917
+ | 0.2950 | 190 | 0.681 | - | - | - | - |
918
+ | 0.3106 | 200 | 0.6562 | - | - | - | - |
919
+ | 0.3261 | 210 | 0.5938 | - | - | - | - |
920
+ | 0.3416 | 220 | 0.6074 | - | - | - | - |
921
+ | 0.3571 | 230 | 0.6752 | - | - | - | - |
922
+ | 0.3727 | 240 | 0.6051 | - | - | - | - |
923
+ | 0.3882 | 250 | 0.7016 | - | - | - | - |
924
+ | 0.4037 | 260 | 0.6432 | - | - | - | - |
925
+ | 0.4193 | 270 | 0.656 | - | - | - | - |
926
+ | 0.4348 | 280 | 0.5781 | - | - | - | - |
927
+ | 0.4503 | 290 | 0.5972 | - | - | - | - |
928
+ | 0.4658 | 300 | 0.6699 | - | - | - | - |
929
+ | 0.4814 | 310 | 0.6081 | - | - | - | - |
930
+ | 0.4969 | 320 | 0.6143 | - | - | - | - |
931
+ | 0.5124 | 330 | 0.657 | - | - | - | - |
932
+ | 0.5280 | 340 | 0.6711 | - | - | - | - |
933
+ | 0.5435 | 350 | 0.6589 | - | - | - | - |
934
+ | 0.5590 | 360 | 0.6388 | - | - | - | - |
935
+ | 0.5745 | 370 | 0.5856 | - | - | - | - |
936
+ | 0.5901 | 380 | 0.6781 | - | - | - | - |
937
+ | 0.6056 | 390 | 0.6044 | - | - | - | - |
938
+ | 0.6211 | 400 | 0.5893 | - | - | - | - |
939
+ | 0.6366 | 410 | 0.6496 | - | - | - | - |
940
+ | 0.6522 | 420 | 0.6423 | - | - | - | - |
941
+ | 0.6677 | 430 | 0.6304 | - | - | - | - |
942
+ | 0.6832 | 440 | 0.6052 | - | - | - | - |
943
+ | 0.6988 | 450 | 0.6767 | - | - | - | - |
944
+ | 0.7143 | 460 | 0.6036 | - | - | - | - |
945
+ | 0.7298 | 470 | 0.6324 | - | - | - | - |
946
+ | 0.7453 | 480 | 0.6036 | - | - | - | - |
947
+ | 0.7609 | 490 | 0.5681 | - | - | - | - |
948
+ | 0.7764 | 500 | 0.5643 | - | - | - | - |
949
+ | 0.7919 | 510 | 0.6016 | - | - | - | - |
950
+ | 0.8075 | 520 | 0.6362 | - | - | - | - |
951
+ | 0.8230 | 530 | 0.601 | - | - | - | - |
952
+ | 0.8385 | 540 | 0.5468 | - | - | - | - |
953
+ | 0.8540 | 550 | 0.5602 | - | - | - | - |
954
+ | 0.8696 | 560 | 0.6183 | - | - | - | - |
955
+ | 0.8851 | 570 | 0.5713 | - | - | - | - |
956
+ | 0.9006 | 580 | 0.59 | - | - | - | - |
957
+ | 0.9161 | 590 | 0.5639 | - | - | - | - |
958
+ | 0.9317 | 600 | 0.5733 | - | - | - | - |
959
+ | 0.9472 | 610 | 0.5941 | - | - | - | - |
960
+ | 0.9627 | 620 | 0.6197 | - | - | - | - |
961
+ | 0.9783 | 630 | 0.6259 | - | - | - | - |
962
+ | 0.9938 | 640 | 0.5718 | - | - | - | - |
963
+ | 1.0 | 644 | - | - | - | 0.5626 | 0.5585 |
964
+
965
+
966
+ ### Training Time
967
+ - **Training**: 48.8 minutes
968
+
969
+ ### Framework Versions
970
+ - Python: 3.12.3
971
+ - Sentence Transformers: 5.5.1
972
+ - Transformers: 4.56.2
973
+ - PyTorch: 2.11.0+cu128
974
+ - Accelerate: 1.13.0
975
+ - Datasets: 4.3.0
976
+ - Tokenizers: 0.22.2
977
+
978
+ ## Citation
979
+
980
+ ### BibTeX
981
+
982
+ #### Sentence Transformers
983
+ ```bibtex
984
+ @inproceedings{reimers-2019-sentence-bert,
985
+ title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
986
+ author = "Reimers, Nils and Gurevych, Iryna",
987
+ booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
988
+ month = "11",
989
+ year = "2019",
990
+ publisher = "Association for Computational Linguistics",
991
+ url = "https://arxiv.org/abs/1908.10084",
992
+ }
993
+ ```
994
+
995
+ #### MatryoshkaLoss
996
+ ```bibtex
997
+ @misc{kusupati2024matryoshka,
998
+ title={Matryoshka Representation Learning},
999
+ author={Aditya Kusupati and Gantavya Bhatt and Aniket Rege and Matthew Wallingford and Aditya Sinha and Vivek Ramanujan and William Howard-Snyder and Kaifeng Chen and Sham Kakade and Prateek Jain and Ali Farhadi},
1000
+ year={2024},
1001
+ eprint={2205.13147},
1002
+ archivePrefix={arXiv},
1003
+ primaryClass={cs.LG}
1004
+ }
1005
+ ```
1006
+
1007
+ #### MultipleNegativesRankingLoss
1008
+ ```bibtex
1009
+ @misc{oord2019representationlearningcontrastivepredictive,
1010
+ title={Representation Learning with Contrastive Predictive Coding},
1011
+ author={Aaron van den Oord and Yazhe Li and Oriol Vinyals},
1012
+ year={2019},
1013
+ eprint={1807.03748},
1014
+ archivePrefix={arXiv},
1015
+ primaryClass={cs.LG},
1016
+ url={https://arxiv.org/abs/1807.03748},
1017
+ }
1018
+ ```
1019
+
1020
+ <!--
1021
+ ## Glossary
1022
+
1023
+ *Clearly define terms in order to be accessible across audiences.*
1024
+ -->
1025
+
1026
+ <!--
1027
+ ## Model Card Authors
1028
+
1029
+ *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
1030
+ -->
1031
+
1032
+ <!--
1033
+ ## Model Card Contact
1034
+
1035
+ *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
1036
+ -->
config.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "BertModel"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "classifier_dropout": null,
7
+ "directionality": "bidi",
8
+ "dtype": "bfloat16",
9
+ "gradient_checkpointing": false,
10
+ "hidden_act": "gelu",
11
+ "hidden_dropout_prob": 0.1,
12
+ "hidden_size": 1024,
13
+ "initializer_range": 0.02,
14
+ "intermediate_size": 4096,
15
+ "layer_norm_eps": 1e-12,
16
+ "max_position_embeddings": 512,
17
+ "model_type": "bert",
18
+ "num_attention_heads": 16,
19
+ "num_hidden_layers": 24,
20
+ "pad_token_id": 0,
21
+ "position_embedding_type": "absolute",
22
+ "transformers_version": "4.56.2",
23
+ "type_vocab_size": 2,
24
+ "use_cache": true,
25
+ "vocab_size": 21128
26
+ }
config_sentence_transformers.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "__version__": {
3
+ "pytorch": "2.11.0+cu128",
4
+ "sentence_transformers": "5.5.1",
5
+ "transformers": "4.56.2"
6
+ },
7
+ "default_prompt_name": null,
8
+ "model_type": "SentenceTransformer",
9
+ "prompts": {
10
+ "document": "",
11
+ "query": ""
12
+ },
13
+ "similarity_fn_name": "cosine"
14
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5df8283c0c2b7e8b25ae25445f315ba6086b8f35e74d67dfdd4779fbcef0d986
3
+ size 679572832
modules.json ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "idx": 0,
4
+ "name": "0",
5
+ "path": "",
6
+ "type": "sentence_transformers.base.modules.transformer.Transformer"
7
+ },
8
+ {
9
+ "idx": 1,
10
+ "name": "1",
11
+ "path": "1_Pooling",
12
+ "type": "sentence_transformers.sentence_transformer.modules.pooling.Pooling"
13
+ },
14
+ {
15
+ "idx": 2,
16
+ "name": "2",
17
+ "path": "2_Dense",
18
+ "type": "sentence_transformers.base.modules.dense.Dense"
19
+ }
20
+ ]
sentence_bert_config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "transformer_task": "feature-extraction",
3
+ "modality_config": {
4
+ "text": {
5
+ "method": "forward",
6
+ "method_output_name": "last_hidden_state"
7
+ }
8
+ },
9
+ "module_output_name": "token_embeddings"
10
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": {
3
+ "content": "[CLS]",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "mask_token": {
10
+ "content": "[MASK]",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "[PAD]",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "sep_token": {
24
+ "content": "[SEP]",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "unk_token": {
31
+ "content": "[UNK]",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ }
37
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": true,
45
+ "cls_token": "[CLS]",
46
+ "do_basic_tokenize": true,
47
+ "do_lower_case": true,
48
+ "extra_special_tokens": {},
49
+ "mask_token": "[MASK]",
50
+ "max_length": 512,
51
+ "model_max_length": 512,
52
+ "never_split": null,
53
+ "pad_to_multiple_of": null,
54
+ "pad_token": "[PAD]",
55
+ "pad_token_type_id": 0,
56
+ "padding_side": "right",
57
+ "sep_token": "[SEP]",
58
+ "stride": 0,
59
+ "strip_accents": null,
60
+ "tokenize_chinese_chars": true,
61
+ "tokenizer_class": "BertTokenizer",
62
+ "truncation_side": "right",
63
+ "truncation_strategy": "longest_first",
64
+ "unk_token": "[UNK]"
65
+ }
vocab.txt ADDED
The diff for this file is too large to render. See raw diff