Stergios-Konstantinidis commited on
Commit
2695b3b
·
verified ·
1 Parent(s): 4153dc6

Add new SentenceTransformer model

Browse files
1_Pooling/config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "word_embedding_dimension": 384,
3
+ "pooling_mode_cls_token": false,
4
+ "pooling_mode_mean_tokens": true,
5
+ "pooling_mode_max_tokens": false,
6
+ "pooling_mode_mean_sqrt_len_tokens": false,
7
+ "pooling_mode_weightedmean_tokens": false,
8
+ "pooling_mode_lasttoken": false,
9
+ "include_prompt": true
10
+ }
README.md ADDED
@@ -0,0 +1,808 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - sentence-transformers
4
+ - sentence-similarity
5
+ - feature-extraction
6
+ - generated_from_trainer
7
+ - dataset_size:21000
8
+ - loss:ContrastiveTensionLoss
9
+ base_model: sentence-transformers/all-MiniLM-L6-v2
10
+ widget:
11
+ - source_sentence: ' "The lemma follows by invoking Lemma 4.1 and Lemma A.1.\n\u220e",'
12
+ sentences:
13
+ - ' "To better address non-stationarity with changing uncertainty, we introduce
14
+ Location-Scale Noise Model (LSNM) into DDPMs, which relaxes the traditional Additive
15
+ Noise Model (ANM) by incorporating a contextually changing variance: \ud835\udc18=f\u2062(\ud835\udc17)+g\u2062(\ud835\udc17)\u2062\u03f5\ud835\udc18\ud835\udc53\ud835\udc17\ud835\udc54\ud835\udc17bold-italic-\u03f5\\mathbf{Y}=f(\\mathbf{X})+\\sqrt{g(\\mathbf{X})}\\boldsymbol{\\epsilon}bold_Y
16
+ = italic_f ( bold_X ) + square-root start_ARG italic_g ( bold_X ) end_ARG bold_italic_\u03f5,
17
+ where g\u2062(\ud835\udc17)\ud835\udc54\ud835\udc17g(\\mathbf{X})italic_g ( bold_X
18
+ ) is an \ud835\udc17\ud835\udc17\\mathbf{X}bold_X-dependent variance model. LSNM
19
+ is capable of modeling both the contextual mean through f\u2062(\ud835\udc17)\ud835\udc53\ud835\udc17f(\\mathbf{X})italic_f
20
+ ( bold_X ) and the contextual uncertainty through g\u2062(\ud835\udc17)\ud835\udc54\ud835\udc17\\sqrt{g(\\mathbf{X})}square-root
21
+ start_ARG italic_g ( bold_X ) end_ARG. In the special case where g\u2062(\ud835\udc17)\u22611\ud835\udc54\ud835\udc171g(\\mathbf{X})\\equiv
22
+ 1italic_g ( bold_X ) \u2261 1, this simplifies to the standard ANM. Building upon
23
+ this more flexible and expressive assumption, we propose the Non-stationary Diffusion
24
+ Model (NsDiff) framework, which provides an uncertainty-aware noise schedule for
25
+ both forward and reverse diffusion processes. In summary, our contributions are
26
+ as:\n\n\n\u2022\n\nWe observe that the ANM is inadequate for capturing the varying
27
+ uncertainty and propose a novel framework that integrates LSNM to allow for explict
28
+ uncertainty modeling. This work is the first attempt to introduce LSNM into probabilistic
29
+ time series forecasting.\n\n\n\n\u2022\n\nTo fundamentally elevate the noise modeling
30
+ capabilities of DDPM, we seamlessly integrate time-varying variances into the
31
+ core diffusion process through an uncertainty-aware noise schedule that dynamically
32
+ adapts the noise variance at each step.\n\n\n\n\n\u2022\n\nExperimental results
33
+ indicate that NsDiff achieves superior performance in capturing uncertainty. Specifically,
34
+ in comparison to the second-best recent baseline TMDM, NsDiff improves up to 66.3%
35
+ on real-world datasets and 88.3% on synthetic datasets.",'
36
+ - ' "The deep neural network representation of the Bifrost simulations is
37
+ highly compressed compared to the original Bifrost data: the deep neural network
38
+ has 44,261 floating point values whereas the Bifrost simulation cube has 96\u22c596\u22c564\u22c520=11,796,480\u22c5969664201179648096\\cdot
39
+ 96\\cdot 64\\cdot 20=11,796,48096 \u22c5 96 \u22c5 64 \u22c5 20 = 11 , 796 , 480
40
+ floating point values. This corresponds to a compression by a factor of 267; this
41
+ compression factor may be different for other numerical simulations and depends
42
+ on their smoothness. In addition, the deep neural network can be evaluated at
43
+ any point in space and time covered by the simulations, therefore enabling a trivial
44
+ way to interpolate between grid points; furthermore, gradients are calculate with
45
+ high efficiency with automatic differentiation. As such, it might be worth considering
46
+ releasing deep-neural-network representations of (magneto)hydrodynamic simulations.",'
47
+ - ' "\u03f5y\u2062(\u03bc)={1nt\u2062\u2211i=nkntey\u2062(ti,\u03bc)=1nt\u2062\u2211i=nknt|y~\u2062(ti,\u03bc)\u2212y\u2062(ti,\u03bc)|if\u00a0\u20621nt\u2062\u2211i=nknt|y\u2062(ti,\u03bc)|\u22641,1nt\u2062\u2211i=nkntey,r\u2062e\u2062l\u2062(ti,\u03bc)=1nt\u2062\u2211i=nknt|y~\u2062(ti,\u03bc)\u2212y\u2062(ti,\u03bc)|/|y\u2062(ti,\u03bc)|if\u00a0\u20621nt\u2062\u2211i=nknt|y\u2062(ti,\u03bc)|>1.subscriptitalic-\u03f5\ud835\udc66\ud835\udf07cases1subscript\ud835\udc5b\ud835\udc61superscriptsubscript\ud835\udc56subscript\ud835\udc5b\ud835\udc58subscript\ud835\udc5b\ud835\udc61subscript\ud835\udc52\ud835\udc66subscript\ud835\udc61\ud835\udc56\ud835\udf071subscript\ud835\udc5b\ud835\udc61superscriptsubscript\ud835\udc56subscript\ud835\udc5b\ud835\udc58subscript\ud835\udc5b\ud835\udc61~\ud835\udc66subscript\ud835\udc61\ud835\udc56\ud835\udf07\ud835\udc66subscript\ud835\udc61\ud835\udc56\ud835\udf07if\u00a01subscript\ud835\udc5b\ud835\udc61superscriptsubscript\ud835\udc56subscript\ud835\udc5b\ud835\udc58subscript\ud835\udc5b\ud835\udc61\ud835\udc66subscript\ud835\udc61\ud835\udc56\ud835\udf0711subscript\ud835\udc5b\ud835\udc61superscriptsubscript\ud835\udc56subscript\ud835\udc5b\ud835\udc58subscript\ud835\udc5b\ud835\udc61subscript\ud835\udc52\ud835\udc66\ud835\udc5f\ud835\udc52\ud835\udc59subscript\ud835\udc61\ud835\udc56\ud835\udf071subscript\ud835\udc5b\ud835\udc61superscriptsubscript\ud835\udc56subscript\ud835\udc5b\ud835\udc58subscript\ud835\udc5b\ud835\udc61~\ud835\udc66subscript\ud835\udc61\ud835\udc56\ud835\udf07\ud835\udc66subscript\ud835\udc61\ud835\udc56\ud835\udf07\ud835\udc66subscript\ud835\udc61\ud835\udc56\ud835\udf07if\u00a01subscript\ud835\udc5b\ud835\udc61superscriptsubscript\ud835\udc56subscript\ud835\udc5b\ud835\udc58subscript\ud835\udc5b\ud835\udc61\ud835\udc66subscript\ud835\udc61\ud835\udc56\ud835\udf071\\centering\\epsilon_{y}(\\mu)=\\begin{cases}\\frac{1}{n_{t}}\\sum\\limits_{i=n_{k}}^%\n{n_{t}}e_{y}(t_{i},\\mu)=\\frac{1}{n_{t}}\\sum\\limits_{i=n_{k}}^{n_{t}}|\\tilde{y}%\n(t_{i},\\mu)-y(t_{i},\\mu)|&\\text{if
48
+ }\\frac{1}{n_{t}}\\sum\\limits_{i=n_{k}}^{n_{t%\n}}|y(t_{i},\\mu)|\\leq 1,\\\\\n\\frac{1}{n_{t}}\\sum\\limits_{i=n_{k}}^{n_{t}}e_{y,rel}(t_{i},\\mu)=\\frac{1}{n_{t%\n}}\\sum\\limits_{i=n_{k}}^{n_{t}}|\\tilde{y}(t_{i},\\mu)-y(t_{i},\\mu)|/|y(t_{i},%\n\\mu)|&\\text{if
49
+ }\\frac{1}{n_{t}}\\sum\\limits_{i=n_{k}}^{n_{t}}|y(t_{i},\\mu)|>1.%\n\\end{cases}\\@add@centeringitalic_\u03f5
50
+ start_POSTSUBSCRIPT italic_y end_POSTSUBSCRIPT ( italic_\u03bc ) = { start_ROW
51
+ start_CELL divide start_ARG 1 end_ARG start_ARG italic_n start_POSTSUBSCRIPT italic_t
52
+ end_POSTSUBSCRIPT end_ARG \u2211 start_POSTSUBSCRIPT italic_i = italic_n start_POSTSUBSCRIPT
53
+ italic_k end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_n start_POSTSUBSCRIPT
54
+ italic_t end_POSTSUBSCRIPT end_POSTSUPERSCRIPT italic_e start_POSTSUBSCRIPT italic_y
55
+ end_POSTSUBSCRIPT ( italic_t start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT ,
56
+ italic_\u03bc ) = divide start_ARG 1 end_ARG start_ARG italic_n start_POSTSUBSCRIPT
57
+ italic_t end_POSTSUBSCRIPT end_ARG \u2211 start_POSTSUBSCRIPT italic_i = italic_n
58
+ start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT end_POSTSUBSCRIPT start_POSTSUPERSCRIPT
59
+ italic_n start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_POSTSUPERSCRIPT |
60
+ over~ start_ARG italic_y end_ARG ( italic_t start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT
61
+ , italic_\u03bc ) - italic_y ( italic_t start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT
62
+ , italic_\u03bc ) | end_CELL start_CELL if divide start_ARG 1 end_ARG start_ARG
63
+ italic_n start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG \u2211 start_POSTSUBSCRIPT
64
+ italic_i = italic_n start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT end_POSTSUBSCRIPT
65
+ start_POSTSUPERSCRIPT italic_n start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT
66
+ end_POSTSUPERSCRIPT | italic_y ( italic_t start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT
67
+ , italic_\u03bc ) | \u2264 1 , end_CELL end_ROW start_ROW start_CELL divide start_ARG
68
+ 1 end_ARG start_ARG italic_n start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG
69
+ \u2211 start_POSTSUBSCRIPT italic_i = italic_n start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT
70
+ end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_n start_POSTSUBSCRIPT italic_t
71
+ end_POSTSUBSCRIPT end_POSTSUPERSCRIPT italic_e start_POSTSUBSCRIPT italic_y ,
72
+ italic_r italic_e italic_l end_POSTSUBSCRIPT ( italic_t start_POSTSUBSCRIPT italic_i
73
+ end_POSTSUBSCRIPT , italic_\u03bc ) = divide start_ARG 1 end_ARG start_ARG italic_n
74
+ start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG \u2211 start_POSTSUBSCRIPT
75
+ italic_i = italic_n start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT end_POSTSUBSCRIPT
76
+ start_POSTSUPERSCRIPT italic_n start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT
77
+ end_POSTSUPERSCRIPT | over~ start_ARG italic_y end_ARG ( italic_t start_POSTSUBSCRIPT
78
+ italic_i end_POSTSUBSCRIPT , italic_\u03bc ) - italic_y ( italic_t start_POSTSUBSCRIPT
79
+ italic_i end_POSTSUBSCRIPT , italic_\u03bc ) | / | italic_y ( italic_t start_POSTSUBSCRIPT
80
+ italic_i end_POSTSUBSCRIPT , italic_\u03bc ) | end_CELL start_CELL if divide start_ARG
81
+ 1 end_ARG start_ARG italic_n start_POSTSUBSCRIPT italic_t end_POSTSUBSCRIPT end_ARG
82
+ \u2211 start_POSTSUBSCRIPT italic_i = italic_n start_POSTSUBSCRIPT italic_k end_POSTSUBSCRIPT
83
+ end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_n start_POSTSUBSCRIPT italic_t
84
+ end_POSTSUBSCRIPT end_POSTSUPERSCRIPT | italic_y ( italic_t start_POSTSUBSCRIPT
85
+ italic_i end_POSTSUBSCRIPT , italic_\u03bc ) | > 1 . end_CELL end_ROW\n\n(12)",'
86
+ - source_sentence: ' "While significant research addresses design tolerance
87
+ optimisation in manufacturing, there is very little focus on production inspection
88
+ machines such as AOIs for manufactured products. For AOIs inspecting PCBs, each
89
+ component may demand a distinct tolerance for each type of inspection, leading
90
+ to thousands of possible scenarios. Consequently, a general paradigm is needed
91
+ that accommodates inspection of all components, including new introductions that
92
+ the system has not previously encountered.",'
93
+ sentences:
94
+ - ' "Indeed, for any e\u2208D0\ud835\udc52subscript\ud835\udc370e\\in D_{0}italic_e
95
+ \u2208 italic_D start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT, there exists a \u03b4\ud835\udeff\\deltaitalic_\u03b4-tube
96
+ Te\u03b4\u2062(ae)subscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udc52subscript\ud835\udc4e\ud835\udc52T^{\\delta}_{e}(a_{e})italic_T
97
+ start_POSTSUPERSCRIPT italic_\u03b4 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_e
98
+ end_POSTSUBSCRIPT ( italic_a start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT )
99
+ centred at some ae\u2208Asubscript\ud835\udc4e\ud835\udc52\ud835\udc34a_{e}\\in
100
+ Aitalic_a start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT \u2208 italic_A such
101
+ that\n\n\n\n1|Te\u03b4\u2062(ae)|n\u2062|E\u2229Te\u03b4\u2062(ae)|n>\u03bb.1subscriptsubscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udc52subscript\ud835\udc4e\ud835\udc52\ud835\udc5bsubscript\ud835\udc38subscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udc52subscript\ud835\udc4e\ud835\udc52\ud835\udc5b\ud835\udf06\\frac{1}{\\left|T^{\\delta}_{e}(a_{e})\\right|_{n}}\\left|E\\cap
102
+ T^{\\delta}_{e}(a_{%\ne})\\right|_{n}>\\lambda.divide start_ARG 1 end_ARG start_ARG
103
+ | italic_T start_POSTSUPERSCRIPT italic_\u03b4 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT
104
+ italic_e end_POSTSUBSCRIPT ( italic_a start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT
105
+ ) | start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG | italic_E \u2229 italic_T
106
+ start_POSTSUPERSCRIPT italic_\u03b4 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_e
107
+ end_POSTSUBSCRIPT ( italic_a start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT )
108
+ | start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT > italic_\u03bb .\n\n\n\nSince
109
+ Emsubscript\ud835\udc38\ud835\udc5aE_{m}italic_E start_POSTSUBSCRIPT italic_m
110
+ end_POSTSUBSCRIPT and E\u00af\u00af\ud835\udc38\\overline{E}over\u00af start_ARG
111
+ italic_E end_ARG form a partition of E\ud835\udc38Eitalic_E, we obtain\n\n\n\n1|Te\u03b4\u2062(ae)|n\u2062|Em\u2229Te\u03b4\u2062(ae)|n+1|Te\u03b4\u2062(ae)|n\u2062|E\u00af\u2229Te\u03b4\u2062(ae)|n>\u03bb.1subscriptsubscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udc52subscript\ud835\udc4e\ud835\udc52\ud835\udc5bsubscriptsubscript\ud835\udc38\ud835\udc5asubscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udc52subscript\ud835\udc4e\ud835\udc52\ud835\udc5b1subscriptsubscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udc52subscript\ud835\udc4e\ud835\udc52\ud835\udc5bsubscript\u00af\ud835\udc38subscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udc52subscript\ud835\udc4e\ud835\udc52\ud835\udc5b\ud835\udf06\\frac{1}{\\left|T^{\\delta}_{e}(a_{e})\\right|_{n}}\\left|E_{m}\\cap
112
+ T^{\\delta}_{e}%\n(a_{e})\\right|_{n}+\\frac{1}{\\left|T^{\\delta}_{e}(a_{e})\\right|_{n}}\\left|%\n\\overline{E}\\cap
113
+ T^{\\delta}_{e}(a_{e})\\right|_{n}>\\lambda.divide start_ARG 1 end_ARG start_ARG
114
+ | italic_T start_POSTSUPERSCRIPT italic_\u03b4 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT
115
+ italic_e end_POSTSUBSCRIPT ( italic_a start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT
116
+ ) | start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG | italic_E start_POSTSUBSCRIPT
117
+ italic_m end_POSTSUBSCRIPT \u2229 italic_T start_POSTSUPERSCRIPT italic_\u03b4
118
+ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ( italic_a
119
+ start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) | start_POSTSUBSCRIPT italic_n
120
+ end_POSTSUBSCRIPT + divide start_ARG 1 end_ARG start_ARG | italic_T start_POSTSUPERSCRIPT
121
+ italic_\u03b4 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT
122
+ ( italic_a start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT ) | start_POSTSUBSCRIPT
123
+ italic_n end_POSTSUBSCRIPT end_ARG | over\u00af start_ARG italic_E end_ARG \u2229
124
+ italic_T start_POSTSUPERSCRIPT italic_\u03b4 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT
125
+ italic_e end_POSTSUBSCRIPT ( italic_a start_POSTSUBSCRIPT italic_e end_POSTSUBSCRIPT
126
+ ) | start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT > italic_\u03bb .\n\n\n\nThus,
127
+ at least one of the terms on the left-hand side must be greater than \u03bb2\ud835\udf062\\frac{\\lambda}{2}divide
128
+ start_ARG italic_\u03bb end_ARG start_ARG 2 end_ARG, implying e\u2208Dm\u222aD\u00af\ud835\udc52subscript\ud835\udc37\ud835\udc5a\u00af\ud835\udc37e\\in
129
+ D_{m}\\cup\\overline{D}italic_e \u2208 italic_D start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT
130
+ \u222a over\u00af start_ARG italic_D end_ARG from the definition (3.14) and (3.19).
131
+ Since\n\n\n\n|Dm|n\u22121+|D\u00af|n\u22121\u2a7e|D0|n\u22121=\u03b50subscriptsubscript\ud835\udc37\ud835\udc5a\ud835\udc5b1subscript\u00af\ud835\udc37\ud835\udc5b1subscriptsubscript\ud835\udc370\ud835\udc5b1subscript\ud835\udf000\\left|D_{m}\\right|_{n-1}+\\left|\\overline{D}\\right|_{n-1}\\geqslant\\left|D_{0}%\n\\right|_{n-1}=\\varepsilon_{0}|
132
+ italic_D start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT | start_POSTSUBSCRIPT
133
+ italic_n - 1 end_POSTSUBSCRIPT + | over\u00af start_ARG italic_D end_ARG | start_POSTSUBSCRIPT
134
+ italic_n - 1 end_POSTSUBSCRIPT \u2a7e | italic_D start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT
135
+ | start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT = italic_\u03b5 start_POSTSUBSCRIPT
136
+ 0 end_POSTSUBSCRIPT\n\n\n\nand the stopping condition ensures\n\n\n\n|Dm|n\u22121<14\u2062\u03b50,subscriptsubscript\ud835\udc37\ud835\udc5a\ud835\udc5b114subscript\ud835\udf000\\left|D_{m}\\right|_{n-1}<\\frac{1}{4}\\varepsilon_{0},|
137
+ italic_D start_POSTSUBSCRIPT italic_m end_POSTSUBSCRIPT | start_POSTSUBSCRIPT
138
+ italic_n - 1 end_POSTSUBSCRIPT < divide start_ARG 1 end_ARG start_ARG 4 end_ARG
139
+ italic_\u03b5 start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT ,\n\n\n\nit follows that\n\n\n(3.20)\n\n|D\u00af|n\u22121\u2a7e14\u2062\u03b50.subscript\u00af\ud835\udc37\ud835\udc5b114subscript\ud835\udf000\\left|\\overline{D}\\right|_{n-1}\\geqslant\\frac{1}{4}\\varepsilon_{0}.|
140
+ over\u00af start_ARG italic_D end_ARG | start_POSTSUBSCRIPT italic_n - 1 end_POSTSUBSCRIPT
141
+ \u2a7e divide start_ARG 1 end_ARG start_ARG 4 end_ARG italic_\u03b5 start_POSTSUBSCRIPT
142
+ 0 end_POSTSUBSCRIPT .\n\n\n\nFor any \u03be\u2208D\u00af\ud835\udf09\u00af\ud835\udc37\\xi\\in\\overline{D}italic_\u03be
143
+ \u2208 over\u00af start_ARG italic_D end_ARG, there exists a \u03b4\ud835\udeff\\deltaitalic_\u03b4-tube
144
+ T\u03be\u03b4\u2062(a\u03be)subscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udf09subscript\ud835\udc4e\ud835\udf09T^{\\delta}_{\\xi}(a_{\\xi})italic_T
145
+ start_POSTSUPERSCRIPT italic_\u03b4 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_\u03be
146
+ end_POSTSUBSCRIPT ( italic_a start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT
147
+ ) centred at a\u03be\u2208Asubscript\ud835\udc4e\ud835\udf09\ud835\udc34a_{\\xi}\\in
148
+ Aitalic_a start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT \u2208 italic_A
149
+ such that\n\n\n\n1|T\u03be\u03b4\u2062(a\u03be)|n\u2062|\u22c3i=0m\u22121(E\u2229\u212ci)\u2229T\u03be\u03b4\u2062(a\u03be)|n>\u03bb2.1subscriptsubscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udf09subscript\ud835\udc4e\ud835\udf09\ud835\udc5bsubscriptsuperscriptsubscript\ud835\udc560\ud835\udc5a1\ud835\udc38subscript\u212c\ud835\udc56subscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udf09subscript\ud835\udc4e\ud835\udf09\ud835\udc5b\ud835\udf062\\frac{1}{\\left|T^{\\delta}_{\\xi}(a_{\\xi})\\right|_{n}}\\left|\\bigcup_{i=0}^{m-1}(%\nE\\cap\\mathcal{B}_{i})\\cap
150
+ T^{\\delta}_{\\xi}(a_{\\xi})\\right|_{n}>\\frac{\\lambda}{%\n2}.divide start_ARG
151
+ 1 end_ARG start_ARG | italic_T start_POSTSUPERSCRIPT italic_\u03b4 end_POSTSUPERSCRIPT
152
+ start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT ( italic_a start_POSTSUBSCRIPT
153
+ italic_\u03be end_POSTSUBSCRIPT ) | start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT
154
+ end_ARG | \u22c3 start_POSTSUBSCRIPT italic_i = 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT
155
+ italic_m - 1 end_POSTSUPERSCRIPT ( italic_E \u2229 caligraphic_B start_POSTSUBSCRIPT
156
+ italic_i end_POSTSUBSCRIPT ) \u2229 italic_T start_POSTSUPERSCRIPT italic_\u03b4
157
+ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT ( italic_a
158
+ start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT ) | start_POSTSUBSCRIPT italic_n
159
+ end_POSTSUBSCRIPT > divide start_ARG italic_\u03bb end_ARG start_ARG 2 end_ARG
160
+ .\n\n\n\nThis implies\n\n\n(3.21)\n\n\u2211i=0m\u22121|\u212ci\u2229T\u03be\u03b4\u2062(a\u03be)|n|T\u03be\u03b4\u2062(a\u03be)|n\u2a7e\u2211i=0m\u22121|(E\u2229\u212ci)\u2229T\u03be\u03b4\u2062(a\u03be)|n|T\u03be\u03b4\u2062(a\u03be)|n\u2a7e|\u22c3i=0m\u22121(E\u2229\u212ci)\u2229T\u03be\u03b4\u2062(a\u03be)|n|T\u03be\u03b4\u2062(a\u03be)|n>\u03bb2superscriptsubscript\ud835\udc560\ud835\udc5a1subscriptsubscript\u212c\ud835\udc56subscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udf09subscript\ud835\udc4e\ud835\udf09\ud835\udc5bsubscriptsubscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udf09subscript\ud835\udc4e\ud835\udf09\ud835\udc5bsuperscriptsubscript\ud835\udc560\ud835\udc5a1subscript\ud835\udc38subscript\u212c\ud835\udc56subscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udf09subscript\ud835\udc4e\ud835\udf09\ud835\udc5bsubscriptsubscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udf09subscript\ud835\udc4e\ud835\udf09\ud835\udc5bsubscriptsuperscriptsubscript\ud835\udc560\ud835\udc5a1\ud835\udc38subscript\u212c\ud835\udc56subscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udf09subscript\ud835\udc4e\ud835\udf09\ud835\udc5bsubscriptsubscriptsuperscript\ud835\udc47\ud835\udeff\ud835\udf09subscript\ud835\udc4e\ud835\udf09\ud835\udc5b\ud835\udf062\\begin{split}\\frac{\\sum_{i=0}^{m-1}\\left|\\mathcal{B}_{i}\\cap
161
+ T^{\\delta}_{\\xi}(%\na_{\\xi})\\right|_{n}}{\\left|T^{\\delta}_{\\xi}(a_{\\xi})\\right|_{n}}&\\geqslant%\n\\frac{\\sum_{i=0}^{m-1}\\left|(E\\cap\\mathcal{B}_{i})\\cap
162
+ T^{\\delta}_{\\xi}(a_{\\xi%\n})\\right|_{n}}{\\left|T^{\\delta}_{\\xi}(a_{\\xi})\\right|_{n}}\\\\\n&\\geqslant\\frac{\\left|\\bigcup_{i=0}^{m-1}(E\\cap\\mathcal{B}_{i})\\cap
163
+ T^{\\delta}%\n_{\\xi}(a_{\\xi})\\right|_{n}}{\\left|T^{\\delta}_{\\xi}(a_{\\xi})\\right|_{n}}>\\frac{%\n\\lambda}{2}\\end{split}start_ROW
164
+ start_CELL divide start_ARG \u2211 start_POSTSUBSCRIPT italic_i = 0 end_POSTSUBSCRIPT
165
+ start_POSTSUPERSCRIPT italic_m - 1 end_POSTSUPERSCRIPT | caligraphic_B start_POSTSUBSCRIPT
166
+ italic_i end_POSTSUBSCRIPT \u2229 italic_T start_POSTSUPERSCRIPT italic_\u03b4
167
+ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT ( italic_a
168
+ start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT ) | start_POSTSUBSCRIPT italic_n
169
+ end_POSTSUBSCRIPT end_ARG start_ARG | italic_T start_POSTSUPERSCRIPT italic_\u03b4
170
+ end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT ( italic_a
171
+ start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT ) | start_POSTSUBSCRIPT italic_n
172
+ end_POSTSUBSCRIPT end_ARG end_CELL start_CELL \u2a7e divide start_ARG \u2211 start_POSTSUBSCRIPT
173
+ italic_i = 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_m - 1 end_POSTSUPERSCRIPT
174
+ | ( italic_E \u2229 caligraphic_B start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT
175
+ ) \u2229 italic_T start_POSTSUPERSCRIPT italic_\u03b4 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT
176
+ italic_\u03be end_POSTSUBSCRIPT ( italic_a start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT
177
+ ) | start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG | italic_T
178
+ start_POSTSUPERSCRIPT italic_\u03b4 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_\u03be
179
+ end_POSTSUBSCRIPT ( italic_a start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT
180
+ ) | start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG end_CELL end_ROW start_ROW
181
+ start_CELL end_CELL start_CELL \u2a7e divide start_ARG | \u22c3 start_POSTSUBSCRIPT
182
+ italic_i = 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_m - 1 end_POSTSUPERSCRIPT
183
+ ( italic_E \u2229 caligraphic_B start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT
184
+ ) \u2229 italic_T start_POSTSUPERSCRIPT italic_\u03b4 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT
185
+ italic_\u03be end_POSTSUBSCRIPT ( italic_a start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT
186
+ ) | start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG start_ARG | italic_T
187
+ start_POSTSUPERSCRIPT italic_\u03b4 end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_\u03be
188
+ end_POSTSUBSCRIPT ( italic_a start_POSTSUBSCRIPT italic_\u03be end_POSTSUBSCRIPT
189
+ ) | start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_ARG > divide start_ARG
190
+ italic_\u03bb end_ARG start_ARG 2 end_ARG end_CELL end_ROW",'
191
+ - ' "In [kipvar], the authors first add and subtract terms to\nexplicitly
192
+ express\nIn\u2062(f,\u22c5)subscript\ud835\udc3c\ud835\udc5b\ud835\udc53\u22c5I_{n}(f,\\cdot)italic_I
193
+ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_f , \u22c5 ) in terms
194
+ of\nDynkin martingale and then pass to\nthe limit \u03bb\u21930\u2193\ud835\udf060\\lambda\\downarrow
195
+ 0italic_\u03bb \u2193 0, before\nanalyzing that result in a second limit as\nn\u2192\u221e\u2192\ud835\udc5bn\\to\\inftyitalic_n
196
+ \u2192 \u221e. This is the approach of\n[varadhan95, liggett99, landim] as well.\nThe
197
+ essential idea of the present proof is to first note that\nfor f\u2208\ud835\udc9f(\u2212A^)\u221212\u2283\u211bA^\ud835\udc53subscript\ud835\udc9fsuperscript^\ud835\udc3412superset-ofsubscript\u211b^\ud835\udc34f\\in\\mathscr{D}_{(-\\hat{A})^{-\\frac{1}{2}}}\\supset\\mathscr{R}_{\\hat{A}}italic_f
198
+ \u2208 script_D start_POSTSUBSCRIPT ( - over^ start_ARG italic_A end_ARG ) start_POSTSUPERSCRIPT
199
+ - divide start_ARG 1 end_ARG start_ARG 2 end_ARG end_POSTSUPERSCRIPT end_POSTSUBSCRIPT
200
+ \u2283 script_R start_POSTSUBSCRIPT over^ start_ARG italic_A end_ARG end_POSTSUBSCRIPT,
201
+ the sequence\n\u039bn\u2062(f,\u03bbn,\u22c5)subscript\u039b\ud835\udc5b\ud835\udc53subscript\ud835\udf06\ud835\udc5b\u22c5\\Lambda_{n}(f,\\lambda_{n},\\cdot)roman_\u039b
202
+ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_f , italic_\u03bb start_POSTSUBSCRIPT
203
+ italic_n end_POSTSUBSCRIPT , \u22c5 ) converges to zero\nin probability as n\u2192\u221e\u2192\ud835\udc5bn\\to\\inftyitalic_n
204
+ \u2192 \u221e for a choice of the sequence \u03bbnsubscript\ud835\udf06\ud835\udc5b\\lambda_{n}italic_\u03bb
205
+ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT\ntending to zero. From this it
206
+ follows that\nIn\u2062(f,\u22c5)subscript\ud835\udc3c\ud835\udc5b\ud835\udc53\u22c5I_{n}(f,\\cdot)italic_I
207
+ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_f , \u22c5 ) and In\u2062(f,\u22c5)\u2212\u039bn\u2062(f,\u03bbn,\u22c5)\u2261An\u2062(f,\u03bbn,\u22c5)subscript\ud835\udc3c\ud835\udc5b\ud835\udc53\u22c5subscript\u039b\ud835\udc5b\ud835\udc53subscript\ud835\udf06\ud835\udc5b\u22c5subscript\ud835\udc34\ud835\udc5b\ud835\udc53subscript\ud835\udf06\ud835\udc5b\u22c5I_{n}(f,\\cdot)-\\Lambda_{n}(f,\\lambda_{n},\\cdot)\\equiv
208
+ A_{n}(f,\\lambda_{n},\\cdot)italic_I start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT
209
+ ( italic_f , \u22c5 ) - roman_\u039b start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT
210
+ ( italic_f , italic_\u03bb start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , \u22c5
211
+ ) \u2261 italic_A start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT ( italic_f ,
212
+ italic_\u03bb start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT , \u22c5 ) have the
213
+ same limit distribution, provided that the limit exists.\nThe proof is then completed
214
+ by showing that the latter\nlimit exists and can be obtained by an\nargument using
215
+ Theorem 1 in which n\ud835\udc5bnitalic_n tends to infinity for a\nfixed small,
216
+ but positive\n\u03bb\u2113subscript\ud835\udf06\u2113\\lambda_{\\ell}italic_\u03bb
217
+ start_POSTSUBSCRIPT roman_\u2113 end_POSTSUBSCRIPT, to be determined. Thus, this
218
+ new\nproof exhibits the asymptotic distribution of\n1n\u2062\u222b0n\u2062tf\u2062(X\u2062(s))\u2062\ud835\udc51s,t\u226501\ud835\udc5bsuperscriptsubscript0\ud835\udc5b\ud835\udc61\ud835\udc53\ud835\udc4b\ud835\udc60differential-d\ud835\udc60\ud835\udc610\\frac{1}{\\sqrt{n}}\\int_{0}^{nt}f(X(s))ds,t\\geq
219
+ 0divide start_ARG 1 end_ARG start_ARG square-root start_ARG italic_n end_ARG end_ARG
220
+ \u222b start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_n
221
+ italic_t end_POSTSUPERSCRIPT italic_f ( italic_X ( italic_s ) ) italic_d italic_s
222
+ , italic_t \u2265 0,\nf\u2208\ud835\udc9f(\u2212A^)\u221212\ud835\udc53subscript\ud835\udc9fsuperscript^\ud835\udc3412f\\in\\mathscr{D}_{(-\\hat{A})^{-\\frac{1}{2}}}italic_f
223
+ \u2208 script_D start_POSTSUBSCRIPT ( - over^ start_ARG italic_A end_ARG ) start_POSTSUPERSCRIPT
224
+ - divide start_ARG 1 end_ARG start_ARG 2 end_ARG end_POSTSUPERSCRIPT end_POSTSUBSCRIPT,
225
+ explicitly\nas the limit of\n1n\u2062\u222b0n\u2062tA^\u2062R\u03bbn\u2062f\u2062(X\u2062(s)),t\u226501\ud835\udc5bsuperscriptsubscript0\ud835\udc5b\ud835\udc61^\ud835\udc34subscript\ud835\udc45subscript\ud835\udf06\ud835\udc5b\ud835\udc53\ud835\udc4b\ud835\udc60\ud835\udc610\\frac{1}{\\sqrt{n}}\\int_{0}^{nt}\\hat{A}R_{\\lambda_{n}}f(X(s)),t\\geq
226
+ 0divide start_ARG 1 end_ARG start_ARG square-root start_ARG italic_n end_ARG end_ARG
227
+ \u222b start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_n
228
+ italic_t end_POSTSUPERSCRIPT over^ start_ARG italic_A end_ARG italic_R start_POSTSUBSCRIPT
229
+ italic_\u03bb start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT end_POSTSUBSCRIPT
230
+ italic_f ( italic_X ( italic_s ) ) , italic_t \u2265 0,\nA^\u2062R\u03bbn\u2062f\u2208\u211bA^^\ud835\udc34subscript\ud835\udc45subscript\ud835\udf06\ud835\udc5b\ud835\udc53subscript\u211b^\ud835\udc34\\hat{A}R_{\\lambda_{n}}f\\in\\mathscr{R}_{\\hat{A}}over^
231
+ start_ARG italic_A end_ARG italic_R start_POSTSUBSCRIPT italic_\u03bb start_POSTSUBSCRIPT
232
+ italic_n end_POSTSUBSCRIPT end_POSTSUBSCRIPT italic_f \u2208 script_R start_POSTSUBSCRIPT
233
+ over^ start_ARG italic_A end_ARG end_POSTSUBSCRIPT,\nfor a sequence of positive
234
+ \u201ctuning\u201dparameters \u03bbnsubscript\ud835\udf06\ud835\udc5b\\lambda_{n}italic_\u03bb
235
+ start_POSTSUBSCRIPT italic_n end_POSTSUBSCRIPT.\nSo this new approach\nmay have
236
+ added value in\ncomputational and further theoretical refinements of the fclt.",'
237
+ - ' "Few-shot Voice Cloning: This follows the central concept of speaker
238
+ adaptation. However, the difference is the amount of data required. Thus, the
239
+ reference audio can range from a few seconds to a maximum of 5 minutes, which
240
+ is decided based on previous work, and anything more is challenging to obtain
241
+ in real-life scenarios.",'
242
+ - source_sentence: ' "For any \u03b3\u2208(0,2\u2062d)\ud835\udefe02\ud835\udc51\\gamma\\in(0,\\sqrt{2d})italic_\u03b3
243
+ \u2208 ( 0 , square-root start_ARG 2 italic_d end_ARG ), define a stochastic process\n{P\u03b3(\u03bb)\u2062(\ud835\udc2d):\ud835\udc2d\u2208[0,1]d}conditional-setsuperscriptsubscript\ud835\udc43\ud835\udefe\ud835\udf06\ud835\udc2d\ud835\udc2dsuperscript01\ud835\udc51\\{P_{\\gamma}^{(\\lambda)}(\\mathbf{t}):\\mathbf{t}\\in[0,1]^{d}\\}{
244
+ italic_P start_POSTSUBSCRIPT italic_\u03b3 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT
245
+ ( italic_\u03bb ) end_POSTSUPERSCRIPT ( bold_t ) : bold_t \u2208 [ 0 , 1 ] start_POSTSUPERSCRIPT
246
+ italic_d end_POSTSUPERSCRIPT } by\n\n\n(3.52)\n\nP\u03b3(\u03bb)\u2062(\ud835\udc2d):=exp\u2061(\u03b3\u2062Z\u03bb\u2062(\ud835\udc2d)\u2212\u03b322\u2062\ud835\udd3c\u2062[Z\u03bb\u2062(\ud835\udc2d)2])=exp\u2061(\u03b3\u2062Z\u03bb\u2062(\ud835\udc2d)\u2212\u03b322\u2062R\u03bb\u2062(\ud835\udc2d,\ud835\udc2d)).assignsuperscriptsubscript\ud835\udc43\ud835\udefe\ud835\udf06\ud835\udc2d\ud835\udefesubscript\ud835\udc4d\ud835\udf06\ud835\udc2dsuperscript\ud835\udefe22\ud835\udd3cdelimited-[]subscript\ud835\udc4d\ud835\udf06superscript\ud835\udc2d2\ud835\udefesubscript\ud835\udc4d\ud835\udf06\ud835\udc2dsuperscript\ud835\udefe22subscript\ud835\udc45\ud835\udf06\ud835\udc2d\ud835\udc2d\\displaystyle
247
+ P_{\\gamma}^{(\\lambda)}(\\mathbf{t}):=\\exp\\Big{(}\\gamma Z_{\\lambda%\n}(\\mathbf{t})-\\frac{\\gamma^{2}}{2}\\mathbb{E}[Z_{\\lambda}(\\mathbf{t})^{2}]\\Big{%\n)}=\\exp\\Big{(}\\gamma
248
+ Z_{\\lambda}(\\mathbf{t})-\\frac{\\gamma^{2}}{2}R_{\\lambda}(%\n\\mathbf{t},\\mathbf{t})\\Big{)}.italic_P
249
+ start_POSTSUBSCRIPT italic_\u03b3 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT ( italic_\u03bb
250
+ ) end_POSTSUPERSCRIPT ( bold_t ) := roman_exp ( italic_\u03b3 italic_Z start_POSTSUBSCRIPT
251
+ italic_\u03bb end_POSTSUBSCRIPT ( bold_t ) - divide start_ARG italic_\u03b3 start_POSTSUPERSCRIPT
252
+ 2 end_POSTSUPERSCRIPT end_ARG start_ARG 2 end_ARG blackboard_E [ italic_Z start_POSTSUBSCRIPT
253
+ italic_\u03bb end_POSTSUBSCRIPT ( bold_t ) start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT
254
+ ] ) = roman_exp ( italic_\u03b3 italic_Z start_POSTSUBSCRIPT italic_\u03bb end_POSTSUBSCRIPT
255
+ ( bold_t ) - divide start_ARG italic_\u03b3 start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT
256
+ end_ARG start_ARG 2 end_ARG italic_R start_POSTSUBSCRIPT italic_\u03bb end_POSTSUBSCRIPT
257
+ ( bold_t , bold_t ) ) .",'
258
+ sentences:
259
+ - ' "In this section, we highlight open challenges and future directions
260
+ in network-level ISAC design and the practical implementation of distributed ISAC
261
+ systems.",'
262
+ - '}'
263
+ - ' "Warning: As before, we need to restrict ourselves to a smaller class
264
+ of perturbation data (i.e. sufficiently small Hamiltonian perturbations) to ensure
265
+ that the element on the right is in \u039b0subscript\u039b0\\Lambda_{0}roman_\u039b
266
+ start_POSTSUBSCRIPT 0 end_POSTSUBSCRIPT, in other words such that for any quilted
267
+ strip u\u00af\u00af\ud835\udc62\\underline{u}under\u00af start_ARG italic_u end_ARG
268
+ we have \u03c9\u2062(u\u00af)=0\ud835\udf14\u00af\ud835\udc620\\omega(\\underline{u})=0italic_\u03c9
269
+ ( under\u00af start_ARG italic_u end_ARG ) = 0 if and only if [u\u00af]=0delimited-[]\u00af\ud835\udc620[\\underline{u}]=0[
270
+ under\u00af start_ARG italic_u end_ARG ] = 0.",'
271
+ - source_sentence: ' "For the regular planar lattice graphs, \ud835\udca2\u25b3,\ud835\udca2\u25a1,\ud835\udca2\u2394subscript\ud835\udca2\u25b3subscript\ud835\udca2\u25a1subscript\ud835\udca2\u2394\\mathcal{G}_{\\triangle},\\,\\mathcal{G}_{\\square},\\,\\mathcal{G}_{\\hexagon}caligraphic_G
272
+ start_POSTSUBSCRIPT \u25b3 end_POSTSUBSCRIPT , caligraphic_G start_POSTSUBSCRIPT
273
+ \u25a1 end_POSTSUBSCRIPT , caligraphic_G start_POSTSUBSCRIPT \u2394 end_POSTSUBSCRIPT,\n\n\n\nvol\u27c2\u2062(G)=vol\u2062(G)=vol\u25c6\u2062(G)+vol\u25c6\u2062(G\u2217)=2\u2062\u03c0\u2062m\u2062(p\u2062(z,w))=2\u2062\u03c0\u2062zGfd.superscriptvolperpendicular-to\ud835\udc3avol\ud835\udc3asuperscriptvol\u25c6\ud835\udc3asuperscriptvol\u25c6superscript\ud835\udc3a2\ud835\udf0bm\ud835\udc5d\ud835\udc67\ud835\udc642\ud835\udf0bsubscriptsuperscript\ud835\udc67fd\ud835\udc3a{\\rm
274
+ vol}^{\\perp}(G)={\\rm vol}(G)={\\rm vol}^{\\lozenge}(G)+{\\rm vol}^{\\lozenge}%\n(G^{*})=2\\pi\\,\\mathrm{m}(p(z,w))=2\\pi\\,z^{\\rm
275
+ fd}_{G}.roman_vol start_POSTSUPERSCRIPT \u27c2 end_POSTSUPERSCRIPT ( italic_G
276
+ ) = roman_vol ( italic_G ) = roman_vol start_POSTSUPERSCRIPT \u25c6 end_POSTSUPERSCRIPT
277
+ ( italic_G ) + roman_vol start_POSTSUPERSCRIPT \u25c6 end_POSTSUPERSCRIPT ( italic_G
278
+ start_POSTSUPERSCRIPT \u2217 end_POSTSUPERSCRIPT ) = 2 italic_\u03c0 roman_m (
279
+ italic_p ( italic_z , italic_w ) ) = 2 italic_\u03c0 italic_z start_POSTSUPERSCRIPT
280
+ roman_fd end_POSTSUPERSCRIPT start_POSTSUBSCRIPT italic_G end_POSTSUBSCRIPT .\n\n\n\nThus,
281
+ the lower bound in Conjecture\u00a01 holds with equality.",'
282
+ sentences:
283
+ - ' "Let F\ud835\udc39Fitalic_F denote a target model, which will now be
284
+ trained on a modified dataset Dp\u2062o\u2062i\u2062s\u2062o\u2062n\u2062e\u2062d=D\u2217subscript\ud835\udc37\ud835\udc5d\ud835\udc5c\ud835\udc56\ud835\udc60\ud835\udc5c\ud835\udc5b\ud835\udc52\ud835\udc51superscript\ud835\udc37D_{poisoned}=D^{*}italic_D
285
+ start_POSTSUBSCRIPT italic_p italic_o italic_i italic_s italic_o italic_n italic_e
286
+ italic_d end_POSTSUBSCRIPT = italic_D start_POSTSUPERSCRIPT \u2217 end_POSTSUPERSCRIPT,
287
+ where D\u2217superscript\ud835\udc37D^{*}italic_D start_POSTSUPERSCRIPT \u2217
288
+ end_POSTSUPERSCRIPT is a surreptitiously modified version of the clean training
289
+ dataset D\ud835\udc37Ditalic_D. The aim of data poisoning F\ud835\udc39Fitalic_F
290
+ is creating a poisoned model F\u2217superscript\ud835\udc39F^{*}italic_F start_POSTSUPERSCRIPT
291
+ \u2217 end_POSTSUPERSCRIPT that makes incorrect predictions, often without an
292
+ observable degradation in its overall accuracy. Data poisoning compromises the
293
+ model integrity by introducing systematic biases that serve the attacker\u2019s
294
+ objectives while evading detection during model training.",'
295
+ - ' "Figure 2 illustrates a comparison between the observed low-medium resolution
296
+ and the high-resolution spectral profiles of the oxygen A band, depicting observations
297
+ of (telluric) molecular oxygen. The upper panel of Figure 2 shows low to medium
298
+ resolution telluric oxygen features. These were obtained from the ESO Science
299
+ Archive Facility using X-shooter[141] observations during February and March 2024
300
+ by the UVES team, as part of Program ID: 60.A-9022(c), OB ID:2024672, 2024624
301
+ and 2024822, at various resolutions with short exposures (12 seconds). The results
302
+ indicate that higher resolution enables the observation of more detailed features
303
+ within the molecular oxygen spectrum, revealing the signal more distinctly within
304
+ each spectral line. The lower panel of Figure 2 shows performance tests for future
305
+ HRS instrumentation by observing the Sun through the Earth\u2019s atmosphere.
306
+ These profiles demonstrate the measurement outcomes obtained using two types of
307
+ interferometers: Michelson-based and FPI-based. Firstly, the FTS from the National
308
+ Solar Observatory at Kitt Peak [126] reported R=700,000 in the oxygen A-band.
309
+ Secondly, the FIOS-demo[133] showcases spectral profiles based on a chained FPI
310
+ array with a spectral resolution of R=250,000. This resolution can potentially
311
+ increase up to R=350,000 with the addition of each array. The throughput of each
312
+ additional unit, however, decreases by 10-15% [50]. One benefit of achieving this
313
+ level of resolution is the increase in signal-to-noise ratio and the sampling
314
+ frequency for each spectral line, which may reduce the required observing time,
315
+ as predicted in [46, 93].",'
316
+ - ' "At this point, we can reconcile what we observe with the evidence from
317
+ the last paragraphs on TFP in Figure 5. We argue that a critical mass is needed
318
+ in either case to record a significant impact of the exporting activity. At lower
319
+ levels of exporting activity, the company starts to benefit from economies of
320
+ scale but also needs to invest in productive capacity. To keep up with the technological
321
+ frontier is costly, and it often requires an upgrade of obsolete tangible assets.
322
+ We argue that the combined evidence of rising operational capacity (sales and
323
+ costs) and investment in fixed assets explains why we observe a negative albeit
324
+ small productivity loss in an intermediate range of export intensity. It is only
325
+ when the company operates abroad at a larger scale that positive albeit small
326
+ TFP gains come as a consequence of exporting. In this case, we argue, economies
327
+ of scale become evident and the capital adjustment unveils its impact on firms\u2019
328
+ performance.",'
329
+ - source_sentence: ' "To generate queer warmth phrases, we employed persona
330
+ prompting to adapt our SAE warmth phrases (see Table\u00a04). Three distinct personas
331
+ were designed and used as prompts to produce iterations of the 14 SAE warmth phrases.
332
+ Each phrase was processed through all three persona prompts (see Table\u00a08),
333
+ resulting in a total of 42 unique queer warmth phrases. The final set of phrases
334
+ is presented below.",'
335
+ sentences:
336
+ - ' "title": "Always skip attention",'
337
+ - ' "To generate queer warmth phrases, we employed persona prompting to adapt
338
+ our SAE warmth phrases (see Table\u00a04). Three distinct personas were designed
339
+ and used as prompts to produce iterations of the 14 SAE warmth phrases. Each phrase
340
+ was processed through all three persona prompts (see Table\u00a08), resulting
341
+ in a total of 42 unique queer warmth phrases. The final set of phrases is presented
342
+ below.",'
343
+ - ' "Assuming an adequately sized Bloom filter, the proportion of false positives
344
+ is small, ensuring that XAcomsuperscriptsubscript\ud835\udc4b\ud835\udc34comX_{A}^{\\text{com}}italic_X
345
+ start_POSTSUBSCRIPT italic_A end_POSTSUBSCRIPT start_POSTSUPERSCRIPT com end_POSTSUPERSCRIPT
346
+ and XBcomsuperscriptsubscript\ud835\udc4b\ud835\udc35comX_{B}^{\\text{com}}italic_X
347
+ start_POSTSUBSCRIPT italic_B end_POSTSUBSCRIPT start_POSTSUPERSCRIPT com end_POSTSUPERSCRIPT
348
+ are highly similar. This minimizes the occurrence of similar but non-identical
349
+ buckets, thereby mitigating the redundancy issue inherent in bucketing. Furthermore,
350
+ the use of bucketing not only detects false positives but also ensures convergence,
351
+ addressing the limitation of Bloom filters alone. This combined approach is analogous
352
+ to the RSync protocol, where Bloom filters act as the weak checksum and bucketing
353
+ serves as the strong checksum.",'
354
+ pipeline_tag: sentence-similarity
355
+ library_name: sentence-transformers
356
+ ---
357
+
358
+ # SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2
359
+
360
+ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
361
+
362
+ ## Model Details
363
+
364
+ ### Model Description
365
+ - **Model Type:** Sentence Transformer
366
+ - **Base model:** [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) <!-- at revision c9745ed1d9f207416be6d2e6f8de32d1f16199bf -->
367
+ - **Maximum Sequence Length:** 256 tokens
368
+ - **Output Dimensionality:** 384 dimensions
369
+ - **Similarity Function:** Cosine Similarity
370
+ <!-- - **Training Dataset:** Unknown -->
371
+ <!-- - **Language:** Unknown -->
372
+ <!-- - **License:** Unknown -->
373
+
374
+ ### Model Sources
375
+
376
+ - **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
377
+ - **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
378
+ - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
379
+
380
+ ### Full Model Architecture
381
+
382
+ ```
383
+ SentenceTransformer(
384
+ (0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel
385
+ (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
386
+ (2): Normalize()
387
+ )
388
+ ```
389
+
390
+ ## Usage
391
+
392
+ ### Direct Usage (Sentence Transformers)
393
+
394
+ First install the Sentence Transformers library:
395
+
396
+ ```bash
397
+ pip install -U sentence-transformers
398
+ ```
399
+
400
+ Then you can load this model and run inference.
401
+ ```python
402
+ from sentence_transformers import SentenceTransformer
403
+
404
+ # Download from the 🤗 Hub
405
+ model = SentenceTransformer("Stergios-Konstantinidis/MNLP_M2_document_encoder")
406
+ # Run inference
407
+ sentences = [
408
+ ' "To generate queer warmth phrases, we employed persona prompting to adapt our SAE warmth phrases (see Table\\u00a04). Three distinct personas were designed and used as prompts to produce iterations of the 14 SAE warmth phrases. Each phrase was processed through all three persona prompts (see Table\\u00a08), resulting in a total of 42 unique queer warmth phrases. The final set of phrases is presented below.",',
409
+ ' "To generate queer warmth phrases, we employed persona prompting to adapt our SAE warmth phrases (see Table\\u00a04). Three distinct personas were designed and used as prompts to produce iterations of the 14 SAE warmth phrases. Each phrase was processed through all three persona prompts (see Table\\u00a08), resulting in a total of 42 unique queer warmth phrases. The final set of phrases is presented below.",',
410
+ ' "title": "Always skip attention",',
411
+ ]
412
+ embeddings = model.encode(sentences)
413
+ print(embeddings.shape)
414
+ # [3, 384]
415
+
416
+ # Get the similarity scores for the embeddings
417
+ similarities = model.similarity(embeddings, embeddings)
418
+ print(similarities.shape)
419
+ # [3, 3]
420
+ ```
421
+
422
+ <!--
423
+ ### Direct Usage (Transformers)
424
+
425
+ <details><summary>Click to see the direct usage in Transformers</summary>
426
+
427
+ </details>
428
+ -->
429
+
430
+ <!--
431
+ ### Downstream Usage (Sentence Transformers)
432
+
433
+ You can finetune this model on your own dataset.
434
+
435
+ <details><summary>Click to expand</summary>
436
+
437
+ </details>
438
+ -->
439
+
440
+ <!--
441
+ ### Out-of-Scope Use
442
+
443
+ *List how the model may foreseeably be misused and address what users ought not to do with the model.*
444
+ -->
445
+
446
+ <!--
447
+ ## Bias, Risks and Limitations
448
+
449
+ *What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
450
+ -->
451
+
452
+ <!--
453
+ ### Recommendations
454
+
455
+ *What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
456
+ -->
457
+
458
+ ## Training Details
459
+
460
+ ### Training Dataset
461
+
462
+ #### Unnamed Dataset
463
+
464
+ * Size: 21,000 training samples
465
+ * Columns: <code>sentence_0</code>, <code>sentence_1</code>, and <code>label</code>
466
+ * Approximate statistics based on the first 1000 samples:
467
+ | | sentence_0 | sentence_1 | label |
468
+ |:--------|:------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:------------------------------------------------|
469
+ | type | string | string | int |
470
+ | details | <ul><li>min: 3 tokens</li><li>mean: 173.22 tokens</li><li>max: 256 tokens</li></ul> | <ul><li>min: 3 tokens</li><li>mean: 170.67 tokens</li><li>max: 256 tokens</li></ul> | <ul><li>0: ~66.60%</li><li>1: ~33.40%</li></ul> |
471
+ * Samples:
472
+ | sentence_0 | sentence_1 | label |
473
+ |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------|
474
+ | <code> "the user may robustify the design by selecting a suitable A^^\ud835\udc34\\widehat{A}over^ start_ARG italic_A end_ARG. Only the choice of A^^\ud835\udc34\\widehat{A}over^ start_ARG italic_A end_ARG has an impact at an algorithmic level and, normally, A^^\ud835\udc34\\widehat{A}over^ start_ARG italic_A end_ARG is tuned to a set A\ud835\udc34Aitalic_A that, in the user\u2019s mind, captures, and suitably describes, possible adversarial actions. Still, we remark that our results hold true for any choice of A^^\ud835\udc34\\widehat{A}over^ start_ARG italic_A end_ARG and A\ud835\udc34Aitalic_A (with A^\u2286A^\ud835\udc34\ud835\udc34\\widehat{A}\\subseteq Aover^ start_ARG italic_A end_ARG \u2286 italic_A), so accommodating situations in which, e.g., the user envisages adversarial actions of a certain type and, yet, he is willing to theoretically test the robustness of the design against actions of higher magnitude. One simple example of this situation occurs when the design is done...</code> | <code> "the user may robustify the design by selecting a suitable A^^\ud835\udc34\\widehat{A}over^ start_ARG italic_A end_ARG. Only the choice of A^^\ud835\udc34\\widehat{A}over^ start_ARG italic_A end_ARG has an impact at an algorithmic level and, normally, A^^\ud835\udc34\\widehat{A}over^ start_ARG italic_A end_ARG is tuned to a set A\ud835\udc34Aitalic_A that, in the user\u2019s mind, captures, and suitably describes, possible adversarial actions. Still, we remark that our results hold true for any choice of A^^\ud835\udc34\\widehat{A}over^ start_ARG italic_A end_ARG and A\ud835\udc34Aitalic_A (with A^\u2286A^\ud835\udc34\ud835\udc34\\widehat{A}\\subseteq Aover^ start_ARG italic_A end_ARG \u2286 italic_A), so accommodating situations in which, e.g., the user envisages adversarial actions of a certain type and, yet, he is willing to theoretically test the robustness of the design against actions of higher magnitude. One simple example of this situation occurs when the design is done...</code> | <code>1</code> |
475
+ | <code> "Aha Moment of R1-Reward. Through our task design and reward function formulation, the R1-Reward model effectively learns the reward modeling task structure during the SFT phase. Following reinforcement learning, it reduces the length of reasoning to enhance efficiency. Visual examples of the model\u2019s output appear in Figures\u00a03 and\u00a06. The model autonomously learns a process to assess response quality. It first defines the goal, analyzes the image, attempts to solve the problem, and provides an answer. Based on this, the model evaluates Response 1 and Response 2, compares the two outputs, and gives a final ranking. Simultaneously, the model demonstrates different reflection patterns. In Figure\u00a03, the model encounters an error in its calculation, but after rechecking the bar chart, it recognizes the mistake and recalculates to obtain the correct result. In Figure\u00a06, the model misunderstands the problem. However, after outputting \u201cWait, re-reading the ...</code> | <code> "In an ideal case, the hole made after the punch doesn\u2019t move and keeps the size of the needle. Then the hole is filled with a subsequent paint layer, if it is not made in the top layer.",</code> | <code>0</code> |
476
+ | <code> "In our search for the optimal parameters, we evaluated all possible combinations presented in Section\u00a03.3. To do this, we aggregated the results for each specific parameter configuration and computed the mean metrics. This approach allowed us to isolate the effects of each parameter under evaluation.",</code> | <code> "We employ RWP to model the movement of humans within the indoor space and use the Matern hard-core process (MHCP) to model static obstacles, such as furniture or static humans, in the environment [15].",</code> | <code>0</code> |
477
+ * Loss: [<code>ContrastiveTensionLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#contrastivetensionloss)
478
+
479
+ ### Training Hyperparameters
480
+ #### Non-Default Hyperparameters
481
+
482
+ - `per_device_train_batch_size`: 3
483
+ - `per_device_eval_batch_size`: 3
484
+ - `num_train_epochs`: 10
485
+ - `multi_dataset_batch_sampler`: round_robin
486
+
487
+ #### All Hyperparameters
488
+ <details><summary>Click to expand</summary>
489
+
490
+ - `overwrite_output_dir`: False
491
+ - `do_predict`: False
492
+ - `eval_strategy`: no
493
+ - `prediction_loss_only`: True
494
+ - `per_device_train_batch_size`: 3
495
+ - `per_device_eval_batch_size`: 3
496
+ - `per_gpu_train_batch_size`: None
497
+ - `per_gpu_eval_batch_size`: None
498
+ - `gradient_accumulation_steps`: 1
499
+ - `eval_accumulation_steps`: None
500
+ - `torch_empty_cache_steps`: None
501
+ - `learning_rate`: 5e-05
502
+ - `weight_decay`: 0.0
503
+ - `adam_beta1`: 0.9
504
+ - `adam_beta2`: 0.999
505
+ - `adam_epsilon`: 1e-08
506
+ - `max_grad_norm`: 1
507
+ - `num_train_epochs`: 10
508
+ - `max_steps`: -1
509
+ - `lr_scheduler_type`: linear
510
+ - `lr_scheduler_kwargs`: {}
511
+ - `warmup_ratio`: 0.0
512
+ - `warmup_steps`: 0
513
+ - `log_level`: passive
514
+ - `log_level_replica`: warning
515
+ - `log_on_each_node`: True
516
+ - `logging_nan_inf_filter`: True
517
+ - `save_safetensors`: True
518
+ - `save_on_each_node`: False
519
+ - `save_only_model`: False
520
+ - `restore_callback_states_from_checkpoint`: False
521
+ - `no_cuda`: False
522
+ - `use_cpu`: False
523
+ - `use_mps_device`: False
524
+ - `seed`: 42
525
+ - `data_seed`: None
526
+ - `jit_mode_eval`: False
527
+ - `use_ipex`: False
528
+ - `bf16`: False
529
+ - `fp16`: False
530
+ - `fp16_opt_level`: O1
531
+ - `half_precision_backend`: auto
532
+ - `bf16_full_eval`: False
533
+ - `fp16_full_eval`: False
534
+ - `tf32`: None
535
+ - `local_rank`: 0
536
+ - `ddp_backend`: None
537
+ - `tpu_num_cores`: None
538
+ - `tpu_metrics_debug`: False
539
+ - `debug`: []
540
+ - `dataloader_drop_last`: False
541
+ - `dataloader_num_workers`: 0
542
+ - `dataloader_prefetch_factor`: None
543
+ - `past_index`: -1
544
+ - `disable_tqdm`: False
545
+ - `remove_unused_columns`: True
546
+ - `label_names`: None
547
+ - `load_best_model_at_end`: False
548
+ - `ignore_data_skip`: False
549
+ - `fsdp`: []
550
+ - `fsdp_min_num_params`: 0
551
+ - `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
552
+ - `tp_size`: 0
553
+ - `fsdp_transformer_layer_cls_to_wrap`: None
554
+ - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
555
+ - `deepspeed`: None
556
+ - `label_smoothing_factor`: 0.0
557
+ - `optim`: adamw_torch
558
+ - `optim_args`: None
559
+ - `adafactor`: False
560
+ - `group_by_length`: False
561
+ - `length_column_name`: length
562
+ - `ddp_find_unused_parameters`: None
563
+ - `ddp_bucket_cap_mb`: None
564
+ - `ddp_broadcast_buffers`: False
565
+ - `dataloader_pin_memory`: True
566
+ - `dataloader_persistent_workers`: False
567
+ - `skip_memory_metrics`: True
568
+ - `use_legacy_prediction_loop`: False
569
+ - `push_to_hub`: False
570
+ - `resume_from_checkpoint`: None
571
+ - `hub_model_id`: None
572
+ - `hub_strategy`: every_save
573
+ - `hub_private_repo`: None
574
+ - `hub_always_push`: False
575
+ - `gradient_checkpointing`: False
576
+ - `gradient_checkpointing_kwargs`: None
577
+ - `include_inputs_for_metrics`: False
578
+ - `include_for_metrics`: []
579
+ - `eval_do_concat_batches`: True
580
+ - `fp16_backend`: auto
581
+ - `push_to_hub_model_id`: None
582
+ - `push_to_hub_organization`: None
583
+ - `mp_parameters`:
584
+ - `auto_find_batch_size`: False
585
+ - `full_determinism`: False
586
+ - `torchdynamo`: None
587
+ - `ray_scope`: last
588
+ - `ddp_timeout`: 1800
589
+ - `torch_compile`: False
590
+ - `torch_compile_backend`: None
591
+ - `torch_compile_mode`: None
592
+ - `include_tokens_per_second`: False
593
+ - `include_num_input_tokens_seen`: False
594
+ - `neftune_noise_alpha`: None
595
+ - `optim_target_modules`: None
596
+ - `batch_eval_metrics`: False
597
+ - `eval_on_start`: False
598
+ - `use_liger_kernel`: False
599
+ - `eval_use_gather_object`: False
600
+ - `average_tokens_across_devices`: False
601
+ - `prompts`: None
602
+ - `batch_sampler`: batch_sampler
603
+ - `multi_dataset_batch_sampler`: round_robin
604
+
605
+ </details>
606
+
607
+ ### Training Logs
608
+ <details><summary>Click to expand</summary>
609
+
610
+ | Epoch | Step | Training Loss |
611
+ |:------:|:-----:|:-------------:|
612
+ | 0.0714 | 500 | 1.8871 |
613
+ | 0.1429 | 1000 | 1.7445 |
614
+ | 0.2143 | 1500 | 1.7138 |
615
+ | 0.2857 | 2000 | 1.699 |
616
+ | 0.3571 | 2500 | 1.6729 |
617
+ | 0.4286 | 3000 | 1.6864 |
618
+ | 0.5 | 3500 | 1.6718 |
619
+ | 0.5714 | 4000 | 1.6754 |
620
+ | 0.6429 | 4500 | 1.6747 |
621
+ | 0.7143 | 5000 | 1.6709 |
622
+ | 0.7857 | 5500 | 1.6797 |
623
+ | 0.8571 | 6000 | 1.6768 |
624
+ | 0.9286 | 6500 | 1.6694 |
625
+ | 1.0 | 7000 | 1.6754 |
626
+ | 1.0714 | 7500 | 1.6632 |
627
+ | 1.1429 | 8000 | 1.6643 |
628
+ | 1.2143 | 8500 | 1.6553 |
629
+ | 1.2857 | 9000 | 1.6626 |
630
+ | 1.3571 | 9500 | 1.6734 |
631
+ | 1.4286 | 10000 | 1.673 |
632
+ | 1.5 | 10500 | 1.6611 |
633
+ | 1.5714 | 11000 | 1.671 |
634
+ | 1.6429 | 11500 | 1.6762 |
635
+ | 1.7143 | 12000 | 1.6717 |
636
+ | 1.7857 | 12500 | 1.6599 |
637
+ | 1.8571 | 13000 | 1.681 |
638
+ | 1.9286 | 13500 | 1.6715 |
639
+ | 2.0 | 14000 | 1.6815 |
640
+ | 2.0714 | 14500 | 1.6304 |
641
+ | 2.1429 | 15000 | 1.6351 |
642
+ | 2.2143 | 15500 | 1.648 |
643
+ | 2.2857 | 16000 | 1.6538 |
644
+ | 2.3571 | 16500 | 1.6396 |
645
+ | 2.4286 | 17000 | 1.632 |
646
+ | 2.5 | 17500 | 1.6497 |
647
+ | 2.5714 | 18000 | 1.6526 |
648
+ | 2.6429 | 18500 | 1.6346 |
649
+ | 2.7143 | 19000 | 1.6548 |
650
+ | 2.7857 | 19500 | 1.6549 |
651
+ | 2.8571 | 20000 | 1.6438 |
652
+ | 2.9286 | 20500 | 1.6448 |
653
+ | 3.0 | 21000 | 1.6435 |
654
+ | 3.0714 | 21500 | 1.589 |
655
+ | 3.1429 | 22000 | 1.6075 |
656
+ | 3.2143 | 22500 | 1.6084 |
657
+ | 3.2857 | 23000 | 1.6061 |
658
+ | 3.3571 | 23500 | 1.6121 |
659
+ | 3.4286 | 24000 | 1.6168 |
660
+ | 3.5 | 24500 | 1.6022 |
661
+ | 3.5714 | 25000 | 1.6164 |
662
+ | 3.6429 | 25500 | 1.6132 |
663
+ | 3.7143 | 26000 | 1.6036 |
664
+ | 3.7857 | 26500 | 1.6077 |
665
+ | 3.8571 | 27000 | 1.6241 |
666
+ | 3.9286 | 27500 | 1.6224 |
667
+ | 4.0 | 28000 | 1.6023 |
668
+ | 4.0714 | 28500 | 1.5479 |
669
+ | 4.1429 | 29000 | 1.5569 |
670
+ | 4.2143 | 29500 | 1.5611 |
671
+ | 4.2857 | 30000 | 1.5413 |
672
+ | 4.3571 | 30500 | 1.5568 |
673
+ | 4.4286 | 31000 | 1.5458 |
674
+ | 4.5 | 31500 | 1.5405 |
675
+ | 4.5714 | 32000 | 1.5707 |
676
+ | 4.6429 | 32500 | 1.557 |
677
+ | 4.7143 | 33000 | 1.5561 |
678
+ | 4.7857 | 33500 | 1.5698 |
679
+ | 4.8571 | 34000 | 1.546 |
680
+ | 4.9286 | 34500 | 1.5589 |
681
+ | 5.0 | 35000 | 1.5692 |
682
+ | 5.0714 | 35500 | 1.5029 |
683
+ | 5.1429 | 36000 | 1.5087 |
684
+ | 5.2143 | 36500 | 1.4882 |
685
+ | 5.2857 | 37000 | 1.5116 |
686
+ | 5.3571 | 37500 | 1.5016 |
687
+ | 5.4286 | 38000 | 1.4988 |
688
+ | 5.5 | 38500 | 1.5065 |
689
+ | 5.5714 | 39000 | 1.5089 |
690
+ | 5.6429 | 39500 | 1.5104 |
691
+ | 5.7143 | 40000 | 1.4937 |
692
+ | 5.7857 | 40500 | 1.4974 |
693
+ | 5.8571 | 41000 | 1.5095 |
694
+ | 5.9286 | 41500 | 1.5064 |
695
+ | 6.0 | 42000 | 1.5119 |
696
+ | 6.0714 | 42500 | 1.4572 |
697
+ | 6.1429 | 43000 | 1.4732 |
698
+ | 6.2143 | 43500 | 1.4534 |
699
+ | 6.2857 | 44000 | 1.4598 |
700
+ | 6.3571 | 44500 | 1.4626 |
701
+ | 6.4286 | 45000 | 1.4486 |
702
+ | 6.5 | 45500 | 1.4677 |
703
+ | 6.5714 | 46000 | 1.4705 |
704
+ | 6.6429 | 46500 | 1.4757 |
705
+ | 6.7143 | 47000 | 1.4724 |
706
+ | 6.7857 | 47500 | 1.4744 |
707
+ | 6.8571 | 48000 | 1.4571 |
708
+ | 6.9286 | 48500 | 1.4571 |
709
+ | 7.0 | 49000 | 1.4549 |
710
+ | 7.0714 | 49500 | 1.4198 |
711
+ | 7.1429 | 50000 | 1.4328 |
712
+ | 7.2143 | 50500 | 1.4322 |
713
+ | 7.2857 | 51000 | 1.4191 |
714
+ | 7.3571 | 51500 | 1.4355 |
715
+ | 7.4286 | 52000 | 1.4409 |
716
+ | 7.5 | 52500 | 1.4366 |
717
+ | 7.5714 | 53000 | 1.4378 |
718
+ | 7.6429 | 53500 | 1.4229 |
719
+ | 7.7143 | 54000 | 1.4386 |
720
+ | 7.7857 | 54500 | 1.453 |
721
+ | 7.8571 | 55000 | 1.419 |
722
+ | 7.9286 | 55500 | 1.4215 |
723
+ | 8.0 | 56000 | 1.4248 |
724
+ | 8.0714 | 56500 | 1.4184 |
725
+ | 8.1429 | 57000 | 1.4059 |
726
+ | 8.2143 | 57500 | 1.4011 |
727
+ | 8.2857 | 58000 | 1.3962 |
728
+ | 8.3571 | 58500 | 1.4134 |
729
+ | 8.4286 | 59000 | 1.4104 |
730
+ | 8.5 | 59500 | 1.3924 |
731
+ | 8.5714 | 60000 | 1.4062 |
732
+ | 8.6429 | 60500 | 1.4117 |
733
+ | 8.7143 | 61000 | 1.4192 |
734
+ | 8.7857 | 61500 | 1.402 |
735
+ | 8.8571 | 62000 | 1.3998 |
736
+ | 8.9286 | 62500 | 1.4087 |
737
+ | 9.0 | 63000 | 1.4203 |
738
+ | 9.0714 | 63500 | 1.389 |
739
+ | 9.1429 | 64000 | 1.4049 |
740
+ | 9.2143 | 64500 | 1.3897 |
741
+ | 9.2857 | 65000 | 1.3839 |
742
+ | 9.3571 | 65500 | 1.3712 |
743
+ | 9.4286 | 66000 | 1.3908 |
744
+ | 9.5 | 66500 | 1.3986 |
745
+ | 9.5714 | 67000 | 1.4014 |
746
+ | 9.6429 | 67500 | 1.3919 |
747
+ | 9.7143 | 68000 | 1.404 |
748
+ | 9.7857 | 68500 | 1.3921 |
749
+ | 9.8571 | 69000 | 1.3918 |
750
+ | 9.9286 | 69500 | 1.4046 |
751
+ | 10.0 | 70000 | 1.3923 |
752
+
753
+ </details>
754
+
755
+ ### Framework Versions
756
+ - Python: 3.12.8
757
+ - Sentence Transformers: 3.4.1
758
+ - Transformers: 4.51.3
759
+ - PyTorch: 2.5.1+cu124
760
+ - Accelerate: 1.3.0
761
+ - Datasets: 3.6.0
762
+ - Tokenizers: 0.21.0
763
+
764
+ ## Citation
765
+
766
+ ### BibTeX
767
+
768
+ #### Sentence Transformers
769
+ ```bibtex
770
+ @inproceedings{reimers-2019-sentence-bert,
771
+ title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
772
+ author = "Reimers, Nils and Gurevych, Iryna",
773
+ booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
774
+ month = "11",
775
+ year = "2019",
776
+ publisher = "Association for Computational Linguistics",
777
+ url = "https://arxiv.org/abs/1908.10084",
778
+ }
779
+ ```
780
+
781
+ #### ContrastiveTensionLoss
782
+ ```bibtex
783
+ @inproceedings{carlsson2021semantic,
784
+ title={Semantic Re-tuning with Contrastive Tension},
785
+ author={Fredrik Carlsson and Amaru Cuba Gyllensten and Evangelia Gogoulou and Erik Ylip{"a}{"a} Hellqvist and Magnus Sahlgren},
786
+ booktitle={International Conference on Learning Representations},
787
+ year={2021},
788
+ url={https://openreview.net/forum?id=Ov_sMNau-PF}
789
+ }
790
+ ```
791
+
792
+ <!--
793
+ ## Glossary
794
+
795
+ *Clearly define terms in order to be accessible across audiences.*
796
+ -->
797
+
798
+ <!--
799
+ ## Model Card Authors
800
+
801
+ *Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
802
+ -->
803
+
804
+ <!--
805
+ ## Model Card Contact
806
+
807
+ *Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
808
+ -->
config.json ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "BertModel"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "classifier_dropout": null,
7
+ "gradient_checkpointing": false,
8
+ "hidden_act": "gelu",
9
+ "hidden_dropout_prob": 0.1,
10
+ "hidden_size": 384,
11
+ "initializer_range": 0.02,
12
+ "intermediate_size": 1536,
13
+ "layer_norm_eps": 1e-12,
14
+ "max_position_embeddings": 512,
15
+ "model_type": "bert",
16
+ "num_attention_heads": 12,
17
+ "num_hidden_layers": 6,
18
+ "pad_token_id": 0,
19
+ "position_embedding_type": "absolute",
20
+ "torch_dtype": "float32",
21
+ "transformers_version": "4.51.3",
22
+ "type_vocab_size": 2,
23
+ "use_cache": true,
24
+ "vocab_size": 30522
25
+ }
config_sentence_transformers.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "__version__": {
3
+ "sentence_transformers": "3.4.1",
4
+ "transformers": "4.51.3",
5
+ "pytorch": "2.5.1+cu124"
6
+ },
7
+ "prompts": {},
8
+ "default_prompt_name": null,
9
+ "similarity_fn_name": "cosine"
10
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74a8990de35dec8461b18fc8570b510c44670f34da06b408dab8c400cdddd02d
3
+ size 90864192
modules.json ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "idx": 0,
4
+ "name": "0",
5
+ "path": "",
6
+ "type": "sentence_transformers.models.Transformer"
7
+ },
8
+ {
9
+ "idx": 1,
10
+ "name": "1",
11
+ "path": "1_Pooling",
12
+ "type": "sentence_transformers.models.Pooling"
13
+ },
14
+ {
15
+ "idx": 2,
16
+ "name": "2",
17
+ "path": "2_Normalize",
18
+ "type": "sentence_transformers.models.Normalize"
19
+ }
20
+ ]
sentence_bert_config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "max_seq_length": 256,
3
+ "do_lower_case": false
4
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": {
3
+ "content": "[CLS]",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "mask_token": {
10
+ "content": "[MASK]",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "[PAD]",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "sep_token": {
24
+ "content": "[SEP]",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "unk_token": {
31
+ "content": "[UNK]",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ }
37
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": false,
45
+ "cls_token": "[CLS]",
46
+ "do_basic_tokenize": true,
47
+ "do_lower_case": true,
48
+ "extra_special_tokens": {},
49
+ "mask_token": "[MASK]",
50
+ "max_length": 128,
51
+ "model_max_length": 256,
52
+ "never_split": null,
53
+ "pad_to_multiple_of": null,
54
+ "pad_token": "[PAD]",
55
+ "pad_token_type_id": 0,
56
+ "padding_side": "right",
57
+ "sep_token": "[SEP]",
58
+ "stride": 0,
59
+ "strip_accents": null,
60
+ "tokenize_chinese_chars": true,
61
+ "tokenizer_class": "BertTokenizer",
62
+ "truncation_side": "right",
63
+ "truncation_strategy": "longest_first",
64
+ "unk_token": "[UNK]"
65
+ }
vocab.txt ADDED
The diff for this file is too large to render. See raw diff