Sentence Similarity
sentence-transformers
Safetensors
bert
feature-extraction
Generated from Trainer
dataset_size:46716
loss:MultipleNegativesRankingLoss
Eval Results (legacy)
text-embeddings-inference
Instructions to use NilsML/fine_tuned_miniLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use NilsML/fine_tuned_miniLM with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("NilsML/fine_tuned_miniLM") sentences = [ "Structurally, diplomonads have two equal-sized what and multiple flagella?", "deciding when to buy or sell a stock is not an easy task because the market is hard to predict, being influenced by political and economic factors. thus, methodologies based on computational intelligence have been applied to this challenging problem. in this work, every day the stocks are ranked by technique for order preference by similarity to ideal solution ( topsis ) using technical analysis criteria, and the most suitable stock is selected for purchase. even so, it may occur that the market is not favorable to purchase on certain days, or even, the topsis make an incorrect selection. to improve the selection, another method should be used. so, a hybrid", "we present the analysis of the brightest flare that was recorded in the \\ emph { insight } - hmxt data set, in a broad energy range ( 2 $ - $ 200 kev ) from the microquasar grs ~ 1915 + 105 during an unusual low - luminosity state. this flare was detected by \\ emph { insight } - hxmt among a series of flares during 2 june 2019 utc 16 : 37 : 06 to 20 : 11 : 36, with a 2 - 200 kev luminosity of 3. 4 $ - $ 7. 27 $ \\ times10 ^ { 38 } $ er", "nuclei" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
Upload folder using huggingface_hub
Browse files- 1_Pooling/config.json +10 -0
- README.md +535 -0
- config.json +25 -0
- config_sentence_transformers.json +10 -0
- eval/Information-Retrieval_evaluation_sciq-eval_results.csv +3 -0
- model.safetensors +3 -0
- modules.json +20 -0
- sentence_bert_config.json +4 -0
- special_tokens_map.json +37 -0
- tokenizer.json +0 -0
- tokenizer_config.json +65 -0
- vocab.txt +0 -0
1_Pooling/config.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"word_embedding_dimension": 384,
|
| 3 |
+
"pooling_mode_cls_token": false,
|
| 4 |
+
"pooling_mode_mean_tokens": true,
|
| 5 |
+
"pooling_mode_max_tokens": false,
|
| 6 |
+
"pooling_mode_mean_sqrt_len_tokens": false,
|
| 7 |
+
"pooling_mode_weightedmean_tokens": false,
|
| 8 |
+
"pooling_mode_lasttoken": false,
|
| 9 |
+
"include_prompt": true
|
| 10 |
+
}
|
README.md
ADDED
|
@@ -0,0 +1,535 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- sentence-transformers
|
| 4 |
+
- sentence-similarity
|
| 5 |
+
- feature-extraction
|
| 6 |
+
- generated_from_trainer
|
| 7 |
+
- dataset_size:46716
|
| 8 |
+
- loss:MultipleNegativesRankingLoss
|
| 9 |
+
base_model: sentence-transformers/all-MiniLM-L6-v2
|
| 10 |
+
widget:
|
| 11 |
+
- source_sentence: Structurally, diplomonads have two equal-sized what and multiple
|
| 12 |
+
flagella?
|
| 13 |
+
sentences:
|
| 14 |
+
- deciding when to buy or sell a stock is not an easy task because the market is
|
| 15 |
+
hard to predict, being influenced by political and economic factors. thus, methodologies
|
| 16 |
+
based on computational intelligence have been applied to this challenging problem.
|
| 17 |
+
in this work, every day the stocks are ranked by technique for order preference
|
| 18 |
+
by similarity to ideal solution ( topsis ) using technical analysis criteria,
|
| 19 |
+
and the most suitable stock is selected for purchase. even so, it may occur that
|
| 20 |
+
the market is not favorable to purchase on certain days, or even, the topsis make
|
| 21 |
+
an incorrect selection. to improve the selection, another method should be used.
|
| 22 |
+
so, a hybrid
|
| 23 |
+
- 'we present the analysis of the brightest flare that was recorded in the \ emph
|
| 24 |
+
{ insight } - hmxt data set, in a broad energy range ( 2 $ - $ 200 kev ) from
|
| 25 |
+
the microquasar grs ~ 1915 + 105 during an unusual low - luminosity state. this
|
| 26 |
+
flare was detected by \ emph { insight } - hxmt among a series of flares during
|
| 27 |
+
2 june 2019 utc 16 : 37 : 06 to 20 : 11 : 36, with a 2 - 200 kev luminosity of
|
| 28 |
+
3. 4 $ - $ 7. 27 $ \ times10 ^ { 38 } $ er'
|
| 29 |
+
- nuclei
|
| 30 |
+
- source_sentence: What instruments used in guidance systems to indicate directions
|
| 31 |
+
in space must have an angular momentum that does not change in direction?
|
| 32 |
+
sentences:
|
| 33 |
+
- magnetic and transport properties of near - stoichiometric metastable fexmnygaz
|
| 34 |
+
alloys ( 46 < x < 52, 17 < y25, 26 < z < 30 ) with face - centered cubic ( fcc
|
| 35 |
+
), body - centered cubic ( bcc ), and two - phase ( fcc + bcc ) structures are
|
| 36 |
+
investigated. the experimental results are analyzed in terms of first - principles
|
| 37 |
+
calculations of stoichiometric fe2mnga alloy with the l21, l12, and the tetragonally
|
| 38 |
+
distorted l21 structural orderings. it is shown that the pure bcc and fcc phases
|
| 39 |
+
have distinct magnetic
|
| 40 |
+
- k nearest neighbor ( knn ) joins are used in scientific domains for data analysis,
|
| 41 |
+
and are building blocks of several well - known algorithms. knn - joins find the
|
| 42 |
+
knn of all points in a dataset. this paper focuses on a hybrid cpu / gpu approach
|
| 43 |
+
for low - dimensional knn - joins, where the gpu may not yield substantial performance
|
| 44 |
+
gains over parallel cpu algorithms. we utilize a work queue that prioritizes computing
|
| 45 |
+
data points in high density regions on the gpu, and low density regions on the
|
| 46 |
+
cpu, thereby taking advantage of each architecture ' s relative strengths. our
|
| 47 |
+
approach, hybridknn - join,
|
| 48 |
+
- the fact that these states are effectively decoupled from propagating photons.
|
| 49 |
+
we prove that scattering of a parity - invariant single photon on a qubit pair,
|
| 50 |
+
combined with a properly engineered time variation of the qubit detuning, is not
|
| 51 |
+
only feasible, but also more effective than strategies based on the relaxation
|
| 52 |
+
of the excited states of the qubits. the use of tensor network methods to simulate
|
| 53 |
+
the proposed scheme enables to include photon delays in collision models, thus
|
| 54 |
+
opening the possibility to follow the time evolution of the full quantum system,
|
| 55 |
+
including qubits and field, and to efficiently implement and characterize the
|
| 56 |
+
dynamics in non
|
| 57 |
+
- source_sentence: If pollination and fertilization occur, a diploid zygote forms
|
| 58 |
+
within an ovule, located where
|
| 59 |
+
sentences:
|
| 60 |
+
- while cosmic rays $ ( e \ gtrsim 1 \, \ mathrm { gev } ) $ are well coupled to
|
| 61 |
+
a galaxy ' s interstellar medium ( ism ) at scales of $ l > 100 \, \ mathrm {
|
| 62 |
+
pc } $, adjusting stratification and driving outflows, their impact on small scales
|
| 63 |
+
is less clear. based on calculations of the cosmic ray diffusion coefficient from
|
| 64 |
+
observations of the grammage in the milky way, cosmic rays have little time to
|
| 65 |
+
dynamically impact the ism on those small scales. using numerical simulations,
|
| 66 |
+
we explore how more complex cosmic ray transport could allow cosmic rays to couple
|
| 67 |
+
- centripetal force
|
| 68 |
+
- derived simple analytical expressions for the maximum growth rate, corresponding
|
| 69 |
+
to the most unstable mode of the system. these expressions provide the explicit
|
| 70 |
+
dependence of the growth rate on the various equilibrium parameters. for small
|
| 71 |
+
angles the growth time is linearly proportional to the shear angle, and in this
|
| 72 |
+
regime the single interface problem and the slab problem tend to the same result.
|
| 73 |
+
on the contrary, in the limit of large angles and for the interface problem the
|
| 74 |
+
growth time is essentially independent of the shear angle. in this regime we have
|
| 75 |
+
also been able to calculate an approximate expression for the growth time for
|
| 76 |
+
the slab configuration. magnetic shear can have a strong effect on the growth
|
| 77 |
+
rates
|
| 78 |
+
- source_sentence: When the hydrogen is nearly used up, the star can fuse which element
|
| 79 |
+
into heavier elements?
|
| 80 |
+
sentences:
|
| 81 |
+
- the 50 ~ kton iron calorimeter ( ical ) detector at the underground india based
|
| 82 |
+
neutrino observatory ( ino ) will make measurements on atmospheric neutrinos.
|
| 83 |
+
muons produced in charged current ( cc ) interactions of muon neutrinos with the
|
| 84 |
+
iron are tracked spatially and temporally through the signals that they produce
|
| 85 |
+
in the resistive plate chambers ~ ( rpcs ) that are interleaved with iron layers.
|
| 86 |
+
since the rpcs will be operated in the avalanche mode the signal rise - time is
|
| 87 |
+
$ \ sim ~ 1 ~ \ rm { nsec } $ resulting in a fast time response
|
| 88 |
+
- magnesium in air
|
| 89 |
+
- pbhs. after discussing pbh formation as well as several inflation models leading
|
| 90 |
+
to pbh production, we summarize various existing and future observational constraints.
|
| 91 |
+
we then present topics on formation of pbh binaries, gravitational waves from
|
| 92 |
+
pbh binaries, various observational tests of pbhs by using gravitational waves.
|
| 93 |
+
- source_sentence: How many different main types of diabetes are there?
|
| 94 |
+
sentences:
|
| 95 |
+
- skin
|
| 96 |
+
- two
|
| 97 |
+
- a connection between relativistic quantum mechanics in the foldy - wouthuysen
|
| 98 |
+
representation and the paraxial equations is established for a dirac particle
|
| 99 |
+
in external fields. the paraxial form of the landau eigenfunction for a relativistic
|
| 100 |
+
electron in a uniform magnetic field is determined. the obtained wave function
|
| 101 |
+
contains the gouy phase and significantly approaches to the paraxial wave function
|
| 102 |
+
for a free electron.
|
| 103 |
+
pipeline_tag: sentence-similarity
|
| 104 |
+
library_name: sentence-transformers
|
| 105 |
+
metrics:
|
| 106 |
+
- cosine_accuracy@1
|
| 107 |
+
- cosine_accuracy@3
|
| 108 |
+
- cosine_accuracy@5
|
| 109 |
+
- cosine_accuracy@10
|
| 110 |
+
- cosine_precision@1
|
| 111 |
+
- cosine_precision@3
|
| 112 |
+
- cosine_precision@5
|
| 113 |
+
- cosine_precision@10
|
| 114 |
+
- cosine_recall@1
|
| 115 |
+
- cosine_recall@3
|
| 116 |
+
- cosine_recall@5
|
| 117 |
+
- cosine_recall@10
|
| 118 |
+
- cosine_ndcg@10
|
| 119 |
+
- cosine_mrr@10
|
| 120 |
+
- cosine_map@100
|
| 121 |
+
model-index:
|
| 122 |
+
- name: SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2
|
| 123 |
+
results:
|
| 124 |
+
- task:
|
| 125 |
+
type: information-retrieval
|
| 126 |
+
name: Information Retrieval
|
| 127 |
+
dataset:
|
| 128 |
+
name: sciq eval
|
| 129 |
+
type: sciq-eval
|
| 130 |
+
metrics:
|
| 131 |
+
- type: cosine_accuracy@1
|
| 132 |
+
value: 0.084
|
| 133 |
+
name: Cosine Accuracy@1
|
| 134 |
+
- type: cosine_accuracy@3
|
| 135 |
+
value: 0.192
|
| 136 |
+
name: Cosine Accuracy@3
|
| 137 |
+
- type: cosine_accuracy@5
|
| 138 |
+
value: 0.26
|
| 139 |
+
name: Cosine Accuracy@5
|
| 140 |
+
- type: cosine_accuracy@10
|
| 141 |
+
value: 0.367
|
| 142 |
+
name: Cosine Accuracy@10
|
| 143 |
+
- type: cosine_precision@1
|
| 144 |
+
value: 0.084
|
| 145 |
+
name: Cosine Precision@1
|
| 146 |
+
- type: cosine_precision@3
|
| 147 |
+
value: 0.064
|
| 148 |
+
name: Cosine Precision@3
|
| 149 |
+
- type: cosine_precision@5
|
| 150 |
+
value: 0.052
|
| 151 |
+
name: Cosine Precision@5
|
| 152 |
+
- type: cosine_precision@10
|
| 153 |
+
value: 0.0367
|
| 154 |
+
name: Cosine Precision@10
|
| 155 |
+
- type: cosine_recall@1
|
| 156 |
+
value: 0.084
|
| 157 |
+
name: Cosine Recall@1
|
| 158 |
+
- type: cosine_recall@3
|
| 159 |
+
value: 0.192
|
| 160 |
+
name: Cosine Recall@3
|
| 161 |
+
- type: cosine_recall@5
|
| 162 |
+
value: 0.26
|
| 163 |
+
name: Cosine Recall@5
|
| 164 |
+
- type: cosine_recall@10
|
| 165 |
+
value: 0.367
|
| 166 |
+
name: Cosine Recall@10
|
| 167 |
+
- type: cosine_ndcg@10
|
| 168 |
+
value: 0.20773622543165599
|
| 169 |
+
name: Cosine Ndcg@10
|
| 170 |
+
- type: cosine_mrr@10
|
| 171 |
+
value: 0.1588857142857143
|
| 172 |
+
name: Cosine Mrr@10
|
| 173 |
+
- type: cosine_map@100
|
| 174 |
+
value: 0.17411230071844377
|
| 175 |
+
name: Cosine Map@100
|
| 176 |
+
---
|
| 177 |
+
|
| 178 |
+
# SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2
|
| 179 |
+
|
| 180 |
+
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
|
| 181 |
+
|
| 182 |
+
## Model Details
|
| 183 |
+
|
| 184 |
+
### Model Description
|
| 185 |
+
- **Model Type:** Sentence Transformer
|
| 186 |
+
- **Base model:** [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) <!-- at revision c9745ed1d9f207416be6d2e6f8de32d1f16199bf -->
|
| 187 |
+
- **Maximum Sequence Length:** 256 tokens
|
| 188 |
+
- **Output Dimensionality:** 384 dimensions
|
| 189 |
+
- **Similarity Function:** Cosine Similarity
|
| 190 |
+
<!-- - **Training Dataset:** Unknown -->
|
| 191 |
+
<!-- - **Language:** Unknown -->
|
| 192 |
+
<!-- - **License:** Unknown -->
|
| 193 |
+
|
| 194 |
+
### Model Sources
|
| 195 |
+
|
| 196 |
+
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
|
| 197 |
+
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
|
| 198 |
+
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
|
| 199 |
+
|
| 200 |
+
### Full Model Architecture
|
| 201 |
+
|
| 202 |
+
```
|
| 203 |
+
SentenceTransformer(
|
| 204 |
+
(0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel
|
| 205 |
+
(1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
|
| 206 |
+
(2): Normalize()
|
| 207 |
+
)
|
| 208 |
+
```
|
| 209 |
+
|
| 210 |
+
## Usage
|
| 211 |
+
|
| 212 |
+
### Direct Usage (Sentence Transformers)
|
| 213 |
+
|
| 214 |
+
First install the Sentence Transformers library:
|
| 215 |
+
|
| 216 |
+
```bash
|
| 217 |
+
pip install -U sentence-transformers
|
| 218 |
+
```
|
| 219 |
+
|
| 220 |
+
Then you can load this model and run inference.
|
| 221 |
+
```python
|
| 222 |
+
from sentence_transformers import SentenceTransformer
|
| 223 |
+
|
| 224 |
+
# Download from the 🤗 Hub
|
| 225 |
+
model = SentenceTransformer("sentence_transformers_model_id")
|
| 226 |
+
# Run inference
|
| 227 |
+
sentences = [
|
| 228 |
+
'How many different main types of diabetes are there?',
|
| 229 |
+
'two',
|
| 230 |
+
'a connection between relativistic quantum mechanics in the foldy - wouthuysen representation and the paraxial equations is established for a dirac particle in external fields. the paraxial form of the landau eigenfunction for a relativistic electron in a uniform magnetic field is determined. the obtained wave function contains the gouy phase and significantly approaches to the paraxial wave function for a free electron.',
|
| 231 |
+
]
|
| 232 |
+
embeddings = model.encode(sentences)
|
| 233 |
+
print(embeddings.shape)
|
| 234 |
+
# [3, 384]
|
| 235 |
+
|
| 236 |
+
# Get the similarity scores for the embeddings
|
| 237 |
+
similarities = model.similarity(embeddings, embeddings)
|
| 238 |
+
print(similarities.shape)
|
| 239 |
+
# [3, 3]
|
| 240 |
+
```
|
| 241 |
+
|
| 242 |
+
<!--
|
| 243 |
+
### Direct Usage (Transformers)
|
| 244 |
+
|
| 245 |
+
<details><summary>Click to see the direct usage in Transformers</summary>
|
| 246 |
+
|
| 247 |
+
</details>
|
| 248 |
+
-->
|
| 249 |
+
|
| 250 |
+
<!--
|
| 251 |
+
### Downstream Usage (Sentence Transformers)
|
| 252 |
+
|
| 253 |
+
You can finetune this model on your own dataset.
|
| 254 |
+
|
| 255 |
+
<details><summary>Click to expand</summary>
|
| 256 |
+
|
| 257 |
+
</details>
|
| 258 |
+
-->
|
| 259 |
+
|
| 260 |
+
<!--
|
| 261 |
+
### Out-of-Scope Use
|
| 262 |
+
|
| 263 |
+
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
|
| 264 |
+
-->
|
| 265 |
+
|
| 266 |
+
## Evaluation
|
| 267 |
+
|
| 268 |
+
### Metrics
|
| 269 |
+
|
| 270 |
+
#### Information Retrieval
|
| 271 |
+
|
| 272 |
+
* Dataset: `sciq-eval`
|
| 273 |
+
* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator)
|
| 274 |
+
|
| 275 |
+
| Metric | Value |
|
| 276 |
+
|:--------------------|:-----------|
|
| 277 |
+
| cosine_accuracy@1 | 0.084 |
|
| 278 |
+
| cosine_accuracy@3 | 0.192 |
|
| 279 |
+
| cosine_accuracy@5 | 0.26 |
|
| 280 |
+
| cosine_accuracy@10 | 0.367 |
|
| 281 |
+
| cosine_precision@1 | 0.084 |
|
| 282 |
+
| cosine_precision@3 | 0.064 |
|
| 283 |
+
| cosine_precision@5 | 0.052 |
|
| 284 |
+
| cosine_precision@10 | 0.0367 |
|
| 285 |
+
| cosine_recall@1 | 0.084 |
|
| 286 |
+
| cosine_recall@3 | 0.192 |
|
| 287 |
+
| cosine_recall@5 | 0.26 |
|
| 288 |
+
| cosine_recall@10 | 0.367 |
|
| 289 |
+
| **cosine_ndcg@10** | **0.2077** |
|
| 290 |
+
| cosine_mrr@10 | 0.1589 |
|
| 291 |
+
| cosine_map@100 | 0.1741 |
|
| 292 |
+
|
| 293 |
+
<!--
|
| 294 |
+
## Bias, Risks and Limitations
|
| 295 |
+
|
| 296 |
+
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
|
| 297 |
+
-->
|
| 298 |
+
|
| 299 |
+
<!--
|
| 300 |
+
### Recommendations
|
| 301 |
+
|
| 302 |
+
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
|
| 303 |
+
-->
|
| 304 |
+
|
| 305 |
+
## Training Details
|
| 306 |
+
|
| 307 |
+
### Training Dataset
|
| 308 |
+
|
| 309 |
+
#### Unnamed Dataset
|
| 310 |
+
|
| 311 |
+
* Size: 46,716 training samples
|
| 312 |
+
* Columns: <code>sentence_0</code>, <code>sentence_1</code>, and <code>label</code>
|
| 313 |
+
* Approximate statistics based on the first 1000 samples:
|
| 314 |
+
| | sentence_0 | sentence_1 | label |
|
| 315 |
+
|:--------|:----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:---------------------------------------------------------------|
|
| 316 |
+
| type | string | string | float |
|
| 317 |
+
| details | <ul><li>min: 7 tokens</li><li>mean: 17.62 tokens</li><li>max: 63 tokens</li></ul> | <ul><li>min: 3 tokens</li><li>mean: 92.89 tokens</li><li>max: 133 tokens</li></ul> | <ul><li>min: 0.0</li><li>mean: 0.23</li><li>max: 1.0</li></ul> |
|
| 318 |
+
* Samples:
|
| 319 |
+
| sentence_0 | sentence_1 | label |
|
| 320 |
+
|:--------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
|
| 321 |
+
| <code>Unlike plants, animal species rely almost exclusively on what type of reproduction?</code> | <code>0. 4, \ sim 4, and \ sim 300 \ mum are stronger than 10 ^ 5, 10 ^ 8, and 10 ^ 4 times those of the local interstellar radiation field ( isrf ). below these values, the chemical pumping is the dominant source of excitation of the j > 1 levels, even at high kinetic temperatures ( \ sim 1000 k ). the far - infrared emission lines of ch + observed in the orion bar and the ngc 7027 pdrs are consistent with the predictions of our excitation model assuming an incident far - ultraviolet ( fuv ) radiation field of \ sim 3 \ times 10</code> | <code>0.0</code> |
|
| 322 |
+
| <code>What type of energy occurs by splitting the nuclei of radioactive uranium?</code> | <code>we study the potential of future electron - ion collider ( eic ) data to probe four - fermion operators in the standard model effective field theory ( smeft ). the ability to perform measurements with both polarized electron and proton beams at the eic provides a powerful tool that can disentangle the effects from different smeft operators. we compare the potential constraints from an eic with those obtained from drell - yan data at the large hadron collider. we show that eic data plays an important complementary role since it probes combinations of wilson coefficients not accessible through available drell - yan measurements.</code> | <code>0.0</code> |
|
| 323 |
+
| <code>What element, which often forms polymers, has a unique ability to form covalent bonds with many other atoms?</code> | <code>some divergent series $ f $. the convergence sets on $ \ gamma : = \ { [ 1 : z : \ psi ( z ) ] : z \ in \ mathbb { c } \ } \ subset \ mathbb { c } ^ 2 \ subset \ mathbb { p } ^ 2 $, where $ \ psi $ is a transcendental entire holomorphic function, are also studied and we obtain that a subset on $ \ gamma $ is a convergence set in $ \ mathbb { p } ^ 2 $ if and only if it is a countable union of compact projectively convex sets, and</code> | <code>0.0</code> |
|
| 324 |
+
* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
|
| 325 |
+
```json
|
| 326 |
+
{
|
| 327 |
+
"scale": 20.0,
|
| 328 |
+
"similarity_fct": "cos_sim"
|
| 329 |
+
}
|
| 330 |
+
```
|
| 331 |
+
|
| 332 |
+
### Training Hyperparameters
|
| 333 |
+
#### Non-Default Hyperparameters
|
| 334 |
+
|
| 335 |
+
- `eval_strategy`: steps
|
| 336 |
+
- `per_device_train_batch_size`: 32
|
| 337 |
+
- `per_device_eval_batch_size`: 32
|
| 338 |
+
- `num_train_epochs`: 1
|
| 339 |
+
- `multi_dataset_batch_sampler`: round_robin
|
| 340 |
+
|
| 341 |
+
#### All Hyperparameters
|
| 342 |
+
<details><summary>Click to expand</summary>
|
| 343 |
+
|
| 344 |
+
- `overwrite_output_dir`: False
|
| 345 |
+
- `do_predict`: False
|
| 346 |
+
- `eval_strategy`: steps
|
| 347 |
+
- `prediction_loss_only`: True
|
| 348 |
+
- `per_device_train_batch_size`: 32
|
| 349 |
+
- `per_device_eval_batch_size`: 32
|
| 350 |
+
- `per_gpu_train_batch_size`: None
|
| 351 |
+
- `per_gpu_eval_batch_size`: None
|
| 352 |
+
- `gradient_accumulation_steps`: 1
|
| 353 |
+
- `eval_accumulation_steps`: None
|
| 354 |
+
- `torch_empty_cache_steps`: None
|
| 355 |
+
- `learning_rate`: 5e-05
|
| 356 |
+
- `weight_decay`: 0.0
|
| 357 |
+
- `adam_beta1`: 0.9
|
| 358 |
+
- `adam_beta2`: 0.999
|
| 359 |
+
- `adam_epsilon`: 1e-08
|
| 360 |
+
- `max_grad_norm`: 1
|
| 361 |
+
- `num_train_epochs`: 1
|
| 362 |
+
- `max_steps`: -1
|
| 363 |
+
- `lr_scheduler_type`: linear
|
| 364 |
+
- `lr_scheduler_kwargs`: {}
|
| 365 |
+
- `warmup_ratio`: 0.0
|
| 366 |
+
- `warmup_steps`: 0
|
| 367 |
+
- `log_level`: passive
|
| 368 |
+
- `log_level_replica`: warning
|
| 369 |
+
- `log_on_each_node`: True
|
| 370 |
+
- `logging_nan_inf_filter`: True
|
| 371 |
+
- `save_safetensors`: True
|
| 372 |
+
- `save_on_each_node`: False
|
| 373 |
+
- `save_only_model`: False
|
| 374 |
+
- `restore_callback_states_from_checkpoint`: False
|
| 375 |
+
- `no_cuda`: False
|
| 376 |
+
- `use_cpu`: False
|
| 377 |
+
- `use_mps_device`: False
|
| 378 |
+
- `seed`: 42
|
| 379 |
+
- `data_seed`: None
|
| 380 |
+
- `jit_mode_eval`: False
|
| 381 |
+
- `use_ipex`: False
|
| 382 |
+
- `bf16`: False
|
| 383 |
+
- `fp16`: False
|
| 384 |
+
- `fp16_opt_level`: O1
|
| 385 |
+
- `half_precision_backend`: auto
|
| 386 |
+
- `bf16_full_eval`: False
|
| 387 |
+
- `fp16_full_eval`: False
|
| 388 |
+
- `tf32`: None
|
| 389 |
+
- `local_rank`: 0
|
| 390 |
+
- `ddp_backend`: None
|
| 391 |
+
- `tpu_num_cores`: None
|
| 392 |
+
- `tpu_metrics_debug`: False
|
| 393 |
+
- `debug`: []
|
| 394 |
+
- `dataloader_drop_last`: False
|
| 395 |
+
- `dataloader_num_workers`: 0
|
| 396 |
+
- `dataloader_prefetch_factor`: None
|
| 397 |
+
- `past_index`: -1
|
| 398 |
+
- `disable_tqdm`: False
|
| 399 |
+
- `remove_unused_columns`: True
|
| 400 |
+
- `label_names`: None
|
| 401 |
+
- `load_best_model_at_end`: False
|
| 402 |
+
- `ignore_data_skip`: False
|
| 403 |
+
- `fsdp`: []
|
| 404 |
+
- `fsdp_min_num_params`: 0
|
| 405 |
+
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
|
| 406 |
+
- `tp_size`: 0
|
| 407 |
+
- `fsdp_transformer_layer_cls_to_wrap`: None
|
| 408 |
+
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
|
| 409 |
+
- `deepspeed`: None
|
| 410 |
+
- `label_smoothing_factor`: 0.0
|
| 411 |
+
- `optim`: adamw_torch
|
| 412 |
+
- `optim_args`: None
|
| 413 |
+
- `adafactor`: False
|
| 414 |
+
- `group_by_length`: False
|
| 415 |
+
- `length_column_name`: length
|
| 416 |
+
- `ddp_find_unused_parameters`: None
|
| 417 |
+
- `ddp_bucket_cap_mb`: None
|
| 418 |
+
- `ddp_broadcast_buffers`: False
|
| 419 |
+
- `dataloader_pin_memory`: True
|
| 420 |
+
- `dataloader_persistent_workers`: False
|
| 421 |
+
- `skip_memory_metrics`: True
|
| 422 |
+
- `use_legacy_prediction_loop`: False
|
| 423 |
+
- `push_to_hub`: False
|
| 424 |
+
- `resume_from_checkpoint`: None
|
| 425 |
+
- `hub_model_id`: None
|
| 426 |
+
- `hub_strategy`: every_save
|
| 427 |
+
- `hub_private_repo`: None
|
| 428 |
+
- `hub_always_push`: False
|
| 429 |
+
- `gradient_checkpointing`: False
|
| 430 |
+
- `gradient_checkpointing_kwargs`: None
|
| 431 |
+
- `include_inputs_for_metrics`: False
|
| 432 |
+
- `include_for_metrics`: []
|
| 433 |
+
- `eval_do_concat_batches`: True
|
| 434 |
+
- `fp16_backend`: auto
|
| 435 |
+
- `push_to_hub_model_id`: None
|
| 436 |
+
- `push_to_hub_organization`: None
|
| 437 |
+
- `mp_parameters`:
|
| 438 |
+
- `auto_find_batch_size`: False
|
| 439 |
+
- `full_determinism`: False
|
| 440 |
+
- `torchdynamo`: None
|
| 441 |
+
- `ray_scope`: last
|
| 442 |
+
- `ddp_timeout`: 1800
|
| 443 |
+
- `torch_compile`: False
|
| 444 |
+
- `torch_compile_backend`: None
|
| 445 |
+
- `torch_compile_mode`: None
|
| 446 |
+
- `include_tokens_per_second`: False
|
| 447 |
+
- `include_num_input_tokens_seen`: False
|
| 448 |
+
- `neftune_noise_alpha`: None
|
| 449 |
+
- `optim_target_modules`: None
|
| 450 |
+
- `batch_eval_metrics`: False
|
| 451 |
+
- `eval_on_start`: False
|
| 452 |
+
- `use_liger_kernel`: False
|
| 453 |
+
- `eval_use_gather_object`: False
|
| 454 |
+
- `average_tokens_across_devices`: False
|
| 455 |
+
- `prompts`: None
|
| 456 |
+
- `batch_sampler`: batch_sampler
|
| 457 |
+
- `multi_dataset_batch_sampler`: round_robin
|
| 458 |
+
|
| 459 |
+
</details>
|
| 460 |
+
|
| 461 |
+
### Training Logs
|
| 462 |
+
| Epoch | Step | Training Loss | sciq-eval_cosine_ndcg@10 |
|
| 463 |
+
|:------:|:----:|:-------------:|:------------------------:|
|
| 464 |
+
| 0.0685 | 100 | - | 0.1200 |
|
| 465 |
+
| 0.1370 | 200 | - | 0.1562 |
|
| 466 |
+
| 0.2055 | 300 | - | 0.1780 |
|
| 467 |
+
| 0.2740 | 400 | - | 0.1811 |
|
| 468 |
+
| 0.3425 | 500 | 3.1705 | 0.1909 |
|
| 469 |
+
| 0.4110 | 600 | - | 0.1904 |
|
| 470 |
+
| 0.4795 | 700 | - | 0.1955 |
|
| 471 |
+
| 0.5479 | 800 | - | 0.2031 |
|
| 472 |
+
| 0.6164 | 900 | - | 0.2014 |
|
| 473 |
+
| 0.6849 | 1000 | 2.9054 | 0.2002 |
|
| 474 |
+
| 0.7534 | 1100 | - | 0.2058 |
|
| 475 |
+
| 0.8219 | 1200 | - | 0.2083 |
|
| 476 |
+
| 0.8904 | 1300 | - | 0.2084 |
|
| 477 |
+
| 0.9589 | 1400 | - | 0.2076 |
|
| 478 |
+
| 1.0 | 1460 | - | 0.2077 |
|
| 479 |
+
|
| 480 |
+
|
| 481 |
+
### Framework Versions
|
| 482 |
+
- Python: 3.12.8
|
| 483 |
+
- Sentence Transformers: 3.4.1
|
| 484 |
+
- Transformers: 4.51.3
|
| 485 |
+
- PyTorch: 2.5.1+cu124
|
| 486 |
+
- Accelerate: 1.3.0
|
| 487 |
+
- Datasets: 3.2.0
|
| 488 |
+
- Tokenizers: 0.21.0
|
| 489 |
+
|
| 490 |
+
## Citation
|
| 491 |
+
|
| 492 |
+
### BibTeX
|
| 493 |
+
|
| 494 |
+
#### Sentence Transformers
|
| 495 |
+
```bibtex
|
| 496 |
+
@inproceedings{reimers-2019-sentence-bert,
|
| 497 |
+
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
|
| 498 |
+
author = "Reimers, Nils and Gurevych, Iryna",
|
| 499 |
+
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
|
| 500 |
+
month = "11",
|
| 501 |
+
year = "2019",
|
| 502 |
+
publisher = "Association for Computational Linguistics",
|
| 503 |
+
url = "https://arxiv.org/abs/1908.10084",
|
| 504 |
+
}
|
| 505 |
+
```
|
| 506 |
+
|
| 507 |
+
#### MultipleNegativesRankingLoss
|
| 508 |
+
```bibtex
|
| 509 |
+
@misc{henderson2017efficient,
|
| 510 |
+
title={Efficient Natural Language Response Suggestion for Smart Reply},
|
| 511 |
+
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
|
| 512 |
+
year={2017},
|
| 513 |
+
eprint={1705.00652},
|
| 514 |
+
archivePrefix={arXiv},
|
| 515 |
+
primaryClass={cs.CL}
|
| 516 |
+
}
|
| 517 |
+
```
|
| 518 |
+
|
| 519 |
+
<!--
|
| 520 |
+
## Glossary
|
| 521 |
+
|
| 522 |
+
*Clearly define terms in order to be accessible across audiences.*
|
| 523 |
+
-->
|
| 524 |
+
|
| 525 |
+
<!--
|
| 526 |
+
## Model Card Authors
|
| 527 |
+
|
| 528 |
+
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
|
| 529 |
+
-->
|
| 530 |
+
|
| 531 |
+
<!--
|
| 532 |
+
## Model Card Contact
|
| 533 |
+
|
| 534 |
+
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
|
| 535 |
+
-->
|
config.json
ADDED
|
@@ -0,0 +1,25 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"architectures": [
|
| 3 |
+
"BertModel"
|
| 4 |
+
],
|
| 5 |
+
"attention_probs_dropout_prob": 0.1,
|
| 6 |
+
"classifier_dropout": null,
|
| 7 |
+
"gradient_checkpointing": false,
|
| 8 |
+
"hidden_act": "gelu",
|
| 9 |
+
"hidden_dropout_prob": 0.1,
|
| 10 |
+
"hidden_size": 384,
|
| 11 |
+
"initializer_range": 0.02,
|
| 12 |
+
"intermediate_size": 1536,
|
| 13 |
+
"layer_norm_eps": 1e-12,
|
| 14 |
+
"max_position_embeddings": 512,
|
| 15 |
+
"model_type": "bert",
|
| 16 |
+
"num_attention_heads": 12,
|
| 17 |
+
"num_hidden_layers": 6,
|
| 18 |
+
"pad_token_id": 0,
|
| 19 |
+
"position_embedding_type": "absolute",
|
| 20 |
+
"torch_dtype": "float32",
|
| 21 |
+
"transformers_version": "4.51.3",
|
| 22 |
+
"type_vocab_size": 2,
|
| 23 |
+
"use_cache": true,
|
| 24 |
+
"vocab_size": 30522
|
| 25 |
+
}
|
config_sentence_transformers.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"__version__": {
|
| 3 |
+
"sentence_transformers": "3.4.1",
|
| 4 |
+
"transformers": "4.51.3",
|
| 5 |
+
"pytorch": "2.5.1+cu124"
|
| 6 |
+
},
|
| 7 |
+
"prompts": {},
|
| 8 |
+
"default_prompt_name": null,
|
| 9 |
+
"similarity_fn_name": "cosine"
|
| 10 |
+
}
|
eval/Information-Retrieval_evaluation_sciq-eval_results.csv
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
epoch,steps,cosine-Accuracy@1,cosine-Accuracy@3,cosine-Accuracy@5,cosine-Accuracy@10,cosine-Precision@1,cosine-Recall@1,cosine-Precision@3,cosine-Recall@3,cosine-Precision@5,cosine-Recall@5,cosine-Precision@10,cosine-Recall@10,cosine-MRR@10,cosine-NDCG@10,cosine-MAP@100
|
| 2 |
+
1.0,1460,0.013,0.029,0.038,0.059,0.013,0.013,0.009666666666666665,0.029,0.007600000000000001,0.038,0.005900000000000001,0.059,0.024373015873015862,0.03240572420406316,0.029794303600999623
|
| 3 |
+
1.0,1460,0.084,0.192,0.26,0.367,0.084,0.084,0.064,0.192,0.052,0.26,0.0367,0.367,0.1588857142857143,0.20773622543165599,0.17411230071844377
|
model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e8aa1acedb6b15468abbbd574ccceaa9a3c4cc579752c2412433c9ae596b4ffa
|
| 3 |
+
size 90864192
|
modules.json
ADDED
|
@@ -0,0 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[
|
| 2 |
+
{
|
| 3 |
+
"idx": 0,
|
| 4 |
+
"name": "0",
|
| 5 |
+
"path": "",
|
| 6 |
+
"type": "sentence_transformers.models.Transformer"
|
| 7 |
+
},
|
| 8 |
+
{
|
| 9 |
+
"idx": 1,
|
| 10 |
+
"name": "1",
|
| 11 |
+
"path": "1_Pooling",
|
| 12 |
+
"type": "sentence_transformers.models.Pooling"
|
| 13 |
+
},
|
| 14 |
+
{
|
| 15 |
+
"idx": 2,
|
| 16 |
+
"name": "2",
|
| 17 |
+
"path": "2_Normalize",
|
| 18 |
+
"type": "sentence_transformers.models.Normalize"
|
| 19 |
+
}
|
| 20 |
+
]
|
sentence_bert_config.json
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"max_seq_length": 256,
|
| 3 |
+
"do_lower_case": false
|
| 4 |
+
}
|
special_tokens_map.json
ADDED
|
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"cls_token": {
|
| 3 |
+
"content": "[CLS]",
|
| 4 |
+
"lstrip": false,
|
| 5 |
+
"normalized": false,
|
| 6 |
+
"rstrip": false,
|
| 7 |
+
"single_word": false
|
| 8 |
+
},
|
| 9 |
+
"mask_token": {
|
| 10 |
+
"content": "[MASK]",
|
| 11 |
+
"lstrip": false,
|
| 12 |
+
"normalized": false,
|
| 13 |
+
"rstrip": false,
|
| 14 |
+
"single_word": false
|
| 15 |
+
},
|
| 16 |
+
"pad_token": {
|
| 17 |
+
"content": "[PAD]",
|
| 18 |
+
"lstrip": false,
|
| 19 |
+
"normalized": false,
|
| 20 |
+
"rstrip": false,
|
| 21 |
+
"single_word": false
|
| 22 |
+
},
|
| 23 |
+
"sep_token": {
|
| 24 |
+
"content": "[SEP]",
|
| 25 |
+
"lstrip": false,
|
| 26 |
+
"normalized": false,
|
| 27 |
+
"rstrip": false,
|
| 28 |
+
"single_word": false
|
| 29 |
+
},
|
| 30 |
+
"unk_token": {
|
| 31 |
+
"content": "[UNK]",
|
| 32 |
+
"lstrip": false,
|
| 33 |
+
"normalized": false,
|
| 34 |
+
"rstrip": false,
|
| 35 |
+
"single_word": false
|
| 36 |
+
}
|
| 37 |
+
}
|
tokenizer.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
tokenizer_config.json
ADDED
|
@@ -0,0 +1,65 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"added_tokens_decoder": {
|
| 3 |
+
"0": {
|
| 4 |
+
"content": "[PAD]",
|
| 5 |
+
"lstrip": false,
|
| 6 |
+
"normalized": false,
|
| 7 |
+
"rstrip": false,
|
| 8 |
+
"single_word": false,
|
| 9 |
+
"special": true
|
| 10 |
+
},
|
| 11 |
+
"100": {
|
| 12 |
+
"content": "[UNK]",
|
| 13 |
+
"lstrip": false,
|
| 14 |
+
"normalized": false,
|
| 15 |
+
"rstrip": false,
|
| 16 |
+
"single_word": false,
|
| 17 |
+
"special": true
|
| 18 |
+
},
|
| 19 |
+
"101": {
|
| 20 |
+
"content": "[CLS]",
|
| 21 |
+
"lstrip": false,
|
| 22 |
+
"normalized": false,
|
| 23 |
+
"rstrip": false,
|
| 24 |
+
"single_word": false,
|
| 25 |
+
"special": true
|
| 26 |
+
},
|
| 27 |
+
"102": {
|
| 28 |
+
"content": "[SEP]",
|
| 29 |
+
"lstrip": false,
|
| 30 |
+
"normalized": false,
|
| 31 |
+
"rstrip": false,
|
| 32 |
+
"single_word": false,
|
| 33 |
+
"special": true
|
| 34 |
+
},
|
| 35 |
+
"103": {
|
| 36 |
+
"content": "[MASK]",
|
| 37 |
+
"lstrip": false,
|
| 38 |
+
"normalized": false,
|
| 39 |
+
"rstrip": false,
|
| 40 |
+
"single_word": false,
|
| 41 |
+
"special": true
|
| 42 |
+
}
|
| 43 |
+
},
|
| 44 |
+
"clean_up_tokenization_spaces": false,
|
| 45 |
+
"cls_token": "[CLS]",
|
| 46 |
+
"do_basic_tokenize": true,
|
| 47 |
+
"do_lower_case": true,
|
| 48 |
+
"extra_special_tokens": {},
|
| 49 |
+
"mask_token": "[MASK]",
|
| 50 |
+
"max_length": 128,
|
| 51 |
+
"model_max_length": 512,
|
| 52 |
+
"never_split": null,
|
| 53 |
+
"pad_to_multiple_of": null,
|
| 54 |
+
"pad_token": "[PAD]",
|
| 55 |
+
"pad_token_type_id": 0,
|
| 56 |
+
"padding_side": "right",
|
| 57 |
+
"sep_token": "[SEP]",
|
| 58 |
+
"stride": 0,
|
| 59 |
+
"strip_accents": null,
|
| 60 |
+
"tokenize_chinese_chars": true,
|
| 61 |
+
"tokenizer_class": "BertTokenizer",
|
| 62 |
+
"truncation_side": "right",
|
| 63 |
+
"truncation_strategy": "longest_first",
|
| 64 |
+
"unk_token": "[UNK]"
|
| 65 |
+
}
|
vocab.txt
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|