Add finetuned model

checkpoint-98/1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+    "word_embedding_dimension": 768,
+    "pooling_mode_cls_token": false,
+    "pooling_mode_mean_tokens": true,
+    "pooling_mode_max_tokens": false,
+    "pooling_mode_mean_sqrt_len_tokens": false,
+    "pooling_mode_weightedmean_tokens": false,
+    "pooling_mode_lasttoken": false,
+    "include_prompt": true
+}

checkpoint-98/README.md

@@ -0,0 +1,1539 @@
+---
+language:
+- en
+license: apache-2.0
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- dense
+- generated_from_trainer
+- dataset_size:391
+- loss:MatryoshkaLoss
+- loss:MultipleNegativesRankingLoss
+base_model: nomic-ai/modernbert-embed-base
+widget:
+- source_sentence: What does 'personal data breach' entail?
+  sentences:
+  - '1.Processing of personal data revealing racial or ethnic origin, political opinions,
+    religious or philosophical beliefs, or trade union membership, and the processing
+    of genetic data, biometric data for the purpose of uniquely identifying a natural
+    person, data concerning health or data concerning a natural person''s sex life
+    or sexual orientation shall be prohibited.
+
+    2.Paragraph 1 shall not apply if one of the following applies: (a)  the data subject
+    has given explicit consent to the processing of those personal data for one or
+    more specified purposes, except where Union or Member State law provide that the
+    prohibition referred to in paragraph 1 may not be lifted by the data subject;
+    (b)  processing is necessary for the purposes of carrying out the obligations
+    and exercising specific rights of the controller or of the data subject in the
+    field of employment and social security and social protection law in so far as
+    it is authorised by Union or Member State law or a collective agreement pursuant
+    to Member State law providing for appropriate safeguards for the fundamental rights
+    and the interests of the data subject; (c)  processing is necessary to protect
+    the vital interests of the data subject or of another natural person where the
+    data subject is physically or legally incapable of giving consent; (d)  processing
+    is carried out in the course of its legitimate activities with appropriate safeguards
+    by a foundation, association or any other not-for-profit body with a political,
+    philosophical, religious or trade union aim and on condition that the processing
+    relates solely to the members or to former members of the body or to persons who
+    have regular contact with it in connection with its purposes and that the personal
+    data are not disclosed outside that body without the consent of the data subjects;
+    (e)  processing relates to personal data which are manifestly made public by the
+    data subject; (f)  processing is necessary for the establishment, exercise or
+    defence of legal claims or whenever courts are acting in their judicial capacity;
+    (g)  processing is necessary for reasons of substantial public interest, on the
+    basis of Union or Member State law which shall be proportionate to the aim pursued,
+    respect the essence of the right to data protection and provide for suitable and
+    specific measures to safeguard the fundamental rights and the interests of the
+    data subject; (h)  processing is necessary for the purposes of preventive or occupational
+    medicine, for the assessment of the working capacity of the employee, medical
+    diagnosis, the provision of health or social care or treatment or the management
+    of health or social care systems and services on the basis of Union or Member
+    State law or pursuant to contract with a health professional and subject to the
+    conditions and safeguards referred to in paragraph 3; (i)  processing is necessary
+    for reasons of public interest in the area of public health, such as protecting
+    against serious cross-border threats to health or ensuring high standards of quality
+    and safety of health care and of medicinal products or medical devices, on the
+    basis of Union or Member State law which provides for suitable and specific measures
+    to safeguard the rights and freedoms of the data subject, in particular professional
+    secrecy; 4.5.2016 L 119/38   (j)  processing is necessary for archiving purposes
+    in the public interest, scientific or historical research purposes or statistical
+    purposes in accordance with Article 89(1) based on Union or Member State law which
+    shall be proportionate to the aim pursued, respect the essence of the right to
+    data protection and provide for suitable and specific measures to safeguard the
+    fundamental rights and the interests of the data subject.
+
+    3.Personal data referred to in paragraph 1 may be processed for the purposes referred
+    to in point (h) of paragraph 2 when those data are processed by or under the responsibility
+    of a professional subject to the obligation of professional secrecy under Union
+    or Member State law or rules established by national competent bodies or by another
+    person also subject to an obligation of secrecy under Union or Member State law
+    or rules established by national competent bodies.
+
+    4.Member States may maintain or introduce further conditions, including limitations,
+    with regard to the processing of genetic data, biometric data or data concerning
+    health.'
+  - '1) ''personal data'' means any information relating to an identified or identifiable
+    natural person (''data subject''); an identifiable natural person is one who can
+    be identified, directly or indirectly, in particular by reference to an identifier
+    such as a name, an identification number, location data, an online identifier
+    or to one or more factors specific to the physical, physiological, genetic, mental,
+    economic, cultural or social identity of that natural person;
+
+    (2) ‘processing’ means any operation or set of operations which is performed on
+    personal data or on sets of personal data, whether or not by automated means,
+    such as collection, recording, organisation, structuring, storage, adaptation
+    or alteration, retrieval, consultation, use, disclosure by transmission, dissemination
+    or otherwise making available, alignment or combination, restriction, erasure
+    or destruction;
+
+    (3) ‘restriction of processing’ means the marking of stored personal data with
+    the aim of limiting their processing in the future;
+
+    (4) ‘profiling’ means any form of automated processing of personal data consisting
+    of the use of personal data to evaluate certain personal aspects relating to a
+    natural person, in particular to analyse or predict aspects concerning that natural
+    person''s performance at work, economic situation, health, personal preferences,
+    interests, reliability, behaviour, location or movements;
+
+    (5) ‘pseudonymisation’ means the processing of personal data in such a manner
+    that the personal data can no longer be attributed to a specific data subject
+    without the use of additional information, provided that such additional information
+    is kept separately and is subject to technical and organisational measures to
+    ensure that the personal data are not attributed to an identified or identifiable
+    natural person;
+
+    (6) ‘filing system’ means any structured set of personal data which are accessible
+    according to specific criteria, whether centralised, decentralised or dispersed
+    on a functional or geographical basis;
+
+    (7) ‘controller’ means the natural or legal person, public authority, agency or
+    other body which, alone or jointly with others, determines the purposes and means
+    of the processing of personal data; where the purposes and means of such processing
+    are determined by Union or Member State law, the controller or the specific criteria
+    for its nomination may be provided for by Union or Member State law;
+
+    (8) ‘processor’ means a natural or legal person, public authority, agency or other
+    body which processes personal data on behalf of the controller;
+
+    (9) ‘recipient’ means a natural or legal person, public authority, agency or another
+    body, to which the personal data are disclosed, whether a third party or not.
+    However, public authorities which may receive personal data in the framework of
+    a particular inquiry in accordance with Union or Member State law shall not be
+    regarded as recipients; the processing of those data by those public authorities
+    shall be in compliance with the applicable data protection rules according to
+    the purposes of the processing;
+
+    (10) ‘third party’ means a natural or legal person, public authority, agency or
+    body other than the data subject, controller, processor and persons who, under
+    the direct authority of the controller or processor, are authorised to process
+    personal data;
+
+    (11) ‘consent’ of the data subject means any freely given, specific, informed
+    and unambiguous indication of the data subject''s wishes by which he or she, by
+    a statement or by a clear affirmative action, signifies agreement to the processing
+    of personal data relating to him or her;
+
+    (12) ‘personal data breach’ means a breach of security leading to the accidental
+    or unlawful destruction, loss, alteration, unauthorised disclosure of, or access
+    to, personal data transmitted, stored or otherwise processed;
+
+    (13) ‘genetic data’ means personal data relating to the inherited or acquired
+    genetic characteristics of a natural person which give unique information about
+    the physiology or the health of that natural person and which result, in particular,
+    from an analysis of a biological sample from the natural person in question;
+
+    (14) ‘biometric data’ means personal data resulting from specific technical processing
+    relating to the physical, physiological or behavioural characteristics of a natural
+    person, which allow or confirm the unique identification of that natural person,
+    such as facial images or dactyloscopic data;
+
+    (15) ‘data concerning health’ means personal data related to the physical or mental
+    health of a natural person, including the provision of health care services, which
+    reveal information about his or her health status;
+
+    (16) ‘main establishment’ means: (a) as regards a controller with establishments
+    in more than one Member State, the place of its central administration in the
+    Union, unless the decisions on the purposes and means of the processing of personal
+    data are taken in another establishment of the controller in the Union and the
+    latter establishment has the power to have such decisions implemented, in which
+    case the establishment having taken such decisions is to be considered to be the
+    main establishment; (b) as regards a processor with establishments in more than
+    one Member State, the place of its central administration in the Union, or, if
+    the processor has no central administration in the Union, the establishment of
+    the processor in the Union where the main processing activities in the context
+    of the activities of an establishment of the processor take place to the extent
+    that the processor is subject to specific obligations under this Regulation;
+
+    (17) ‘representative’ means a natural or legal person established in the Union
+    who, designated by the controller or processor in writing pursuant to Article
+    27, represents the controller or processor with regard to their respective obligations
+    under this Regulation;
+
+    (18) ‘enterprise’ means a natural or legal person engaged in an economic activity,
+    irrespective of its legal form, including partnerships or associations regularly
+    engaged in an economic activity;
+
+    (19) ‘group of undertakings’ means a controlling undertaking and its controlled
+    undertakings;
+
+    (20) ‘binding corporate rules’ means personal data protection policies which are
+    adhered to by a controller or processor established on the territory of a Member
+    State for transfers or a set of transfers of personal data to a controller or
+    processor in one or more third countries within a group of undertakings, or group
+    of enterprises engaged in a joint economic activity;
+
+    (21) ‘supervisory authority’ means an independent public authority which is established
+    by a Member State pursuant to Article 51;
+
+    (22) ‘supervisory authority concerned’ means a supervisory authority which is
+    concerned by the processing of personal data because: (a) the controller or processor
+    is established on the territory of the Member State of that supervisory authority;
+    (b) data subjects residing in the Member State of that supervisory authority are
+    substantially affected or likely to be substantially affected by the processing;
+    or (c) a complaint has been lodged with that supervisory authority;
+
+    (23) ‘cross-border processing’ means either: (a) processing of personal data which
+    takes place in the context of the activities of establishments in more than one
+    Member State of a controller or processor in the Union where the controller or
+    processor is established in more than one Member State; or (b) processing of personal
+    data which takes place in the context of the activities of a single establishment
+    of a controller or processor in the Union but which substantially affects or is
+    likely to substantially affect data subjects in more than one Member State.
+
+    (24) ‘relevant and reasoned objection’ means an objection to a draft decision
+    as to whether there is an infringement of this Regulation, or whether envisaged
+    action in relation to the controller or processor complies with this Regulation,
+    which clearly demonstrates the significance of the risks posed by the draft decision
+    as regards the fundamental rights and freedoms of data subjects and, where applicable,
+    the free flow of personal data within the Union;
+
+    (25) ‘information society service’ means a service as defined in point (b) of
+    Article 1(1) of Directive (EU) 2015/1535 of the European Parliament and of the
+    Council (1);
+
+    (26) ‘international organisation’ means an organisation and its subordinate bodies
+    governed by public international law, or any other body which is set up by, or
+    on the basis of, an agreement between two or more countries.'
+  - Any processing of personal data should be lawful and fair. It should be transparent
+    to natural persons that personal data concerning them are collected, used, consulted
+    or otherwise processed and to what extent the personal data are or will be processed.
+    The principle of transparency requires that any information and communication
+    relating to the processing of those personal data be easily accessible and easy
+    to understand, and that clear and plain language be used. That principle concerns,
+    in particular, information to the data subjects on the identity of the controller
+    and the purposes of the processing and further information to ensure fair and
+    transparent processing in respect of the natural persons concerned and their right
+    to obtain confirmation and communication of personal data concerning them which
+    are being processed. Natural persons should be made aware of risks, rules, safeguards
+    and rights in relation to the processing of personal data and how to exercise
+    their rights in relation to such processing. In particular, the specific purposes
+    for which personal data are processed should be explicit and legitimate and determined
+    at the time of the collection of the personal data. The personal data should be
+    adequate, relevant and limited to what is necessary for the purposes for which
+    they are processed. This requires, in particular, ensuring that the period for
+    which the personal data are stored is limited to a strict minimum. Personal data
+    should be processed only if the purpose of the processing could not reasonably
+    be fulfilled by other means. In order to ensure that the personal data are not
+    kept longer than necessary, time limits should be established by the controller
+    for erasure or for a periodic review. Every reasonable step should be taken to
+    ensure that personal data which are inaccurate are rectified or deleted. Personal
+    data should be processed in a manner that ensures appropriate security and confidentiality
+    of the personal data, including for preventing unauthorised access to or use of
+    personal data and the equipment used for the processing.
+- source_sentence: In what situations could providing information to the data subject
+    be considered impossible or involve a disproportionate effort?
+  sentences:
+  - '1.The controller shall consult the supervisory authority prior to processing
+    where a data protection impact assessment under Article 35 indicates that the
+    processing would result in a high risk in the absence of measures taken by the
+    controller to mitigate the risk.
+
+    2.Where the supervisory authority is of the opinion that the intended processing
+    referred to in paragraph 1 would infringe this Regulation, in particular where
+    the controller has insufficiently identified or mitigated the risk, the supervisory
+    authority shall, within period of up to eight weeks of receipt of the request
+    for consultation, provide written advice to the controller and, where applicable
+    to the processor, and may use any of its powers referred to in Article 58. That
+    period may be extended by six weeks, taking into account the complexity of the
+    intended processing. The supervisory authority shall inform the controller and,
+    where applicable, the processor, of any such extension within one month of receipt
+    of the request for consultation together with the reasons for the delay. Those
+    periods may be suspended until the supervisory authority has obtained information
+    it has requested for the purposes of the consultation.
+
+    3.When consulting the supervisory authority pursuant to paragraph 1, the controller
+    shall provide the supervisory authority with: (a)  where applicable, the respective
+    responsibilities of the controller, joint controllers and processors involved
+    in the processing, in particular for processing within a group of undertakings;
+    (b)  the purposes and means of the intended processing; (c)  the measures and
+    safeguards provided to protect the rights and freedoms of data subjects pursuant
+    to this Regulation; (d)  where applicable, the contact details of the data protection
+    officer; 4.5.2016 L 119/54   (e)  the data protection impact assessment provided
+    for in Article 35; and (f)  any other information requested by the supervisory
+    authority.
+
+    4.Member States shall consult the supervisory authority during the preparation
+    of a proposal for a legislative measure to be adopted by a national parliament,
+    or of a regulatory measure based on such a legislative measure, which relates
+    to processing.
+
+    5.Notwithstanding paragraph 1, Member State law may require controllers to consult
+    with, and obtain prior authorisation from, the supervisory authority in relation
+    to processing by a controller for the performance of a task carried out by the
+    controller in the public interest, including processing in relation to social
+    protection and public health'
+  - "1.The Member States, the supervisory authorities, the Board and the Commission\
+    \ shall encourage, in particular at Union level, the establishment of data protection\
+    \ certification mechanisms and of data protection seals and marks, for the purpose\
+    \ of demonstrating compliance with this Regulation of processing operations by\
+    \ controllers and processors. The specific needs of micro, small and medium-sized\
+    \ enterprises shall be taken into account. 4.5.2016 L 119/58  \n2.In addition\
+    \ to adherence by controllers or processors subject to this Regulation, data protection\
+    \ certification mechanisms, seals or marks approved pursuant to paragraph 5 of\
+    \ this Article may be established for the purpose of demonstrating the existence\
+    \ of appropriate safeguards provided by controllers or processors that are not\
+    \ subject to this Regulation pursuant to Article 3 within the framework of personal\
+    \ data transfers to third countries or international organisations under the terms\
+    \ referred to in point (f) of Article 46(2). Such controllers or processors shall\
+    \ make binding and enforceable commitments, via contractual or other legally binding\
+    \ instruments, to apply those appropriate safeguards, including with regard to\
+    \ the rights of data subjects.\n3.The certification shall be voluntary and available\
+    \ via a process that is transparent.\n4.A certification pursuant to this Article\
+    \ does not reduce the responsibility of the controller or the processor for compliance\
+    \ with this Regulation and is without prejudice to the tasks and powers of the\
+    \ supervisory authorities which are competent pursuant to Article 55 or 56\n5.A\
+    \ certification pursuant to this Article shall be issued by the certification\
+    \ bodies referred to in Article 43 or by the competent supervisory authority,\
+    \ on the basis of criteria approved by that competent supervisory authority pursuant\
+    \ to Article 58(3) or by the Board pursuant to Article 63. Where the criteria\
+    \ are approved by the Board, this may result in a common certification, the European\
+    \ Data Protection Seal.\n6.The controller or processor which submits its processing\
+    \ to the certification mechanism shall provide the certification body referred\
+    \ to in Article 43, or where applicable, the competent supervisory authority,\
+    \ with all information and access to its processing activities which are necessary\
+    \ to conduct the certification procedure.\n7.Certification shall be issued to\
+    \ a controller or processor for a maximum period of three years and may be renewed,\
+    \ under the same conditions, provided that the relevant requirements continue\
+    \ to be met. Certification shall be withdrawn, as applicable, by the certification\
+    \ bodies referred to in Article 43 or by the competent supervisory authority where\
+    \ the requirements for the certification are not or are no longer met.\n8.The\
+    \ Board shall collate all certification mechanisms and data protection seals and\
+    \ marks in a register and shall make them publicly available by any appropriate\
+    \ means."
+  - However, it is not necessary to impose the obligation to provide information where
+    the data subject already possesses the information, where the recording or disclosure
+    of the personal data is expressly laid down by law or where the provision of information
+    to the data subject proves to be impossible or would involve a disproportionate
+    effort. The latter could in particular be the case where processing is carried
+    out for archiving purposes in the public interest, scientific or historical research
+    purposes or statistical purposes. In that regard, the number of data subjects,
+    the age of the data and any appropriate safeguards adopted should be taken into
+    consideration.
+- source_sentence: What is the data subject provided with prior to further processing
+    of personal data?
+  sentences:
+  - '1.Where personal data relating to a data subject are collected from the data
+    subject, the controller shall, at the time when personal data are obtained, provide
+    the data subject with all of the following information: (a)  the identity and
+    the contact details of the controller and, where applicable, of the controller''s
+    representative; (b)  the contact details of the data protection officer, where
+    applicable; (c)  the purposes of the processing for which the personal data are
+    intended as well as the legal basis for the processing; 4.5.2016 L 119/40   (d)  where
+    the processing is based on point (f) of Article 6(1), the legitimate interests
+    pursued by the controller or by a third party; (e)  the recipients or categories
+    of recipients of the personal data, if any; (f)  where applicable, the fact that
+    the controller intends to transfer personal data to a third country or international
+    organisation and the existence or absence of an adequacy decision by the Commission,
+    or in the case of transfers referred to in Article 46 or 47, or the second subparagraph
+    of Article 49(1), reference to the appropriate or suitable safeguards and the
+    means by which to obtain a copy of them or where they have been made available.
+
+    2.In addition to the information referred to in paragraph 1, the controller shall,
+    at the time when personal data are obtained, provide the data subject with the
+    following further information necessary to ensure fair and transparent processing:
+    (a)  the period for which the personal data will be stored, or if that is not
+    possible, the criteria used to determine that period; (b)  the existence of the
+    right to request from the controller access to and rectification or erasure of
+    personal data or restriction of processing concerning the data subject or to object
+    to processing as well as the right to data portability; (c)  where the processing
+    is based on point (a) of Article 6(1) or point (a) of Article 9(2), the existence
+    of the right to withdraw consent at any time, without affecting the lawfulness
+    of processing based on consent before its withdrawal; (d)  the right to lodge
+    a complaint with a supervisory authority; (e)  whether the provision of personal
+    data is a statutory or contractual requirement, or a requirement necessary to
+    enter into a contract, as well as whether the data subject is obliged to provide
+    the personal data and of the possible consequences of failure to provide such
+    data; (f)  the existence of automated decision-making, including profiling, referred
+    to in Article 22(1) and (4) and, at least in those cases, meaningful information
+    about the logic involved, as well as the significance and the envisaged consequences
+    of such processing for the data subject.
+
+    3.Where the controller intends to further process the personal data for a purpose
+    other than that for which the personal data were collected, the controller shall
+    provide the data subject prior to that further processing with information on
+    that other purpose and with any relevant further information as referred to in
+    paragraph 2
+
+    4.Paragraphs 1, 2 and 3 shall not apply where and insofar as the data subject
+    already has the information.'
+  - This Regulation respects and does not prejudice the status under existing constitutional
+    law of churches and religious associations or communities in the Member States,
+    as recognised in Article 17 TFEU.
+  - '1) ''personal data'' means any information relating to an identified or identifiable
+    natural person (''data subject''); an identifiable natural person is one who can
+    be identified, directly or indirectly, in particular by reference to an identifier
+    such as a name, an identification number, location data, an online identifier
+    or to one or more factors specific to the physical, physiological, genetic, mental,
+    economic, cultural or social identity of that natural person;
+
+    (2) ‘processing’ means any operation or set of operations which is performed on
+    personal data or on sets of personal data, whether or not by automated means,
+    such as collection, recording, organisation, structuring, storage, adaptation
+    or alteration, retrieval, consultation, use, disclosure by transmission, dissemination
+    or otherwise making available, alignment or combination, restriction, erasure
+    or destruction;
+
+    (3) ‘restriction of processing’ means the marking of stored personal data with
+    the aim of limiting their processing in the future;
+
+    (4) ‘profiling’ means any form of automated processing of personal data consisting
+    of the use of personal data to evaluate certain personal aspects relating to a
+    natural person, in particular to analyse or predict aspects concerning that natural
+    person''s performance at work, economic situation, health, personal preferences,
+    interests, reliability, behaviour, location or movements;
+
+    (5) ‘pseudonymisation’ means the processing of personal data in such a manner
+    that the personal data can no longer be attributed to a specific data subject
+    without the use of additional information, provided that such additional information
+    is kept separately and is subject to technical and organisational measures to
+    ensure that the personal data are not attributed to an identified or identifiable
+    natural person;
+
+    (6) ‘filing system’ means any structured set of personal data which are accessible
+    according to specific criteria, whether centralised, decentralised or dispersed
+    on a functional or geographical basis;
+
+    (7) ‘controller’ means the natural or legal person, public authority, agency or
+    other body which, alone or jointly with others, determines the purposes and means
+    of the processing of personal data; where the purposes and means of such processing
+    are determined by Union or Member State law, the controller or the specific criteria
+    for its nomination may be provided for by Union or Member State law;
+
+    (8) ‘processor’ means a natural or legal person, public authority, agency or other
+    body which processes personal data on behalf of the controller;
+
+    (9) ‘recipient’ means a natural or legal person, public authority, agency or another
+    body, to which the personal data are disclosed, whether a third party or not.
+    However, public authorities which may receive personal data in the framework of
+    a particular inquiry in accordance with Union or Member State law shall not be
+    regarded as recipients; the processing of those data by those public authorities
+    shall be in compliance with the applicable data protection rules according to
+    the purposes of the processing;
+
+    (10) ‘third party’ means a natural or legal person, public authority, agency or
+    body other than the data subject, controller, processor and persons who, under
+    the direct authority of the controller or processor, are authorised to process
+    personal data;
+
+    (11) ‘consent’ of the data subject means any freely given, specific, informed
+    and unambiguous indication of the data subject''s wishes by which he or she, by
+    a statement or by a clear affirmative action, signifies agreement to the processing
+    of personal data relating to him or her;
+
+    (12) ‘personal data breach’ means a breach of security leading to the accidental
+    or unlawful destruction, loss, alteration, unauthorised disclosure of, or access
+    to, personal data transmitted, stored or otherwise processed;
+
+    (13) ‘genetic data’ means personal data relating to the inherited or acquired
+    genetic characteristics of a natural person which give unique information about
+    the physiology or the health of that natural person and which result, in particular,
+    from an analysis of a biological sample from the natural person in question;
+
+    (14) ‘biometric data’ means personal data resulting from specific technical processing
+    relating to the physical, physiological or behavioural characteristics of a natural
+    person, which allow or confirm the unique identification of that natural person,
+    such as facial images or dactyloscopic data;
+
+    (15) ‘data concerning health’ means personal data related to the physical or mental
+    health of a natural person, including the provision of health care services, which
+    reveal information about his or her health status;
+
+    (16) ‘main establishment’ means: (a) as regards a controller with establishments
+    in more than one Member State, the place of its central administration in the
+    Union, unless the decisions on the purposes and means of the processing of personal
+    data are taken in another establishment of the controller in the Union and the
+    latter establishment has the power to have such decisions implemented, in which
+    case the establishment having taken such decisions is to be considered to be the
+    main establishment; (b) as regards a processor with establishments in more than
+    one Member State, the place of its central administration in the Union, or, if
+    the processor has no central administration in the Union, the establishment of
+    the processor in the Union where the main processing activities in the context
+    of the activities of an establishment of the processor take place to the extent
+    that the processor is subject to specific obligations under this Regulation;
+
+    (17) ‘representative’ means a natural or legal person established in the Union
+    who, designated by the controller or processor in writing pursuant to Article
+    27, represents the controller or processor with regard to their respective obligations
+    under this Regulation;
+
+    (18) ‘enterprise’ means a natural or legal person engaged in an economic activity,
+    irrespective of its legal form, including partnerships or associations regularly
+    engaged in an economic activity;
+
+    (19) ‘group of undertakings’ means a controlling undertaking and its controlled
+    undertakings;
+
+    (20) ‘binding corporate rules’ means personal data protection policies which are
+    adhered to by a controller or processor established on the territory of a Member
+    State for transfers or a set of transfers of personal data to a controller or
+    processor in one or more third countries within a group of undertakings, or group
+    of enterprises engaged in a joint economic activity;
+
+    (21) ‘supervisory authority’ means an independent public authority which is established
+    by a Member State pursuant to Article 51;
+
+    (22) ‘supervisory authority concerned’ means a supervisory authority which is
+    concerned by the processing of personal data because: (a) the controller or processor
+    is established on the territory of the Member State of that supervisory authority;
+    (b) data subjects residing in the Member State of that supervisory authority are
+    substantially affected or likely to be substantially affected by the processing;
+    or (c) a complaint has been lodged with that supervisory authority;
+
+    (23) ‘cross-border processing’ means either: (a) processing of personal data which
+    takes place in the context of the activities of establishments in more than one
+    Member State of a controller or processor in the Union where the controller or
+    processor is established in more than one Member State; or (b) processing of personal
+    data which takes place in the context of the activities of a single establishment
+    of a controller or processor in the Union but which substantially affects or is
+    likely to substantially affect data subjects in more than one Member State.
+
+    (24) ‘relevant and reasoned objection’ means an objection to a draft decision
+    as to whether there is an infringement of this Regulation, or whether envisaged
+    action in relation to the controller or processor complies with this Regulation,
+    which clearly demonstrates the significance of the risks posed by the draft decision
+    as regards the fundamental rights and freedoms of data subjects and, where applicable,
+    the free flow of personal data within the Union;
+
+    (25) ‘information society service’ means a service as defined in point (b) of
+    Article 1(1) of Directive (EU) 2015/1535 of the European Parliament and of the
+    Council (1);
+
+    (26) ‘international organisation’ means an organisation and its subordinate bodies
+    governed by public international law, or any other body which is set up by, or
+    on the basis of, an agreement between two or more countries.'
+- source_sentence: What type of data may be processed for purposes related to point
+    (h) of paragraph 2?
+  sentences:
+  - '1.Processing of personal data revealing racial or ethnic origin, political opinions,
+    religious or philosophical beliefs, or trade union membership, and the processing
+    of genetic data, biometric data for the purpose of uniquely identifying a natural
+    person, data concerning health or data concerning a natural person''s sex life
+    or sexual orientation shall be prohibited.
+
+    2.Paragraph 1 shall not apply if one of the following applies: (a)  the data subject
+    has given explicit consent to the processing of those personal data for one or
+    more specified purposes, except where Union or Member State law provide that the
+    prohibition referred to in paragraph 1 may not be lifted by the data subject;
+    (b)  processing is necessary for the purposes of carrying out the obligations
+    and exercising specific rights of the controller or of the data subject in the
+    field of employment and social security and social protection law in so far as
+    it is authorised by Union or Member State law or a collective agreement pursuant
+    to Member State law providing for appropriate safeguards for the fundamental rights
+    and the interests of the data subject; (c)  processing is necessary to protect
+    the vital interests of the data subject or of another natural person where the
+    data subject is physically or legally incapable of giving consent; (d)  processing
+    is carried out in the course of its legitimate activities with appropriate safeguards
+    by a foundation, association or any other not-for-profit body with a political,
+    philosophical, religious or trade union aim and on condition that the processing
+    relates solely to the members or to former members of the body or to persons who
+    have regular contact with it in connection with its purposes and that the personal
+    data are not disclosed outside that body without the consent of the data subjects;
+    (e)  processing relates to personal data which are manifestly made public by the
+    data subject; (f)  processing is necessary for the establishment, exercise or
+    defence of legal claims or whenever courts are acting in their judicial capacity;
+    (g)  processing is necessary for reasons of substantial public interest, on the
+    basis of Union or Member State law which shall be proportionate to the aim pursued,
+    respect the essence of the right to data protection and provide for suitable and
+    specific measures to safeguard the fundamental rights and the interests of the
+    data subject; (h)  processing is necessary for the purposes of preventive or occupational
+    medicine, for the assessment of the working capacity of the employee, medical
+    diagnosis, the provision of health or social care or treatment or the management
+    of health or social care systems and services on the basis of Union or Member
+    State law or pursuant to contract with a health professional and subject to the
+    conditions and safeguards referred to in paragraph 3; (i)  processing is necessary
+    for reasons of public interest in the area of public health, such as protecting
+    against serious cross-border threats to health or ensuring high standards of quality
+    and safety of health care and of medicinal products or medical devices, on the
+    basis of Union or Member State law which provides for suitable and specific measures
+    to safeguard the rights and freedoms of the data subject, in particular professional
+    secrecy; 4.5.2016 L 119/38   (j)  processing is necessary for archiving purposes
+    in the public interest, scientific or historical research purposes or statistical
+    purposes in accordance with Article 89(1) based on Union or Member State law which
+    shall be proportionate to the aim pursued, respect the essence of the right to
+    data protection and provide for suitable and specific measures to safeguard the
+    fundamental rights and the interests of the data subject.
+
+    3.Personal data referred to in paragraph 1 may be processed for the purposes referred
+    to in point (h) of paragraph 2 when those data are processed by or under the responsibility
+    of a professional subject to the obligation of professional secrecy under Union
+    or Member State law or rules established by national competent bodies or by another
+    person also subject to an obligation of secrecy under Union or Member State law
+    or rules established by national competent bodies.
+
+    4.Member States may maintain or introduce further conditions, including limitations,
+    with regard to the processing of genetic data, biometric data or data concerning
+    health.'
+  - '1.The data protection officer shall have at least the following tasks: (a)  to
+    inform and advise the controller or the processor and the employees who carry
+    out processing of their obligations pursuant to this Regulation and to other Union
+    or Member State data protection provisions; (b)  to monitor compliance with this
+    Regulation, with other Union or Member State data protection provisions and with
+    the policies of the controller or processor in relation to the protection of personal
+    data, including the assignment of responsibilities, awareness-raising and training
+    of staff involved in processing operations, and the related audits; (c)  to provide
+    advice where requested as regards the data protection impact assessment and monitor
+    its performance pursuant to Article 35; (d)  to cooperate with the supervisory
+    authority; (e)  to act as the contact point for the supervisory authority on issues
+    relating to processing, including the prior consultation referred to in Article
+    36, and to consult, where appropriate, with regard to any other matter.
+
+    2.The data protection officer shall in the performance of his or her tasks have
+    due regard to the risk associated with processing operations, taking into account
+    the nature, scope, context and purposes of processing. Section 5 Codes of conduct
+    and certification'
+  - Processing should be lawful where it is necessary in the context of a contract
+    or the intention to enter into a contract.
+- source_sentence: What may impede authorities in the discharge of their responsibilities
+    under Union law?
+  sentences:
+  - '1.The controller and the processor shall designate a data protection officer
+    in any case where: (a)  the processing is carried out by a public authority or
+    body, except for courts acting in their judicial capacity; (b)  the core activities
+    of the controller or the processor consist of processing operations which, by
+    virtue of their nature, their scope and/or their purposes, require regular and
+    systematic monitoring of data subjects on a large scale; or (c)  the core activities
+    of the controller or the processor consist of processing on a large scale of special
+    categories of data pursuant to Article 9 and personal data relating to criminal
+    convictions and offences referred to in Article 10
+
+    2.A group of undertakings may appoint a single data protection officer provided
+    that a data protection officer is easily accessible from each establishment.
+
+    3.Where the controller or the processor is a public authority or body, a single
+    data protection officer may be designated for several such authorities or bodies,
+    taking account of their organisational structure and size.
+
+    4.In cases other than those referred to in paragraph 1, the controller or processor
+    or associations and other bodies representing categories of controllers or processors
+    may or, where required by Union or Member State law shall, designate a data protection
+    officer. The data protection officer may act for such associations and other bodies
+    representing controllers or processors.
+
+    5.The data protection officer shall be designated on the basis of professional
+    qualities and, in particular, expert knowledge of data protection law and practices
+    and the ability to fulfil the tasks referred to in Article 39
+
+    6.The data protection officer may be a staff member of the controller or processor,
+    or fulfil the tasks on the basis of a service contract.
+
+    7.The controller or the processor shall publish the contact details of the data
+    protection officer and communicate them to the supervisory authority.'
+  - This Regulation is without prejudice to international agreements concluded between
+    the Union and third countries regulating the transfer of personal data including
+    appropriate safeguards for the data subjects. Member States may conclude international
+    agreements which involve the transfer of personal data to third countries or international
+    organisations, as far as such agreements do not affect this Regulation or any
+    other provisions of Union law and include an appropriate level of protection for
+    the fundamental rights of the data subjects.
+  - The objectives and principles of Directive 95/46/EC remain sound, but it has not
+    prevented fragmentation in the implementation of data protection across the Union,
+    legal uncertainty or a widespread public perception that there are significant
+    risks to the protection of natural persons, in particular with regard to online
+    activity. Differences in the level of protection of the rights and freedoms of
+    natural persons, in particular the right to the protection of personal data, with
+    regard to the processing of personal data in the Member States may prevent the
+    free flow of personal data throughout the Union. Those differences may therefore
+    constitute an obstacle to the pursuit of economic activities at the level of the
+    Union, distort competition and impede authorities in the discharge of their responsibilities
+    under Union law. Such a difference in levels of protection is due to the existence
+    of differences in the implementation and application of Directive 95/46/EC.
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+metrics:
+- cosine_accuracy@1
+- cosine_accuracy@3
+- cosine_accuracy@5
+- cosine_accuracy@10
+- cosine_precision@1
+- cosine_precision@3
+- cosine_precision@5
+- cosine_precision@10
+- cosine_recall@1
+- cosine_recall@3
+- cosine_recall@5
+- cosine_recall@10
+- cosine_ndcg@10
+- cosine_mrr@10
+- cosine_map@100
+model-index:
+- name: modernbert-embed-base
+  results:
+  - task:
+      type: information-retrieval
+      name: Information Retrieval
+    dataset:
+      name: dim 768
+      type: dim_768
+    metrics:
+    - type: cosine_accuracy@1
+      value: 0.4026888604353393
+      name: Cosine Accuracy@1
+    - type: cosine_accuracy@3
+      value: 0.4065300896286812
+      name: Cosine Accuracy@3
+    - type: cosine_accuracy@5
+      value: 0.4359795134443022
+      name: Cosine Accuracy@5
+    - type: cosine_accuracy@10
+      value: 0.469270166453265
+      name: Cosine Accuracy@10
+    - type: cosine_precision@1
+      value: 0.4026888604353393
+      name: Cosine Precision@1
+    - type: cosine_precision@3
+      value: 0.4016218523260776
+      name: Cosine Precision@3
+    - type: cosine_precision@5
+      value: 0.3929577464788732
+      name: Cosine Precision@5
+    - type: cosine_precision@10
+      value: 0.36241997439180534
+      name: Cosine Precision@10
+    - type: cosine_recall@1
+      value: 0.042158204863822595
+      name: Cosine Recall@1
+    - type: cosine_recall@3
+      value: 0.12340911592737758
+      name: Cosine Recall@3
+    - type: cosine_recall@5
+      value: 0.18693795146685696
+      name: Cosine Recall@5
+    - type: cosine_recall@10
+      value: 0.28222410577862556
+      name: Cosine Recall@10
+    - type: cosine_ndcg@10
+      value: 0.42608814635365755
+      name: Cosine Ndcg@10
+    - type: cosine_mrr@10
+      value: 0.41397348738898004
+      name: Cosine Mrr@10
+    - type: cosine_map@100
+      value: 0.48436770951404184
+      name: Cosine Map@100
+  - task:
+      type: information-retrieval
+      name: Information Retrieval
+    dataset:
+      name: dim 512
+      type: dim_512
+    metrics:
+    - type: cosine_accuracy@1
+      value: 0.39500640204865556
+      name: Cosine Accuracy@1
+    - type: cosine_accuracy@3
+      value: 0.39884763124199746
+      name: Cosine Accuracy@3
+    - type: cosine_accuracy@5
+      value: 0.42509603072983354
+      name: Cosine Accuracy@5
+    - type: cosine_accuracy@10
+      value: 0.4532650448143406
+      name: Cosine Accuracy@10
+    - type: cosine_precision@1
+      value: 0.39500640204865556
+      name: Cosine Precision@1
+    - type: cosine_precision@3
+      value: 0.393939393939394
+      name: Cosine Precision@3
+    - type: cosine_precision@5
+      value: 0.3846350832266325
+      name: Cosine Precision@5
+    - type: cosine_precision@10
+      value: 0.35102432778489123
+      name: Cosine Precision@10
+    - type: cosine_recall@1
+      value: 0.04167554612344552
+      name: Cosine Recall@1
+    - type: cosine_recall@3
+      value: 0.12185555036210068
+      name: Cosine Recall@3
+    - type: cosine_recall@5
+      value: 0.18440910016156958
+      name: Cosine Recall@5
+    - type: cosine_recall@10
+      value: 0.27558399878065315
+      name: Cosine Recall@10
+    - type: cosine_ndcg@10
+      value: 0.4154101738314148
+      name: Cosine Ndcg@10
+    - type: cosine_mrr@10
+      value: 0.4048785135052737
+      name: Cosine Mrr@10
+    - type: cosine_map@100
+      value: 0.47311757377710084
+      name: Cosine Map@100
+  - task:
+      type: information-retrieval
+      name: Information Retrieval
+    dataset:
+      name: dim 256
+      type: dim_256
+    metrics:
+    - type: cosine_accuracy@1
+      value: 0.3873239436619718
+      name: Cosine Accuracy@1
+    - type: cosine_accuracy@3
+      value: 0.39244558258642764
+      name: Cosine Accuracy@3
+    - type: cosine_accuracy@5
+      value: 0.4206145966709347
+      name: Cosine Accuracy@5
+    - type: cosine_accuracy@10
+      value: 0.4494238156209987
+      name: Cosine Accuracy@10
+    - type: cosine_precision@1
+      value: 0.3873239436619718
+      name: Cosine Precision@1
+    - type: cosine_precision@3
+      value: 0.3868971404182671
+      name: Cosine Precision@3
+    - type: cosine_precision@5
+      value: 0.37912932138284255
+      name: Cosine Precision@5
+    - type: cosine_precision@10
+      value: 0.348527528809219
+      name: Cosine Precision@10
+    - type: cosine_recall@1
+      value: 0.04023203819999771
+      name: Cosine Recall@1
+    - type: cosine_recall@3
+      value: 0.1180462190143581
+      name: Cosine Recall@3
+    - type: cosine_recall@5
+      value: 0.17956095699785507
+      name: Cosine Recall@5
+    - type: cosine_recall@10
+      value: 0.27112137316286944
+      name: Cosine Recall@10
+    - type: cosine_ndcg@10
+      value: 0.40977946157999073
+      name: Cosine Ndcg@10
+    - type: cosine_mrr@10
+      value: 0.39812790886734506
+      name: Cosine Mrr@10
+    - type: cosine_map@100
+      value: 0.4661645952118268
+      name: Cosine Map@100
+  - task:
+      type: information-retrieval
+      name: Information Retrieval
+    dataset:
+      name: dim 128
+      type: dim_128
+    metrics:
+    - type: cosine_accuracy@1
+      value: 0.3559539052496799
+      name: Cosine Accuracy@1
+    - type: cosine_accuracy@3
+      value: 0.3617157490396927
+      name: Cosine Accuracy@3
+    - type: cosine_accuracy@5
+      value: 0.39244558258642764
+      name: Cosine Accuracy@5
+    - type: cosine_accuracy@10
+      value: 0.4186939820742638
+      name: Cosine Accuracy@10
+    - type: cosine_precision@1
+      value: 0.3559539052496799
+      name: Cosine Precision@1
+    - type: cosine_precision@3
+      value: 0.35552710200597526
+      name: Cosine Precision@3
+    - type: cosine_precision@5
+      value: 0.3490396927016646
+      name: Cosine Precision@5
+    - type: cosine_precision@10
+      value: 0.32131882202304735
+      name: Cosine Precision@10
+    - type: cosine_recall@1
+      value: 0.037575464818099744
+      name: Cosine Recall@1
+    - type: cosine_recall@3
+      value: 0.11032964908822472
+      name: Cosine Recall@3
+    - type: cosine_recall@5
+      value: 0.16793427308834435
+      name: Cosine Recall@5
+    - type: cosine_recall@10
+      value: 0.2541985714643628
+      name: Cosine Recall@10
+    - type: cosine_ndcg@10
+      value: 0.3790325714206647
+      name: Cosine Ndcg@10
+    - type: cosine_mrr@10
+      value: 0.3671173505680543
+      name: Cosine Mrr@10
+    - type: cosine_map@100
+      value: 0.43535825619272106
+      name: Cosine Map@100
+  - task:
+      type: information-retrieval
+      name: Information Retrieval
+    dataset:
+      name: dim 64
+      type: dim_64
+    metrics:
+    - type: cosine_accuracy@1
+      value: 0.31306017925736235
+      name: Cosine Accuracy@1
+    - type: cosine_accuracy@3
+      value: 0.31946222791293216
+      name: Cosine Accuracy@3
+    - type: cosine_accuracy@5
+      value: 0.34635083226632524
+      name: Cosine Accuracy@5
+    - type: cosine_accuracy@10
+      value: 0.3758002560819462
+      name: Cosine Accuracy@10
+    - type: cosine_precision@1
+      value: 0.31306017925736235
+      name: Cosine Precision@1
+    - type: cosine_precision@3
+      value: 0.313486982501067
+      name: Cosine Precision@3
+    - type: cosine_precision@5
+      value: 0.3075544174135723
+      name: Cosine Precision@5
+    - type: cosine_precision@10
+      value: 0.2819462227912932
+      name: Cosine Precision@10
+    - type: cosine_recall@1
+      value: 0.033872169883188745
+      name: Cosine Recall@1
+    - type: cosine_recall@3
+      value: 0.09984524687478234
+      name: Cosine Recall@3
+    - type: cosine_recall@5
+      value: 0.15245541388627262
+      name: Cosine Recall@5
+    - type: cosine_recall@10
+      value: 0.228651154461535
+      name: Cosine Recall@10
+    - type: cosine_ndcg@10
+      value: 0.33574924678086643
+      name: Cosine Ndcg@10
+    - type: cosine_mrr@10
+      value: 0.3240625571611481
+      name: Cosine Mrr@10
+    - type: cosine_map@100
+      value: 0.3923627170196659
+      name: Cosine Map@100
+---
+
+# modernbert-embed-base
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base) <!-- at revision d556a88e332558790b210f7bdbe87da2fa94a8d8 -->
+- **Maximum Sequence Length:** 8192 tokens
+- **Output Dimensionality:** 768 dimensions
+- **Similarity Function:** Cosine Similarity
+<!-- - **Training Dataset:** Unknown -->
+- **Language:** en
+- **License:** apache-2.0
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
+  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("sentence_transformers_model_id")
+# Run inference
+sentences = [
+    'What may impede authorities in the discharge of their responsibilities under Union law?',
+    'The objectives and principles of Directive 95/46/EC remain sound, but it has not prevented fragmentation in the implementation of data protection across the Union, legal uncertainty or a widespread public perception that there are significant risks to the protection of natural persons, in particular with regard to online activity. Differences in the level of protection of the rights and freedoms of natural persons, in particular the right to the protection of personal data, with regard to the processing of personal data in the Member States may prevent the free flow of personal data throughout the Union. Those differences may therefore constitute an obstacle to the pursuit of economic activities at the level of the Union, distort competition and impede authorities in the discharge of their responsibilities under Union law. Such a difference in levels of protection is due to the existence of differences in the implementation and application of Directive 95/46/EC.',
+    'This Regulation is without prejudice to international agreements concluded between the Union and third countries regulating the transfer of personal data including appropriate safeguards for the data subjects. Member States may conclude international agreements which involve the transfer of personal data to third countries or international organisations, as far as such agreements do not affect this Regulation or any other provisions of Union law and include an appropriate level of protection for the fundamental rights of the data subjects.',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 768]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities)
+# tensor([[1.0000, 0.5042, 0.0865],
+#         [0.5042, 1.0000, 0.2632],
+#         [0.0865, 0.2632, 1.0000]])
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+## Evaluation
+
+### Metrics
+
+#### Information Retrieval
+
+* Dataset: `dim_768`
+* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator) with these parameters:
+  ```json
+  {
+      "truncate_dim": 768
+  }
+  ```
+
+| Metric              | Value      |
+|:--------------------|:-----------|
+| cosine_accuracy@1   | 0.4027     |
+| cosine_accuracy@3   | 0.4065     |
+| cosine_accuracy@5   | 0.436      |
+| cosine_accuracy@10  | 0.4693     |
+| cosine_precision@1  | 0.4027     |
+| cosine_precision@3  | 0.4016     |
+| cosine_precision@5  | 0.393      |
+| cosine_precision@10 | 0.3624     |
+| cosine_recall@1     | 0.0422     |
+| cosine_recall@3     | 0.1234     |
+| cosine_recall@5     | 0.1869     |
+| cosine_recall@10    | 0.2822     |
+| **cosine_ndcg@10**  | **0.4261** |
+| cosine_mrr@10       | 0.414      |
+| cosine_map@100      | 0.4844     |
+
+#### Information Retrieval
+
+* Dataset: `dim_512`
+* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator) with these parameters:
+  ```json
+  {
+      "truncate_dim": 512
+  }
+  ```
+
+| Metric              | Value      |
+|:--------------------|:-----------|
+| cosine_accuracy@1   | 0.395      |
+| cosine_accuracy@3   | 0.3988     |
+| cosine_accuracy@5   | 0.4251     |
+| cosine_accuracy@10  | 0.4533     |
+| cosine_precision@1  | 0.395      |
+| cosine_precision@3  | 0.3939     |
+| cosine_precision@5  | 0.3846     |
+| cosine_precision@10 | 0.351      |
+| cosine_recall@1     | 0.0417     |
+| cosine_recall@3     | 0.1219     |
+| cosine_recall@5     | 0.1844     |
+| cosine_recall@10    | 0.2756     |
+| **cosine_ndcg@10**  | **0.4154** |
+| cosine_mrr@10       | 0.4049     |
+| cosine_map@100      | 0.4731     |
+
+#### Information Retrieval
+
+* Dataset: `dim_256`
+* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator) with these parameters:
+  ```json
+  {
+      "truncate_dim": 256
+  }
+  ```
+
+| Metric              | Value      |
+|:--------------------|:-----------|
+| cosine_accuracy@1   | 0.3873     |
+| cosine_accuracy@3   | 0.3924     |
+| cosine_accuracy@5   | 0.4206     |
+| cosine_accuracy@10  | 0.4494     |
+| cosine_precision@1  | 0.3873     |
+| cosine_precision@3  | 0.3869     |
+| cosine_precision@5  | 0.3791     |
+| cosine_precision@10 | 0.3485     |
+| cosine_recall@1     | 0.0402     |
+| cosine_recall@3     | 0.118      |
+| cosine_recall@5     | 0.1796     |
+| cosine_recall@10    | 0.2711     |
+| **cosine_ndcg@10**  | **0.4098** |
+| cosine_mrr@10       | 0.3981     |
+| cosine_map@100      | 0.4662     |
+
+#### Information Retrieval
+
+* Dataset: `dim_128`
+* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator) with these parameters:
+  ```json
+  {
+      "truncate_dim": 128
+  }
+  ```
+
+| Metric              | Value     |
+|:--------------------|:----------|
+| cosine_accuracy@1   | 0.356     |
+| cosine_accuracy@3   | 0.3617    |
+| cosine_accuracy@5   | 0.3924    |
+| cosine_accuracy@10  | 0.4187    |
+| cosine_precision@1  | 0.356     |
+| cosine_precision@3  | 0.3555    |
+| cosine_precision@5  | 0.349     |
+| cosine_precision@10 | 0.3213    |
+| cosine_recall@1     | 0.0376    |
+| cosine_recall@3     | 0.1103    |
+| cosine_recall@5     | 0.1679    |
+| cosine_recall@10    | 0.2542    |
+| **cosine_ndcg@10**  | **0.379** |
+| cosine_mrr@10       | 0.3671    |
+| cosine_map@100      | 0.4354    |
+
+#### Information Retrieval
+
+* Dataset: `dim_64`
+* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator) with these parameters:
+  ```json
+  {
+      "truncate_dim": 64
+  }
+  ```
+
+| Metric              | Value      |
+|:--------------------|:-----------|
+| cosine_accuracy@1   | 0.3131     |
+| cosine_accuracy@3   | 0.3195     |
+| cosine_accuracy@5   | 0.3464     |
+| cosine_accuracy@10  | 0.3758     |
+| cosine_precision@1  | 0.3131     |
+| cosine_precision@3  | 0.3135     |
+| cosine_precision@5  | 0.3076     |
+| cosine_precision@10 | 0.2819     |
+| cosine_recall@1     | 0.0339     |
+| cosine_recall@3     | 0.0998     |
+| cosine_recall@5     | 0.1525     |
+| cosine_recall@10    | 0.2287     |
+| **cosine_ndcg@10**  | **0.3357** |
+| cosine_mrr@10       | 0.3241     |
+| cosine_map@100      | 0.3924     |
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### Unnamed Dataset
+
+* Size: 391 training samples
+* Columns: <code>anchor</code> and <code>positive</code>
+* Approximate statistics based on the first 391 samples:
+  |         | anchor                                                                            | positive                                                                              |
+  |:--------|:----------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------|
+  | type    | string                                                                            | string                                                                                |
+  | details | <ul><li>min: 7 tokens</li><li>mean: 15.05 tokens</li><li>max: 30 tokens</li></ul> | <ul><li>min: 25 tokens</li><li>mean: 667.99 tokens</li><li>max: 2429 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                               | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  |
+  |:-----------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>On what date did the act occur?</code>                                                         | <code>Court (Civil/Criminal): Civil  <br>Provisions: Directive 2015/366, Law 4537/2018  <br>Time of the act: 31.08.2022  <br>Outcome (not guilty, guilty): Partially accepts the claim.  <br>Reasoning: The Athens Peace Court ordered the bank to return the amount that was withdrawn from the plaintiffs' account and to pay additional compensation for the moral damage they suffered.  <br>Facts: The case concerns plaintiffs who fell victim to electronic fraud via phishing, resulting in the withdrawal of money from their bank account. The plaintiffs claimed that the bank did not take the necessary security measures to protect their accounts and sought compensation for the financial loss and moral damage they suffered. The court determined that the bank is responsible for the loss of the money, as it did not prove that the transactions were authorized by the plaintiffs. Furthermore, the court recognized that the bank's refusal to return the funds constitutes an infringement of the plaintiffs' personal rights, as it...</code>                   |
+  | <code>For what purposes can more specific rules be provided regarding the employment context?</code> | <code>1.Member States may, by law or by collective agreements, provide for more specific rules to ensure the protection of the rights and freedoms in respect of the processing of employees' personal data in the employment context, in particular for the purposes of the recruitment, the performance of the contract of employment, including discharge of obligations laid down by law or by collective agreements, management, planning and organisation of work, equality and diversity in the workplace, health and safety at work, protection of employer's or customer's property and for the purposes of the exercise and enjoyment, on an individual or collective basis, of rights and benefits related to employment, and for the purpose of the termination of the employment relationship.<br>2.Those rules shall include suitable and specific measures to safeguard the data subject's human dignity, legitimate interests and fundamental rights, with particular regard to the transparency of processing, the transfer of p...</code>                               |
+  | <code>On which date were transactions detailed in the provided text conducted?</code>                | <code>**Court (Civil/Criminal): Civil**<br><br>**Provisions:**<br><br>**Time of commission of the act:**<br><br>**Outcome (not guilty, guilty):**<br><br>**Rationale:**<br><br>**Facts:**<br>The plaintiff holds credit card number ............ with the defendant banking corporation. Based on the application for alternative networks dated 19/7/2015 with number ......... submitted at a branch of the defendant, he was granted access to the electronic banking service (e-banking) to conduct banking transactions (debit, credit, updates, payments) remotely. On 30/11/2020, the plaintiff fell victim to electronic fraud through the "phishing" method, whereby an unknown perpetrator managed to withdraw a total amount of €3,121.75 from the aforementioned credit card. Specifically, the plaintiff received an email at 1:35 PM on 29/11/2020 from sender ...... with address ........, informing him that due to an impending system change, he needed to verify the mobile phone number linked to the credit card, urging him to complete the verification...</code> |
+* Loss: [<code>MatryoshkaLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#matryoshkaloss) with these parameters:
+  ```json
+  {
+      "loss": "MultipleNegativesRankingLoss",
+      "matryoshka_dims": [
+          768,
+          512,
+          256,
+          128,
+          64
+      ],
+      "matryoshka_weights": [
+          1,
+          1,
+          1,
+          1,
+          1
+      ],
+      "n_dims_per_step": -1
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `eval_strategy`: epoch
+- `per_device_train_batch_size`: 2
+- `per_device_eval_batch_size`: 2
+- `gradient_accumulation_steps`: 2
+- `learning_rate`: 2e-05
+- `num_train_epochs`: 20
+- `lr_scheduler_type`: cosine
+- `warmup_ratio`: 0.1
+- `bf16`: True
+- `load_best_model_at_end`: True
+- `optim`: adamw_torch_fused
+- `batch_sampler`: no_duplicates
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: epoch
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 2
+- `per_device_eval_batch_size`: 2
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 2
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 2e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1.0
+- `num_train_epochs`: 20
+- `max_steps`: -1
+- `lr_scheduler_type`: cosine
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.1
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: True
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: None
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: True
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `tp_size`: 0
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch_fused
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: no_duplicates
+- `multi_dataset_batch_sampler`: proportional
+- `router_mapping`: {}
+- `learning_rate_mapping`: {}
+
+</details>
+
+### Training Logs
+| Epoch  | Step | Training Loss | dim_768_cosine_ndcg@10 | dim_512_cosine_ndcg@10 | dim_256_cosine_ndcg@10 | dim_128_cosine_ndcg@10 | dim_64_cosine_ndcg@10 |
+|:------:|:----:|:-------------:|:----------------------:|:----------------------:|:----------------------:|:----------------------:|:---------------------:|
+| 0.0102 | 1    | 0.0001        | -                      | -                      | -                      | -                      | -                     |
+| 0.0204 | 2    | 0.001         | -                      | -                      | -                      | -                      | -                     |
+| 0.0306 | 3    | 0.0938        | -                      | -                      | -                      | -                      | -                     |
+| 0.0408 | 4    | 0.0084        | -                      | -                      | -                      | -                      | -                     |
+| 0.0510 | 5    | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.0612 | 6    | 0.0004        | -                      | -                      | -                      | -                      | -                     |
+| 0.0714 | 7    | 0.003         | -                      | -                      | -                      | -                      | -                     |
+| 0.0816 | 8    | 0.0012        | -                      | -                      | -                      | -                      | -                     |
+| 0.0918 | 9    | 0.0001        | -                      | -                      | -                      | -                      | -                     |
+| 0.1020 | 10   | 0.0053        | -                      | -                      | -                      | -                      | -                     |
+| 0.1122 | 11   | 0.0068        | -                      | -                      | -                      | -                      | -                     |
+| 0.1224 | 12   | 0.0006        | -                      | -                      | -                      | -                      | -                     |
+| 0.1327 | 13   | 0.0007        | -                      | -                      | -                      | -                      | -                     |
+| 0.1429 | 14   | 0.0003        | -                      | -                      | -                      | -                      | -                     |
+| 0.1531 | 15   | 0.0096        | -                      | -                      | -                      | -                      | -                     |
+| 0.1633 | 16   | 0.0004        | -                      | -                      | -                      | -                      | -                     |
+| 0.1735 | 17   | 0.016         | -                      | -                      | -                      | -                      | -                     |
+| 0.1837 | 18   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.1939 | 19   | 0.0005        | -                      | -                      | -                      | -                      | -                     |
+| 0.2041 | 20   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.2143 | 21   | 0.003         | -                      | -                      | -                      | -                      | -                     |
+| 0.2245 | 22   | 0.1395        | -                      | -                      | -                      | -                      | -                     |
+| 0.2347 | 23   | 0.3967        | -                      | -                      | -                      | -                      | -                     |
+| 0.2449 | 24   | 0.0023        | -                      | -                      | -                      | -                      | -                     |
+| 0.2551 | 25   | 0.0003        | -                      | -                      | -                      | -                      | -                     |
+| 0.2653 | 26   | 0.0027        | -                      | -                      | -                      | -                      | -                     |
+| 0.2755 | 27   | 0.0147        | -                      | -                      | -                      | -                      | -                     |
+| 0.2857 | 28   | 0.0522        | -                      | -                      | -                      | -                      | -                     |
+| 0.2959 | 29   | 0.0001        | -                      | -                      | -                      | -                      | -                     |
+| 0.3061 | 30   | 0.0008        | -                      | -                      | -                      | -                      | -                     |
+| 0.3163 | 31   | 0.0044        | -                      | -                      | -                      | -                      | -                     |
+| 0.3265 | 32   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.3367 | 33   | 0.0028        | -                      | -                      | -                      | -                      | -                     |
+| 0.3469 | 34   | 0.0007        | -                      | -                      | -                      | -                      | -                     |
+| 0.3571 | 35   | 0.0002        | -                      | -                      | -                      | -                      | -                     |
+| 0.3673 | 36   | 0.0168        | -                      | -                      | -                      | -                      | -                     |
+| 0.3776 | 37   | 0.0023        | -                      | -                      | -                      | -                      | -                     |
+| 0.3878 | 38   | 0.0041        | -                      | -                      | -                      | -                      | -                     |
+| 0.3980 | 39   | 0.0081        | -                      | -                      | -                      | -                      | -                     |
+| 0.4082 | 40   | 0.0004        | -                      | -                      | -                      | -                      | -                     |
+| 0.4184 | 41   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.4286 | 42   | 0.005         | -                      | -                      | -                      | -                      | -                     |
+| 0.4388 | 43   | 0.0031        | -                      | -                      | -                      | -                      | -                     |
+| 0.4490 | 44   | 0.0216        | -                      | -                      | -                      | -                      | -                     |
+| 0.4592 | 45   | 0.0004        | -                      | -                      | -                      | -                      | -                     |
+| 0.4694 | 46   | 0.0018        | -                      | -                      | -                      | -                      | -                     |
+| 0.4796 | 47   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.4898 | 48   | 0.0044        | -                      | -                      | -                      | -                      | -                     |
+| 0.5    | 49   | 0.0004        | -                      | -                      | -                      | -                      | -                     |
+| 0.5102 | 50   | 0.0019        | -                      | -                      | -                      | -                      | -                     |
+| 0.5204 | 51   | 0.0005        | -                      | -                      | -                      | -                      | -                     |
+| 0.5306 | 52   | 0.0016        | -                      | -                      | -                      | -                      | -                     |
+| 0.5408 | 53   | 0.1806        | -                      | -                      | -                      | -                      | -                     |
+| 0.5510 | 54   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.5612 | 55   | 0.0025        | -                      | -                      | -                      | -                      | -                     |
+| 0.5714 | 56   | 0.0002        | -                      | -                      | -                      | -                      | -                     |
+| 0.5816 | 57   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.5918 | 58   | 0.0111        | -                      | -                      | -                      | -                      | -                     |
+| 0.6020 | 59   | 0.0011        | -                      | -                      | -                      | -                      | -                     |
+| 0.6122 | 60   | 0.0003        | -                      | -                      | -                      | -                      | -                     |
+| 0.6224 | 61   | 1.8072        | -                      | -                      | -                      | -                      | -                     |
+| 0.6327 | 62   | 0.0009        | -                      | -                      | -                      | -                      | -                     |
+| 0.6429 | 63   | 0.0011        | -                      | -                      | -                      | -                      | -                     |
+| 0.6531 | 64   | 0.0013        | -                      | -                      | -                      | -                      | -                     |
+| 0.6633 | 65   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.6735 | 66   | 0.0007        | -                      | -                      | -                      | -                      | -                     |
+| 0.6837 | 67   | 0.4116        | -                      | -                      | -                      | -                      | -                     |
+| 0.6939 | 68   | 0.008         | -                      | -                      | -                      | -                      | -                     |
+| 0.7041 | 69   | 0.0009        | -                      | -                      | -                      | -                      | -                     |
+| 0.7143 | 70   | 0.0004        | -                      | -                      | -                      | -                      | -                     |
+| 0.7245 | 71   | 0.0019        | -                      | -                      | -                      | -                      | -                     |
+| 0.7347 | 72   | 0.0005        | -                      | -                      | -                      | -                      | -                     |
+| 0.7449 | 73   | 0.0004        | -                      | -                      | -                      | -                      | -                     |
+| 0.7551 | 74   | 0.0005        | -                      | -                      | -                      | -                      | -                     |
+| 0.7653 | 75   | 0.0001        | -                      | -                      | -                      | -                      | -                     |
+| 0.7755 | 76   | 0.0005        | -                      | -                      | -                      | -                      | -                     |
+| 0.7857 | 77   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.7959 | 78   | 0.0001        | -                      | -                      | -                      | -                      | -                     |
+| 0.8061 | 79   | 0.0025        | -                      | -                      | -                      | -                      | -                     |
+| 0.8163 | 80   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.8265 | 81   | 0.0012        | -                      | -                      | -                      | -                      | -                     |
+| 0.8367 | 82   | 0.0003        | -                      | -                      | -                      | -                      | -                     |
+| 0.8469 | 83   | 0.0002        | -                      | -                      | -                      | -                      | -                     |
+| 0.8571 | 84   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.8673 | 85   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.8776 | 86   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.8878 | 87   | 0.0002        | -                      | -                      | -                      | -                      | -                     |
+| 0.8980 | 88   | 0.0009        | -                      | -                      | -                      | -                      | -                     |
+| 0.9082 | 89   | 0.0067        | -                      | -                      | -                      | -                      | -                     |
+| 0.9184 | 90   | 0.0           | -                      | -                      | -                      | -                      | -                     |
+| 0.9286 | 91   | 0.0001        | -                      | -                      | -                      | -                      | -                     |
+| 0.9388 | 92   | 0.0008        | -                      | -                      | -                      | -                      | -                     |
+| 0.9490 | 93   | 0.0031        | -                      | -                      | -                      | -                      | -                     |
+| 0.9592 | 94   | 0.0004        | -                      | -                      | -                      | -                      | -                     |
+| 0.9694 | 95   | 0.0004        | -                      | -                      | -                      | -                      | -                     |
+| 0.9796 | 96   | 0.0001        | -                      | -                      | -                      | -                      | -                     |
+| 0.9898 | 97   | 0.0004        | -                      | -                      | -                      | -                      | -                     |
+| 1.0    | 98   | 0.0005        | 0.4261                 | 0.4154                 | 0.4098                 | 0.3790                 | 0.3357                |
+
+
+### Framework Versions
+- Python: 3.12.11
+- Sentence Transformers: 5.1.0
+- Transformers: 4.51.3
+- PyTorch: 2.8.0+cu126
+- Accelerate: 1.10.1
+- Datasets: 4.0.0
+- Tokenizers: 0.21.4
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+#### MatryoshkaLoss
+```bibtex
+@misc{kusupati2024matryoshka,
+    title={Matryoshka Representation Learning},
+    author={Aditya Kusupati and Gantavya Bhatt and Aniket Rege and Matthew Wallingford and Aditya Sinha and Vivek Ramanujan and William Howard-Snyder and Kaifeng Chen and Sham Kakade and Prateek Jain and Ali Farhadi},
+    year={2024},
+    eprint={2205.13147},
+    archivePrefix={arXiv},
+    primaryClass={cs.LG}
+}
+```
+
+#### MultipleNegativesRankingLoss
+```bibtex
+@misc{henderson2017efficient,
+    title={Efficient Natural Language Response Suggestion for Smart Reply},
+    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
+    year={2017},
+    eprint={1705.00652},
+    archivePrefix={arXiv},
+    primaryClass={cs.CL}
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

checkpoint-98/config.json

@@ -0,0 +1,45 @@
+{
+  "architectures": [
+    "ModernBertModel"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 50281,
+  "classifier_activation": "gelu",
+  "classifier_bias": false,
+  "classifier_dropout": 0.0,
+  "classifier_pooling": "mean",
+  "cls_token_id": 50281,
+  "decoder_bias": true,
+  "deterministic_flash_attn": false,
+  "embedding_dropout": 0.0,
+  "eos_token_id": 50282,
+  "global_attn_every_n_layers": 3,
+  "global_rope_theta": 160000.0,
+  "gradient_checkpointing": false,
+  "hidden_activation": "gelu",
+  "hidden_size": 768,
+  "initializer_cutoff_factor": 2.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 1152,
+  "layer_norm_eps": 1e-05,
+  "local_attention": 128,
+  "local_rope_theta": 10000.0,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "mlp_dropout": 0.0,
+  "model_type": "modernbert",
+  "norm_bias": false,
+  "norm_eps": 1e-05,
+  "num_attention_heads": 12,
+  "num_hidden_layers": 22,
+  "pad_token_id": 50283,
+  "position_embedding_type": "absolute",
+  "repad_logits_with_grad": false,
+  "sep_token_id": 50282,
+  "sparse_pred_ignore_index": -100,
+  "sparse_prediction": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.51.3",
+  "vocab_size": 50368
+}

checkpoint-98/config_sentence_transformers.json

@@ -0,0 +1,14 @@
+{
+  "__version__": {
+    "sentence_transformers": "5.1.0",
+    "transformers": "4.51.3",
+    "pytorch": "2.8.0+cu126"
+  },
+  "prompts": {
+    "query": "",
+    "document": ""
+  },
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine",
+  "model_type": "SentenceTransformer"
+}

checkpoint-98/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:95e5a818377bdcd1bbf4879eeeb4ba232b290e971113ba2fd94ca9587f19f3f3
+size 596070136

checkpoint-98/modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.models.Normalize"
+  }
+]

checkpoint-98/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b50ae83c1c72eec21aa046f0d7437f76e6ef8a2f0cc7e27e80abcc15585c4f86
+size 1192229387

checkpoint-98/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec81fb8e7bc823bebbf4d8eb5d9328a37bdf71c84cdb11761304ca7f2076f67c
+size 14645

checkpoint-98/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8050407fb4fa517140d91f016be515b027290100821411e470b937a3a98f10c3
+size 1465

checkpoint-98/sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+    "max_seq_length": 8192,
+    "do_lower_case": false
+}

checkpoint-98/special_tokens_map.json

@@ -0,0 +1,37 @@
+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": true,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-98/tokenizer_config.json

@@ -0,0 +1,952 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "|||IP_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "1": {
+      "content": "<|padding|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50254": {
+      "content": "                        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50255": {
+      "content": "                       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50256": {
+      "content": "                      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50257": {
+      "content": "                     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50258": {
+      "content": "                    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50259": {
+      "content": "                   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50260": {
+      "content": "                  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50261": {
+      "content": "                 ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50262": {
+      "content": "                ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50263": {
+      "content": "               ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50264": {
+      "content": "              ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50265": {
+      "content": "             ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50266": {
+      "content": "            ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50267": {
+      "content": "           ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50268": {
+      "content": "          ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50269": {
+      "content": "         ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50270": {
+      "content": "        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50271": {
+      "content": "       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50272": {
+      "content": "      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50273": {
+      "content": "     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50274": {
+      "content": "    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50275": {
+      "content": "   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50276": {
+      "content": "  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50277": {
+      "content": "|||EMAIL_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50278": {
+      "content": "|||PHONE_NUMBER|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50279": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50280": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50281": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50282": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50283": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50284": {
+      "content": "[MASK]",
+      "lstrip": true,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50285": {
+      "content": "[unused0]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50286": {
+      "content": "[unused1]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50287": {
+      "content": "[unused2]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50288": {
+      "content": "[unused3]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50289": {
+      "content": "[unused4]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50290": {
+      "content": "[unused5]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50291": {
+      "content": "[unused6]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50292": {
+      "content": "[unused7]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50293": {
+      "content": "[unused8]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50294": {
+      "content": "[unused9]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50295": {
+      "content": "[unused10]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50296": {
+      "content": "[unused11]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50297": {
+      "content": "[unused12]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50298": {
+      "content": "[unused13]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50299": {
+      "content": "[unused14]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50300": {
+      "content": "[unused15]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50301": {
+      "content": "[unused16]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50302": {
+      "content": "[unused17]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50303": {
+      "content": "[unused18]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50304": {
+      "content": "[unused19]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50305": {
+      "content": "[unused20]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50306": {
+      "content": "[unused21]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50307": {
+      "content": "[unused22]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50308": {
+      "content": "[unused23]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50309": {
+      "content": "[unused24]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50310": {
+      "content": "[unused25]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50311": {
+      "content": "[unused26]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50312": {
+      "content": "[unused27]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50313": {
+      "content": "[unused28]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50314": {
+      "content": "[unused29]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50315": {
+      "content": "[unused30]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50316": {
+      "content": "[unused31]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50317": {
+      "content": "[unused32]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50318": {
+      "content": "[unused33]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50319": {
+      "content": "[unused34]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50320": {
+      "content": "[unused35]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50321": {
+      "content": "[unused36]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50322": {
+      "content": "[unused37]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50323": {
+      "content": "[unused38]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50324": {
+      "content": "[unused39]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50325": {
+      "content": "[unused40]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50326": {
+      "content": "[unused41]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50327": {
+      "content": "[unused42]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50328": {
+      "content": "[unused43]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50329": {
+      "content": "[unused44]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50330": {
+      "content": "[unused45]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50331": {
+      "content": "[unused46]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50332": {
+      "content": "[unused47]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50333": {
+      "content": "[unused48]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50334": {
+      "content": "[unused49]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50335": {
+      "content": "[unused50]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50336": {
+      "content": "[unused51]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50337": {
+      "content": "[unused52]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50338": {
+      "content": "[unused53]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50339": {
+      "content": "[unused54]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50340": {
+      "content": "[unused55]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50341": {
+      "content": "[unused56]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50342": {
+      "content": "[unused57]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50343": {
+      "content": "[unused58]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50344": {
+      "content": "[unused59]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50345": {
+      "content": "[unused60]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50346": {
+      "content": "[unused61]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50347": {
+      "content": "[unused62]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50348": {
+      "content": "[unused63]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50349": {
+      "content": "[unused64]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50350": {
+      "content": "[unused65]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50351": {
+      "content": "[unused66]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50352": {
+      "content": "[unused67]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50353": {
+      "content": "[unused68]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50354": {
+      "content": "[unused69]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50355": {
+      "content": "[unused70]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50356": {
+      "content": "[unused71]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50357": {
+      "content": "[unused72]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50358": {
+      "content": "[unused73]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50359": {
+      "content": "[unused74]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50360": {
+      "content": "[unused75]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50361": {
+      "content": "[unused76]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50362": {
+      "content": "[unused77]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50363": {
+      "content": "[unused78]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50364": {
+      "content": "[unused79]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50365": {
+      "content": "[unused80]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50366": {
+      "content": "[unused81]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50367": {
+      "content": "[unused82]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "max_length": 8192,
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 8192,
+  "pad_to_multiple_of": null,
+  "pad_token": "[PAD]",
+  "pad_token_type_id": 0,
+  "padding_side": "right",
+  "sep_token": "[SEP]",
+  "stride": 0,
+  "tokenizer_class": "PreTrainedTokenizer",
+  "truncation_side": "right",
+  "truncation_strategy": "longest_first",
+  "unk_token": "[UNK]"
+}

checkpoint-98/trainer_state.json

@@ -0,0 +1,812 @@
+{
+  "best_global_step": 98,
+  "best_metric": 0.3790325714206647,
+  "best_model_checkpoint": "nomic-ai/modernbert-embed-base/checkpoint-98",
+  "epoch": 1.0,
+  "eval_steps": 500,
+  "global_step": 98,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.01020408163265306,
+      "grad_norm": 0.014294901862740517,
+      "learning_rate": 0.0,
+      "loss": 0.0001,
+      "step": 1
+    },
+    {
+      "epoch": 0.02040816326530612,
+      "grad_norm": 0.1376705914735794,
+      "learning_rate": 1.0204081632653061e-07,
+      "loss": 0.001,
+      "step": 2
+    },
+    {
+      "epoch": 0.030612244897959183,
+      "grad_norm": 11.743180274963379,
+      "learning_rate": 2.0408163265306121e-07,
+      "loss": 0.0938,
+      "step": 3
+    },
+    {
+      "epoch": 0.04081632653061224,
+      "grad_norm": 0.7897523641586304,
+      "learning_rate": 3.0612244897959183e-07,
+      "loss": 0.0084,
+      "step": 4
+    },
+    {
+      "epoch": 0.05102040816326531,
+      "grad_norm": 0.000707508996129036,
+      "learning_rate": 4.0816326530612243e-07,
+      "loss": 0.0,
+      "step": 5
+    },
+    {
+      "epoch": 0.061224489795918366,
+      "grad_norm": 0.042860936373472214,
+      "learning_rate": 5.102040816326531e-07,
+      "loss": 0.0004,
+      "step": 6
+    },
+    {
+      "epoch": 0.07142857142857142,
+      "grad_norm": 0.2763943076133728,
+      "learning_rate": 6.122448979591837e-07,
+      "loss": 0.003,
+      "step": 7
+    },
+    {
+      "epoch": 0.08163265306122448,
+      "grad_norm": 0.15693208575248718,
+      "learning_rate": 7.142857142857143e-07,
+      "loss": 0.0012,
+      "step": 8
+    },
+    {
+      "epoch": 0.09183673469387756,
+      "grad_norm": 0.04850756749510765,
+      "learning_rate": 8.163265306122449e-07,
+      "loss": 0.0001,
+      "step": 9
+    },
+    {
+      "epoch": 0.10204081632653061,
+      "grad_norm": 0.9481569528579712,
+      "learning_rate": 9.183673469387756e-07,
+      "loss": 0.0053,
+      "step": 10
+    },
+    {
+      "epoch": 0.11224489795918367,
+      "grad_norm": 0.9353957176208496,
+      "learning_rate": 1.0204081632653063e-06,
+      "loss": 0.0068,
+      "step": 11
+    },
+    {
+      "epoch": 0.12244897959183673,
+      "grad_norm": 0.06643998622894287,
+      "learning_rate": 1.122448979591837e-06,
+      "loss": 0.0006,
+      "step": 12
+    },
+    {
+      "epoch": 0.1326530612244898,
+      "grad_norm": 0.1136537492275238,
+      "learning_rate": 1.2244897959183673e-06,
+      "loss": 0.0007,
+      "step": 13
+    },
+    {
+      "epoch": 0.14285714285714285,
+      "grad_norm": 0.019414478912949562,
+      "learning_rate": 1.3265306122448982e-06,
+      "loss": 0.0003,
+      "step": 14
+    },
+    {
+      "epoch": 0.15306122448979592,
+      "grad_norm": 0.7712957859039307,
+      "learning_rate": 1.4285714285714286e-06,
+      "loss": 0.0096,
+      "step": 15
+    },
+    {
+      "epoch": 0.16326530612244897,
+      "grad_norm": 0.04083826765418053,
+      "learning_rate": 1.5306122448979593e-06,
+      "loss": 0.0004,
+      "step": 16
+    },
+    {
+      "epoch": 0.17346938775510204,
+      "grad_norm": 1.991432785987854,
+      "learning_rate": 1.6326530612244897e-06,
+      "loss": 0.016,
+      "step": 17
+    },
+    {
+      "epoch": 0.1836734693877551,
+      "grad_norm": 0.0026387416291981936,
+      "learning_rate": 1.7346938775510206e-06,
+      "loss": 0.0,
+      "step": 18
+    },
+    {
+      "epoch": 0.19387755102040816,
+      "grad_norm": 0.04518063738942146,
+      "learning_rate": 1.8367346938775512e-06,
+      "loss": 0.0005,
+      "step": 19
+    },
+    {
+      "epoch": 0.20408163265306123,
+      "grad_norm": 0.0027923083398491144,
+      "learning_rate": 1.938775510204082e-06,
+      "loss": 0.0,
+      "step": 20
+    },
+    {
+      "epoch": 0.21428571428571427,
+      "grad_norm": 0.225693017244339,
+      "learning_rate": 2.0408163265306125e-06,
+      "loss": 0.003,
+      "step": 21
+    },
+    {
+      "epoch": 0.22448979591836735,
+      "grad_norm": 6.234318256378174,
+      "learning_rate": 2.1428571428571427e-06,
+      "loss": 0.1395,
+      "step": 22
+    },
+    {
+      "epoch": 0.23469387755102042,
+      "grad_norm": 25.103811264038086,
+      "learning_rate": 2.244897959183674e-06,
+      "loss": 0.3967,
+      "step": 23
+    },
+    {
+      "epoch": 0.24489795918367346,
+      "grad_norm": 0.15607698261737823,
+      "learning_rate": 2.3469387755102044e-06,
+      "loss": 0.0023,
+      "step": 24
+    },
+    {
+      "epoch": 0.25510204081632654,
+      "grad_norm": 0.032192617654800415,
+      "learning_rate": 2.4489795918367347e-06,
+      "loss": 0.0003,
+      "step": 25
+    },
+    {
+      "epoch": 0.2653061224489796,
+      "grad_norm": 0.22997426986694336,
+      "learning_rate": 2.5510204081632657e-06,
+      "loss": 0.0027,
+      "step": 26
+    },
+    {
+      "epoch": 0.2755102040816326,
+      "grad_norm": 1.1110199689865112,
+      "learning_rate": 2.6530612244897964e-06,
+      "loss": 0.0147,
+      "step": 27
+    },
+    {
+      "epoch": 0.2857142857142857,
+      "grad_norm": 3.659369945526123,
+      "learning_rate": 2.7551020408163266e-06,
+      "loss": 0.0522,
+      "step": 28
+    },
+    {
+      "epoch": 0.29591836734693877,
+      "grad_norm": 0.005585783626884222,
+      "learning_rate": 2.8571428571428573e-06,
+      "loss": 0.0001,
+      "step": 29
+    },
+    {
+      "epoch": 0.30612244897959184,
+      "grad_norm": 0.07389459758996964,
+      "learning_rate": 2.959183673469388e-06,
+      "loss": 0.0008,
+      "step": 30
+    },
+    {
+      "epoch": 0.3163265306122449,
+      "grad_norm": 0.39431512355804443,
+      "learning_rate": 3.0612244897959185e-06,
+      "loss": 0.0044,
+      "step": 31
+    },
+    {
+      "epoch": 0.32653061224489793,
+      "grad_norm": 0.0016656734514981508,
+      "learning_rate": 3.1632653061224496e-06,
+      "loss": 0.0,
+      "step": 32
+    },
+    {
+      "epoch": 0.336734693877551,
+      "grad_norm": 0.20897622406482697,
+      "learning_rate": 3.2653061224489794e-06,
+      "loss": 0.0028,
+      "step": 33
+    },
+    {
+      "epoch": 0.3469387755102041,
+      "grad_norm": 0.08076613396406174,
+      "learning_rate": 3.3673469387755105e-06,
+      "loss": 0.0007,
+      "step": 34
+    },
+    {
+      "epoch": 0.35714285714285715,
+      "grad_norm": 0.022262288257479668,
+      "learning_rate": 3.469387755102041e-06,
+      "loss": 0.0002,
+      "step": 35
+    },
+    {
+      "epoch": 0.3673469387755102,
+      "grad_norm": 1.9193856716156006,
+      "learning_rate": 3.5714285714285718e-06,
+      "loss": 0.0168,
+      "step": 36
+    },
+    {
+      "epoch": 0.37755102040816324,
+      "grad_norm": 0.1695105880498886,
+      "learning_rate": 3.6734693877551024e-06,
+      "loss": 0.0023,
+      "step": 37
+    },
+    {
+      "epoch": 0.3877551020408163,
+      "grad_norm": 0.5352568626403809,
+      "learning_rate": 3.7755102040816327e-06,
+      "loss": 0.0041,
+      "step": 38
+    },
+    {
+      "epoch": 0.3979591836734694,
+      "grad_norm": 0.6937710642814636,
+      "learning_rate": 3.877551020408164e-06,
+      "loss": 0.0081,
+      "step": 39
+    },
+    {
+      "epoch": 0.40816326530612246,
+      "grad_norm": 0.030398719012737274,
+      "learning_rate": 3.979591836734694e-06,
+      "loss": 0.0004,
+      "step": 40
+    },
+    {
+      "epoch": 0.41836734693877553,
+      "grad_norm": 0.003243567654863,
+      "learning_rate": 4.081632653061225e-06,
+      "loss": 0.0,
+      "step": 41
+    },
+    {
+      "epoch": 0.42857142857142855,
+      "grad_norm": 0.38866573572158813,
+      "learning_rate": 4.183673469387755e-06,
+      "loss": 0.005,
+      "step": 42
+    },
+    {
+      "epoch": 0.4387755102040816,
+      "grad_norm": 0.3949674367904663,
+      "learning_rate": 4.2857142857142855e-06,
+      "loss": 0.0031,
+      "step": 43
+    },
+    {
+      "epoch": 0.4489795918367347,
+      "grad_norm": 2.9631612300872803,
+      "learning_rate": 4.3877551020408165e-06,
+      "loss": 0.0216,
+      "step": 44
+    },
+    {
+      "epoch": 0.45918367346938777,
+      "grad_norm": 0.03951283544301987,
+      "learning_rate": 4.489795918367348e-06,
+      "loss": 0.0004,
+      "step": 45
+    },
+    {
+      "epoch": 0.46938775510204084,
+      "grad_norm": 0.14974893629550934,
+      "learning_rate": 4.591836734693878e-06,
+      "loss": 0.0018,
+      "step": 46
+    },
+    {
+      "epoch": 0.47959183673469385,
+      "grad_norm": 0.0015900792786851525,
+      "learning_rate": 4.693877551020409e-06,
+      "loss": 0.0,
+      "step": 47
+    },
+    {
+      "epoch": 0.4897959183673469,
+      "grad_norm": 0.28462550044059753,
+      "learning_rate": 4.795918367346939e-06,
+      "loss": 0.0044,
+      "step": 48
+    },
+    {
+      "epoch": 0.5,
+      "grad_norm": 0.035834282636642456,
+      "learning_rate": 4.897959183673469e-06,
+      "loss": 0.0004,
+      "step": 49
+    },
+    {
+      "epoch": 0.5102040816326531,
+      "grad_norm": 0.13105374574661255,
+      "learning_rate": 5e-06,
+      "loss": 0.0019,
+      "step": 50
+    },
+    {
+      "epoch": 0.5204081632653061,
+      "grad_norm": 0.04286932945251465,
+      "learning_rate": 5.1020408163265315e-06,
+      "loss": 0.0005,
+      "step": 51
+    },
+    {
+      "epoch": 0.5306122448979592,
+      "grad_norm": 0.14368070662021637,
+      "learning_rate": 5.204081632653062e-06,
+      "loss": 0.0016,
+      "step": 52
+    },
+    {
+      "epoch": 0.5408163265306123,
+      "grad_norm": 15.608235359191895,
+      "learning_rate": 5.306122448979593e-06,
+      "loss": 0.1806,
+      "step": 53
+    },
+    {
+      "epoch": 0.5510204081632653,
+      "grad_norm": 0.004551250953227282,
+      "learning_rate": 5.408163265306123e-06,
+      "loss": 0.0,
+      "step": 54
+    },
+    {
+      "epoch": 0.5612244897959183,
+      "grad_norm": 0.2460200935602188,
+      "learning_rate": 5.510204081632653e-06,
+      "loss": 0.0025,
+      "step": 55
+    },
+    {
+      "epoch": 0.5714285714285714,
+      "grad_norm": 0.022206343710422516,
+      "learning_rate": 5.6122448979591834e-06,
+      "loss": 0.0002,
+      "step": 56
+    },
+    {
+      "epoch": 0.5816326530612245,
+      "grad_norm": 0.0030557001009583473,
+      "learning_rate": 5.7142857142857145e-06,
+      "loss": 0.0,
+      "step": 57
+    },
+    {
+      "epoch": 0.5918367346938775,
+      "grad_norm": 1.3751850128173828,
+      "learning_rate": 5.816326530612246e-06,
+      "loss": 0.0111,
+      "step": 58
+    },
+    {
+      "epoch": 0.6020408163265306,
+      "grad_norm": 0.11706340312957764,
+      "learning_rate": 5.918367346938776e-06,
+      "loss": 0.0011,
+      "step": 59
+    },
+    {
+      "epoch": 0.6122448979591837,
+      "grad_norm": 0.027977069839835167,
+      "learning_rate": 6.020408163265307e-06,
+      "loss": 0.0003,
+      "step": 60
+    },
+    {
+      "epoch": 0.6224489795918368,
+      "grad_norm": 125.90001678466797,
+      "learning_rate": 6.122448979591837e-06,
+      "loss": 1.8072,
+      "step": 61
+    },
+    {
+      "epoch": 0.6326530612244898,
+      "grad_norm": 0.07176324725151062,
+      "learning_rate": 6.224489795918368e-06,
+      "loss": 0.0009,
+      "step": 62
+    },
+    {
+      "epoch": 0.6428571428571429,
+      "grad_norm": 0.06726501137018204,
+      "learning_rate": 6.326530612244899e-06,
+      "loss": 0.0011,
+      "step": 63
+    },
+    {
+      "epoch": 0.6530612244897959,
+      "grad_norm": 0.126393660902977,
+      "learning_rate": 6.4285714285714295e-06,
+      "loss": 0.0013,
+      "step": 64
+    },
+    {
+      "epoch": 0.6632653061224489,
+      "grad_norm": 0.0025682460982352495,
+      "learning_rate": 6.530612244897959e-06,
+      "loss": 0.0,
+      "step": 65
+    },
+    {
+      "epoch": 0.673469387755102,
+      "grad_norm": 0.05368286743760109,
+      "learning_rate": 6.63265306122449e-06,
+      "loss": 0.0007,
+      "step": 66
+    },
+    {
+      "epoch": 0.6836734693877551,
+      "grad_norm": 13.678145408630371,
+      "learning_rate": 6.734693877551021e-06,
+      "loss": 0.4116,
+      "step": 67
+    },
+    {
+      "epoch": 0.6938775510204082,
+      "grad_norm": 0.7735011577606201,
+      "learning_rate": 6.836734693877551e-06,
+      "loss": 0.008,
+      "step": 68
+    },
+    {
+      "epoch": 0.7040816326530612,
+      "grad_norm": 0.07968823611736298,
+      "learning_rate": 6.938775510204082e-06,
+      "loss": 0.0009,
+      "step": 69
+    },
+    {
+      "epoch": 0.7142857142857143,
+      "grad_norm": 0.03921031951904297,
+      "learning_rate": 7.0408163265306125e-06,
+      "loss": 0.0004,
+      "step": 70
+    },
+    {
+      "epoch": 0.7244897959183674,
+      "grad_norm": 0.16386456787586212,
+      "learning_rate": 7.1428571428571436e-06,
+      "loss": 0.0019,
+      "step": 71
+    },
+    {
+      "epoch": 0.7346938775510204,
+      "grad_norm": 0.055115193128585815,
+      "learning_rate": 7.244897959183675e-06,
+      "loss": 0.0005,
+      "step": 72
+    },
+    {
+      "epoch": 0.7448979591836735,
+      "grad_norm": 0.029161576181650162,
+      "learning_rate": 7.346938775510205e-06,
+      "loss": 0.0004,
+      "step": 73
+    },
+    {
+      "epoch": 0.7551020408163265,
+      "grad_norm": 0.03603975474834442,
+      "learning_rate": 7.448979591836736e-06,
+      "loss": 0.0005,
+      "step": 74
+    },
+    {
+      "epoch": 0.7653061224489796,
+      "grad_norm": 0.008691967464983463,
+      "learning_rate": 7.551020408163265e-06,
+      "loss": 0.0001,
+      "step": 75
+    },
+    {
+      "epoch": 0.7755102040816326,
+      "grad_norm": 0.05404982343316078,
+      "learning_rate": 7.653061224489796e-06,
+      "loss": 0.0005,
+      "step": 76
+    },
+    {
+      "epoch": 0.7857142857142857,
+      "grad_norm": 0.00028783048037439585,
+      "learning_rate": 7.755102040816327e-06,
+      "loss": 0.0,
+      "step": 77
+    },
+    {
+      "epoch": 0.7959183673469388,
+      "grad_norm": 0.011970845982432365,
+      "learning_rate": 7.857142857142858e-06,
+      "loss": 0.0001,
+      "step": 78
+    },
+    {
+      "epoch": 0.8061224489795918,
+      "grad_norm": 0.37045904994010925,
+      "learning_rate": 7.959183673469388e-06,
+      "loss": 0.0025,
+      "step": 79
+    },
+    {
+      "epoch": 0.8163265306122449,
+      "grad_norm": 0.00590208824723959,
+      "learning_rate": 8.06122448979592e-06,
+      "loss": 0.0,
+      "step": 80
+    },
+    {
+      "epoch": 0.826530612244898,
+      "grad_norm": 0.1372489035129547,
+      "learning_rate": 8.16326530612245e-06,
+      "loss": 0.0012,
+      "step": 81
+    },
+    {
+      "epoch": 0.8367346938775511,
+      "grad_norm": 0.024213174358010292,
+      "learning_rate": 8.26530612244898e-06,
+      "loss": 0.0003,
+      "step": 82
+    },
+    {
+      "epoch": 0.8469387755102041,
+      "grad_norm": 0.023818498477339745,
+      "learning_rate": 8.36734693877551e-06,
+      "loss": 0.0002,
+      "step": 83
+    },
+    {
+      "epoch": 0.8571428571428571,
+      "grad_norm": 0.003695722436532378,
+      "learning_rate": 8.469387755102042e-06,
+      "loss": 0.0,
+      "step": 84
+    },
+    {
+      "epoch": 0.8673469387755102,
+      "grad_norm": 0.0007995363557711244,
+      "learning_rate": 8.571428571428571e-06,
+      "loss": 0.0,
+      "step": 85
+    },
+    {
+      "epoch": 0.8775510204081632,
+      "grad_norm": 0.0013144081458449364,
+      "learning_rate": 8.673469387755103e-06,
+      "loss": 0.0,
+      "step": 86
+    },
+    {
+      "epoch": 0.8877551020408163,
+      "grad_norm": 0.012435175478458405,
+      "learning_rate": 8.775510204081633e-06,
+      "loss": 0.0002,
+      "step": 87
+    },
+    {
+      "epoch": 0.8979591836734694,
+      "grad_norm": 0.0652078241109848,
+      "learning_rate": 8.877551020408163e-06,
+      "loss": 0.0009,
+      "step": 88
+    },
+    {
+      "epoch": 0.9081632653061225,
+      "grad_norm": 0.35363656282424927,
+      "learning_rate": 8.979591836734695e-06,
+      "loss": 0.0067,
+      "step": 89
+    },
+    {
+      "epoch": 0.9183673469387755,
+      "grad_norm": 0.004570689518004656,
+      "learning_rate": 9.081632653061225e-06,
+      "loss": 0.0,
+      "step": 90
+    },
+    {
+      "epoch": 0.9285714285714286,
+      "grad_norm": 0.0073068393394351006,
+      "learning_rate": 9.183673469387756e-06,
+      "loss": 0.0001,
+      "step": 91
+    },
+    {
+      "epoch": 0.9387755102040817,
+      "grad_norm": 0.09485316276550293,
+      "learning_rate": 9.285714285714288e-06,
+      "loss": 0.0008,
+      "step": 92
+    },
+    {
+      "epoch": 0.9489795918367347,
+      "grad_norm": 0.3648199141025543,
+      "learning_rate": 9.387755102040818e-06,
+      "loss": 0.0031,
+      "step": 93
+    },
+    {
+      "epoch": 0.9591836734693877,
+      "grad_norm": 0.030145330354571342,
+      "learning_rate": 9.489795918367348e-06,
+      "loss": 0.0004,
+      "step": 94
+    },
+    {
+      "epoch": 0.9693877551020408,
+      "grad_norm": 0.02468164637684822,
+      "learning_rate": 9.591836734693878e-06,
+      "loss": 0.0004,
+      "step": 95
+    },
+    {
+      "epoch": 0.9795918367346939,
+      "grad_norm": 0.013045134954154491,
+      "learning_rate": 9.693877551020408e-06,
+      "loss": 0.0001,
+      "step": 96
+    },
+    {
+      "epoch": 0.9897959183673469,
+      "grad_norm": 0.043702784925699234,
+      "learning_rate": 9.795918367346939e-06,
+      "loss": 0.0004,
+      "step": 97
+    },
+    {
+      "epoch": 1.0,
+      "grad_norm": 0.04222981631755829,
+      "learning_rate": 9.89795918367347e-06,
+      "loss": 0.0005,
+      "step": 98
+    },
+    {
+      "epoch": 1.0,
+      "eval_dim_128_cosine_accuracy@1": 0.3559539052496799,
+      "eval_dim_128_cosine_accuracy@10": 0.4186939820742638,
+      "eval_dim_128_cosine_accuracy@3": 0.3617157490396927,
+      "eval_dim_128_cosine_accuracy@5": 0.39244558258642764,
+      "eval_dim_128_cosine_map@100": 0.43535825619272106,
+      "eval_dim_128_cosine_mrr@10": 0.3671173505680543,
+      "eval_dim_128_cosine_ndcg@10": 0.3790325714206647,
+      "eval_dim_128_cosine_precision@1": 0.3559539052496799,
+      "eval_dim_128_cosine_precision@10": 0.32131882202304735,
+      "eval_dim_128_cosine_precision@3": 0.35552710200597526,
+      "eval_dim_128_cosine_precision@5": 0.3490396927016646,
+      "eval_dim_128_cosine_recall@1": 0.037575464818099744,
+      "eval_dim_128_cosine_recall@10": 0.2541985714643628,
+      "eval_dim_128_cosine_recall@3": 0.11032964908822472,
+      "eval_dim_128_cosine_recall@5": 0.16793427308834435,
+      "eval_dim_256_cosine_accuracy@1": 0.3873239436619718,
+      "eval_dim_256_cosine_accuracy@10": 0.4494238156209987,
+      "eval_dim_256_cosine_accuracy@3": 0.39244558258642764,
+      "eval_dim_256_cosine_accuracy@5": 0.4206145966709347,
+      "eval_dim_256_cosine_map@100": 0.4661645952118268,
+      "eval_dim_256_cosine_mrr@10": 0.39812790886734506,
+      "eval_dim_256_cosine_ndcg@10": 0.40977946157999073,
+      "eval_dim_256_cosine_precision@1": 0.3873239436619718,
+      "eval_dim_256_cosine_precision@10": 0.348527528809219,
+      "eval_dim_256_cosine_precision@3": 0.3868971404182671,
+      "eval_dim_256_cosine_precision@5": 0.37912932138284255,
+      "eval_dim_256_cosine_recall@1": 0.04023203819999771,
+      "eval_dim_256_cosine_recall@10": 0.27112137316286944,
+      "eval_dim_256_cosine_recall@3": 0.1180462190143581,
+      "eval_dim_256_cosine_recall@5": 0.17956095699785507,
+      "eval_dim_512_cosine_accuracy@1": 0.39500640204865556,
+      "eval_dim_512_cosine_accuracy@10": 0.4532650448143406,
+      "eval_dim_512_cosine_accuracy@3": 0.39884763124199746,
+      "eval_dim_512_cosine_accuracy@5": 0.42509603072983354,
+      "eval_dim_512_cosine_map@100": 0.47311757377710084,
+      "eval_dim_512_cosine_mrr@10": 0.4048785135052737,
+      "eval_dim_512_cosine_ndcg@10": 0.4154101738314148,
+      "eval_dim_512_cosine_precision@1": 0.39500640204865556,
+      "eval_dim_512_cosine_precision@10": 0.35102432778489123,
+      "eval_dim_512_cosine_precision@3": 0.393939393939394,
+      "eval_dim_512_cosine_precision@5": 0.3846350832266325,
+      "eval_dim_512_cosine_recall@1": 0.04167554612344552,
+      "eval_dim_512_cosine_recall@10": 0.27558399878065315,
+      "eval_dim_512_cosine_recall@3": 0.12185555036210068,
+      "eval_dim_512_cosine_recall@5": 0.18440910016156958,
+      "eval_dim_64_cosine_accuracy@1": 0.31306017925736235,
+      "eval_dim_64_cosine_accuracy@10": 0.3758002560819462,
+      "eval_dim_64_cosine_accuracy@3": 0.31946222791293216,
+      "eval_dim_64_cosine_accuracy@5": 0.34635083226632524,
+      "eval_dim_64_cosine_map@100": 0.3923627170196659,
+      "eval_dim_64_cosine_mrr@10": 0.3240625571611481,
+      "eval_dim_64_cosine_ndcg@10": 0.33574924678086643,
+      "eval_dim_64_cosine_precision@1": 0.31306017925736235,
+      "eval_dim_64_cosine_precision@10": 0.2819462227912932,
+      "eval_dim_64_cosine_precision@3": 0.313486982501067,
+      "eval_dim_64_cosine_precision@5": 0.3075544174135723,
+      "eval_dim_64_cosine_recall@1": 0.033872169883188745,
+      "eval_dim_64_cosine_recall@10": 0.228651154461535,
+      "eval_dim_64_cosine_recall@3": 0.09984524687478234,
+      "eval_dim_64_cosine_recall@5": 0.15245541388627262,
+      "eval_dim_768_cosine_accuracy@1": 0.4026888604353393,
+      "eval_dim_768_cosine_accuracy@10": 0.469270166453265,
+      "eval_dim_768_cosine_accuracy@3": 0.4065300896286812,
+      "eval_dim_768_cosine_accuracy@5": 0.4359795134443022,
+      "eval_dim_768_cosine_map@100": 0.48436770951404184,
+      "eval_dim_768_cosine_mrr@10": 0.41397348738898004,
+      "eval_dim_768_cosine_ndcg@10": 0.42608814635365755,
+      "eval_dim_768_cosine_precision@1": 0.4026888604353393,
+      "eval_dim_768_cosine_precision@10": 0.36241997439180534,
+      "eval_dim_768_cosine_precision@3": 0.4016218523260776,
+      "eval_dim_768_cosine_precision@5": 0.3929577464788732,
+      "eval_dim_768_cosine_recall@1": 0.042158204863822595,
+      "eval_dim_768_cosine_recall@10": 0.28222410577862556,
+      "eval_dim_768_cosine_recall@3": 0.12340911592737758,
+      "eval_dim_768_cosine_recall@5": 0.18693795146685696,
+      "eval_runtime": 183.9141,
+      "eval_samples_per_second": 0.0,
+      "eval_sequential_score": 0.33574924678086643,
+      "eval_steps_per_second": 0.0,
+      "step": 98
+    }
+  ],
+  "logging_steps": 1,
+  "max_steps": 1960,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 20,
+  "save_steps": 500,
+  "stateful_callbacks": {
+    "EarlyStoppingCallback": {
+      "args": {
+        "early_stopping_patience": 2,
+        "early_stopping_threshold": 0.0
+      },
+      "attributes": {
+        "early_stopping_patience_counter": 0
+      }
+    },
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 0.0,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-98/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:27a8a832f799db6edc75ec7d1e9c1a684653e1255a6753af8a20470c25db5513
+size 6097

eval/Information-Retrieval_evaluation_dim_128_results.csv

@@ -10,3 +10,6 @@ epoch,steps,cosine-Accuracy@1,cosine-Accuracy@3,cosine-Accuracy@5,cosine-Accurac
 2.0,196,0.3553137003841229,0.3617157490396927,0.38988476312419973,0.4167733674775928,0.3553137003841229,0.038627357901670004,0.35552710200597526,0.11364993084786716,0.34814340588988474,0.17269211708889393,0.3176696542893726,0.2586321191653615,0.36626094953559696,0.37821276050416114,0.4346957375897274
 3.0,294,0.34763124199743917,0.353393085787452,0.38348271446862997,0.4199743918053777,0.34763124199743917,0.036574097887490074,0.34784464361929146,0.10792857681593648,0.34135723431498083,0.16397305340057647,0.318629961587708,0.25234098526291365,0.36006899985773183,0.37378784294095396,0.4332520995017439
 4.0,392,0.34507042253521125,0.35147247119078107,0.38028169014084506,0.41101152368758004,0.34507042253521125,0.03674308261195813,0.34571062740076824,0.10854200462134246,0.3390524967989757,0.16528054487712734,0.3124839948783611,0.24990838450036762,0.3567330752189903,0.3687761857923042,0.43107536367707355
+1.0,98,0.3559539052496799,0.3617157490396927,0.39244558258642764,0.4186939820742638,0.3559539052496799,0.037575464818099744,0.35552710200597526,0.11032964908822472,0.3490396927016646,0.16793427308834435,0.32131882202304735,0.2541985714643628,0.3671173505680543,0.3790325714206647,0.43535825619272106
+2.0,196,0.34507042253521125,0.35147247119078107,0.38412291933418696,0.41357234314980795,0.34507042253521125,0.03779060006776101,0.34528382415706355,0.11111523194759507,0.3390524967989757,0.16892829224345354,0.3118437900128041,0.2542611355685967,0.35724981200333256,0.3705587688392343,0.4308148525481854
+3.0,294,0.353393085787452,0.35979513444302175,0.3847631241997439,0.4142125480153649,0.353393085787452,0.036464605000445925,0.35381988903115663,0.10761057769873429,0.34609475032010245,0.1630330675703894,0.31952624839948784,0.2478046074721795,0.36410660935308786,0.37609461891444046,0.4332448707193373

eval/Information-Retrieval_evaluation_dim_256_results.csv

@@ -10,3 +10,6 @@ epoch,steps,cosine-Accuracy@1,cosine-Accuracy@3,cosine-Accuracy@5,cosine-Accurac
 2.0,196,0.3854033290653009,0.38988476312419973,0.4199743918053777,0.4500640204865557,0.3854033290653009,0.040129876225339534,0.3851899274434486,0.11811318592862516,0.37759282970550573,0.17998663619137895,0.3473111395646607,0.2712240355508765,0.39665874032071163,0.40840027342579643,0.4644962788032259
 3.0,294,0.3905249679897567,0.39564660691421255,0.4199743918053777,0.4513444302176697,0.3905249679897567,0.040552940063526215,0.39031156636790443,0.11930917453107383,0.3814340588988476,0.1806280229444006,0.3508962868117798,0.2707983661312114,0.40107767819035406,0.4117889497609331,0.4689769976086867
 4.0,392,0.37964148527528807,0.3873239436619718,0.4142125480153649,0.44494238156209986,0.37964148527528807,0.039124417631678836,0.38028169014084506,0.1153665545855213,0.3734955185659411,0.1757838879336913,0.34526248399487836,0.2665534618848508,0.3914128711663921,0.4037131645468801,0.4618802165631398
+1.0,98,0.3873239436619718,0.39244558258642764,0.4206145966709347,0.4494238156209987,0.3873239436619718,0.04023203819999771,0.3868971404182671,0.1180462190143581,0.37912932138284255,0.17956095699785507,0.348527528809219,0.27112137316286944,0.39812790886734506,0.40977946157999073,0.4661645952118268
+2.0,196,0.37900128040973113,0.38348271446862997,0.4154929577464789,0.44878361075544176,0.37900128040973113,0.04027834797290038,0.37793427230046944,0.11799375375346732,0.3701664532650448,0.17890927920221725,0.34206145966709345,0.27059289435393563,0.3909187447919838,0.4032243160613258,0.46299996573163127
+3.0,294,0.3860435339308579,0.39244558258642764,0.4167733674775928,0.44814340588988477,0.3860435339308579,0.03962321211820953,0.3866837387964149,0.11744680009464445,0.37836107554417414,0.17843204724958808,0.3476952624839948,0.26814407122008105,0.3969033900371925,0.40839722669645323,0.4642655010516818

eval/Information-Retrieval_evaluation_dim_512_results.csv

@@ -10,3 +10,6 @@ epoch,steps,cosine-Accuracy@1,cosine-Accuracy@3,cosine-Accuracy@5,cosine-Accurac
 2.0,196,0.3905249679897567,0.39436619718309857,0.42573623559539053,0.4526248399487836,0.3905249679897567,0.041244569952314354,0.38988476312419973,0.12120282671426413,0.3818181818181818,0.18424574322417833,0.3498719590268886,0.27661387603808657,0.4012791394833645,0.41305830961162454,0.46989479441394943
 3.0,294,0.39820742637644047,0.4046094750320102,0.4263764404609475,0.45838668373879643,0.39820742637644047,0.04131054911164303,0.3986342296201451,0.12173427262435019,0.3893725992317541,0.18446122921285565,0.35755441741357236,0.27750046911354176,0.4088185679734973,0.41980419360887333,0.47818911424096583
 4.0,392,0.39308578745198464,0.4020486555697823,0.4225352112676056,0.45774647887323944,0.39308578745198464,0.04075326438991671,0.3941527955612463,0.12015983913317638,0.3854033290653009,0.1819336388905291,0.3544174135723431,0.27537478153215217,0.404457807450765,0.41611852026670604,0.4759217537331298
+1.0,98,0.39500640204865556,0.39884763124199746,0.42509603072983354,0.4532650448143406,0.39500640204865556,0.04167554612344552,0.393939393939394,0.12185555036210068,0.3846350832266325,0.18440910016156958,0.35102432778489123,0.27558399878065315,0.4048785135052737,0.4154101738314148,0.47311757377710084
+2.0,196,0.38028169014084506,0.38412291933418696,0.4180537772087068,0.44430217669654287,0.38028169014084506,0.041217743020374786,0.37942808365343583,0.12079180058349871,0.3714468629961588,0.18295012439591,0.3401408450704225,0.2733570628886365,0.39145656768896175,0.4038131313154522,0.46609447657301045
+3.0,294,0.39436619718309857,0.39884763124199746,0.4180537772087068,0.4532650448143406,0.39436619718309857,0.04042853140523698,0.39436619718309857,0.1196927035383132,0.38412291933418696,0.18113736600353658,0.35262483994878363,0.2725004471030787,0.4040899437026195,0.41401334483433183,0.47229660803723117

eval/Information-Retrieval_evaluation_dim_64_results.csv

@@ -10,3 +10,6 @@ epoch,steps,cosine-Accuracy@1,cosine-Accuracy@3,cosine-Accuracy@5,cosine-Accurac
 2.0,196,0.3028169014084507,0.31049935979513443,0.3399487836107554,0.3719590268886043,0.3028169014084507,0.03383408444379441,0.30367050789586,0.09992674550587541,0.2982074263764405,0.15219083914438378,0.2746478873239437,0.22977756399761853,0.3150631059081757,0.32829551547419517,0.3845480162631014
 3.0,294,0.29513444302176695,0.30153649167733676,0.3265044814340589,0.3559539052496799,0.29513444302176695,0.0310144236339133,0.29598804950917623,0.09171812890758381,0.2906530089628681,0.13962628846987257,0.2701024327784891,0.21535709630112995,0.3058733715423852,0.3175516019719684,0.3770640294522326
 4.0,392,0.3060179257362356,0.3079385403329065,0.33418693982074266,0.3681177976952625,0.3060179257362356,0.033221031499260444,0.30516431924882625,0.09768707755697564,0.29833546734955185,0.14884668347538832,0.2750960307298336,0.23035737422209354,0.3159395768550693,0.3271193606854658,0.38669906496360756
+1.0,98,0.31306017925736235,0.31946222791293216,0.34635083226632524,0.3758002560819462,0.31306017925736235,0.033872169883188745,0.313486982501067,0.09984524687478234,0.3075544174135723,0.15245541388627262,0.2819462227912932,0.228651154461535,0.3240625571611481,0.33574924678086643,0.3923627170196659
+2.0,196,0.3066581306017926,0.3111395646606914,0.3354673495518566,0.36427656850192064,0.3066581306017926,0.03426882400643975,0.30623132735808795,0.10063654687404197,0.2988476312419974,0.1525674849860816,0.2722151088348272,0.227699287913431,0.31652084222506716,0.32687333076394454,0.38693424826091144
+3.0,294,0.3079385403329065,0.31562099871959026,0.3348271446862996,0.36939820742637647,0.3079385403329065,0.03154669390524976,0.3092189500640205,0.09368644321809669,0.3026888604353393,0.14256307415283676,0.28040973111395645,0.21725520447019792,0.3185400280470698,0.3297439353321731,0.3853517715303568

eval/Information-Retrieval_evaluation_dim_768_results.csv

@@ -10,3 +10,6 @@ epoch,steps,cosine-Accuracy@1,cosine-Accuracy@3,cosine-Accuracy@5,cosine-Accurac
 2.0,196,0.4001280409731114,0.4058898847631242,0.4372599231754161,0.471190781049936,0.4001280409731114,0.042347333926694236,0.3997012377294067,0.1240435037991904,0.3919334186939821,0.18802233648261496,0.3613316261203586,0.2824349113791798,0.4124385200089422,0.4252421162228998,0.4841264299392437
 3.0,294,0.4020486555697823,0.40717029449423814,0.4327784891165173,0.4673495518565941,0.4020486555697823,0.04197809637481895,0.40183525394792996,0.12353744887550396,0.3928297055057618,0.18676497822254692,0.36235595390524966,0.2818107957085131,0.41323521939719104,0.4249694897262844,0.4842045422278839
 4.0,392,0.39436619718309857,0.4014084507042254,0.4321382842509603,0.4679897567221511,0.39436619718309857,0.04157946017051904,0.39457959880495086,0.12214811084382268,0.38706786171574903,0.18499389797471857,0.35928297055057623,0.2820017295188253,0.4073224701745827,0.42115237797407157,0.4829322015305782
+1.0,98,0.4026888604353393,0.4065300896286812,0.4359795134443022,0.469270166453265,0.4026888604353393,0.042158204863822595,0.4016218523260776,0.12340911592737758,0.3929577464788732,0.18693795146685696,0.36241997439180534,0.28222410577862556,0.41397348738898004,0.42608814635365755,0.48436770951404184
+2.0,196,0.3758002560819462,0.38156209987195905,0.41613316261203587,0.4468629961587708,0.3758002560819462,0.04146170353478509,0.37537345283824153,0.12127139138148112,0.3681177976952625,0.18355055377188786,0.33898847631241996,0.275632920609814,0.38836326037030233,0.4020597577790278,0.4686277000119534
+3.0,294,0.4020486555697823,0.4052496798975672,0.42893725992317544,0.46094750320102434,0.4020486555697823,0.04175313555284748,0.401195049082373,0.12278476862052412,0.39129321382842513,0.18536806181354978,0.3589628681177977,0.2777345271673647,0.4118049204316806,0.4220301651533148,0.4807606113925945

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:43d09dad89bfac078d48beef8c741a8d192bf63470eada6ae8d559b77880a725
+oid sha256:95e5a818377bdcd1bbf4879eeeb4ba232b290e971113ba2fd94ca9587f19f3f3
 size 596070136

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e7b1978ddb1f8ac53331bb6b2e761a7e89618f491581115c3167505094898d39
+oid sha256:27a8a832f799db6edc75ec7d1e9c1a684653e1255a6753af8a20470c25db5513
 size 6097