Upload fine-tuned TSDAE model

README.md

@@ -5,132 +5,140 @@ tags:
 - feature-extraction
 - dense
 - generated_from_trainer
-- dataset_size:24888
+- dataset_size:24880
 - loss:DenoisingAutoEncoderLoss
 base_model: BAAI/bge-base-en-v1.5
 widget:
-- source_sentence: SUBSECTION] for services The must have a transfusion reviewed and
-    responsible party) that the, transfer, and of blood.
+- source_sentence: '[MASK] blood and blood components from previous donations in inventory.
+    [ITEM i] If the blood collecting establishment notifies the hospital that the
+    result of the supplemental (additional, more specific) test or other follow-up
+    testing required by FDA is negative, absent other informative test results, the
+    hospital may release the blood and blood components from quarantine. [ITEM ii]
+    If the blood collecting establishment notifies the hospital that the result of
+    the supplemental, (additional, more specific) test or other follow-up testing
+    required by FDA is positive, the hospital must—'
   sentences:
-  - '[SUBSECTION C] Encourage and promote use of enabling technologies for improving
-    care coordination for beneficiaries. Enabling technologies may include one or
-    more of the following: [CLAUSE 4] () Other electronic tools to engage beneficiaries
-    in their care.'
-  - '[SUBSECTION a] Arrangement for services.. The facility must have a transfusion
-    service agreement reviewed and approved by the responsible party(ies) that govern
-    the procurement, transfer, and availability of blood and blood products.'
-  - '[SUBSECTION a] Resolution when noncompliance is indicated.. (1) If an investigation
-    of a complaint pursuant to § 3.306 of this subpart or a compliance review pursuant
-    to § 3.308 of this subpart indicates noncompliance, the Secretary may attempt
-    to reach a resolution of the matter satisfactory to the Secretary by informal
-    means. Informal means may include demonstrated compliance or a completed corrective
-    action plan or other agreement. [CLAUSE 2] If the matter is resolved by informal
-    means, the Secretary will so inform the respondent and, if the matter arose from
-    a complaint, the complainant, in writing. [CLAUSE 3] If the matter is not resolved
-    by informal means, the Secretary will— [ITEM i] So inform the respondent and provide
-    the respondent an opportunity to submit written evidence of any mitigating factors.
-    The respondent must submit any evidence to the Secretary within 30 days (computed
-    in the same manner as prescribed under § 3.526 of this subpart) of receipt of
-    such notification; and [ITEM ii] If, following action pursuant to paragraph (a)(3)(i)
-    of this section, the Secretary decides that a civil money penalty should be imposed,
-    inform the respondent of such finding in a notice of proposed determination in
-    accordance with § 3.420 of this subpart.'
-- source_sentence: '[SUBSECTION e Continued, for after home [ITEM] and validly described
-    ()) of this ITEM ii] subject and in with all the provisions of— [CLAUSE CMS may
-    revoke a home infusion therapy enrollment of the: [i supplier accreditation described
-    paragraph) 3) section . ITEM ii does not comply all of the provisions of—'
+  - '[SUBSECTION b] Space rental.. As used in section 1128B of the Act, “remuneration”
+    does not include any payment made by a lessee to a lessor for the use of premises,
+    as long as all of the following six standards are met— [CLAUSE 1] The lease agreement
+    is set out in writing and signed by the parties. [CLAUSE 2] The lease covers all
+    of the premises leased between the parties for the term of the lease and specifies
+    the premises covered by the lease. [CLAUSE 3] If the lease is intended to provide
+    the lessee with access to the premises for periodic intervals of time, rather
+    than on a full-time basis for the term of the lease, the lease specifies exactly
+    the schedule of such intervals, their precise length, and the exact rent for such
+    intervals.'
+  - of the blood or blood product and quarantine all blood and blood components from
+    previous donations in inventory. [ITEM i] If the blood collecting establishment
+    notifies the hospital that the result of the supplemental (additional, more specific)
+    test or other follow-up testing required by FDA is negative, absent other informative
+    test results, the hospital may release the blood and blood components from quarantine.
+    [ITEM ii] If the blood collecting establishment notifies the hospital that the
+    result of the supplemental, (additional, more specific) test or other follow-up
+    testing required by FDA is positive, the hospital must—
+  - '[SUBSECTION d] Each application shall contain a statement that the respirator
+    has been pretested by the applicant as prescribed in § 84.64, and shall include
+    the results of such tests.'
+- source_sentence: '[SUBSECTION b] Security.. A school must require security or endorsement
+    if the borrower is a [MASK] the applicable State law, the note signed by him or
+    her would not create a binding obligation. The school may not require security
+    or endorsement in any other circumstances.'
   sentences:
-  - '[SUBSECTION e] Continued compliance, standards, and reasons for revocation..
-    (1) Upon and after enrollment, a home infusion therapy supplier— [ITEM i] Must
-    remain currently and validly accredited as described in paragraph (c)(3) of this
-    section. [ITEM ii] Remains subject to, and must remain in full compliance with,
-    all of the provisions of— [CLAUSE 2] CMS may revoke a home infusion therapy supplier''s
-    enrollment on any of the following grounds: [ITEM i] The supplier does not meet
-    the accreditation requirements as described in paragraph (c)(3) of this section.
-    [ITEM ii] The supplier does not comply with all of the provisions of—'
-  - '[SUBSECTION B] Activities falling under paragraph (2) of the definition of “health
-    care operations” under 45 C.F.R. 164.501: Reviewing the competence or qualifications
-    of health care professionals, evaluating practitioner and provider performance,
-    health plan performance, conducting training programs in which students, trainees,
-    or practitioners in areas of health care learn under supervision to practice or
-    improve their skills as health care providers, training of non-health care professionals,
-    accreditation, certification, licensing, or credentialing activities.'
-  - '[SECTION HEADING] § 59.1 To what programs do these regulations apply? The regulations
-    of this subpart are applicable to the award of grants under section 1001 of the
-    Public Health Service Act (42 U.S.C. 300) to assist in the establishment and operation
-    of voluntary family planning projects. These projects shall consist of the educational,
-    comprehensive medical, and social services necessary to aid individuals to determine
-    freely the number and spacing of their children.'
-- source_sentence: SUBSECTION] A outlines timing communications, and transition of
-    these clinicians, groups subgroups Entities
+  - '[SUBSECTION b] Security.. A school must require security or endorsement if the
+    borrower is a minor and if, under the applicable State law, the note signed by
+    him or her would not create a binding obligation. The school may not require security
+    or endorsement in any other circumstances.'
+  - '[SUBSECTION b] The minimum flow of air required to maintain a positive pressure
+    in the respiratory-inlet covering throughout the entire breathing cycle will be
+    supplied to the wearer, provided however, that airflow shall not be less than
+    115 liters per minute for tight-fitting and not less than 170 liters per minute
+    for loose-fitting respiratory inlet-coverings.'
+  - '[SUBSECTION a] The following intermediate sanctions may be imposed and will continue
+    in effect until CMS is satisfied that the deficiencies that are the basis for
+    the sanction determination have been corrected and are not likely to recur: [CLAUSE
+    2] Suspension of payment to the MA organization for Medicare beneficiaries enrolled
+    after the date CMS notifies the organization of the intermediate sanction. [CLAUSE
+    3] Suspension of communication activities to Medicare beneficiaries by an MA organization,
+    as defined by CMS.'
+- source_sentence: '[SUBSECTION c] Procedures the State uses to accomplish coordination
+    of CHIP with other public and private health insurance programs, sources of health
+    benefits coverage for children, and relevant child health programs, such as title
+    V, that provide health care services for low-income children. Such procedures
+    include those designed to— [CLAUSE 2] Assist in the enrollment in CHIP of children
+    determined ineligible for Medicaid; and [CLAUSE 3] Ensure coordination with other
+    insurance affordability programs in the [MASK] eligible individuals are enrolled
+    in the appropriate program, including through use of the procedures described
+    in § § 457.305, 457.348 and 457.350 of this part. [CITATIONS]'
   sentences:
-  - '[SUBSECTION f] Prohibition on improper billing of premiums.. Part D plan sponsors
-    shall not bill an enrollee for a premium payment period if the enrollee has had
-    the premium for that period withheld from his or her Social Security, Railroad
-    Retirement Board or Office of Personnel Management check. [CITATIONS]'
-  - '[SUBSECTION D] A detailed timeline that outlines timing for communications, the
-    start of the transition, and completion of the transition of these clinicians,
-    groups, virtual groups, subgroups, or APM Entities.'
-  - '[ITEM i] Ambulance service suppliers. [ITEM ii] Community mental health centers.
-    [ITEM iii] Comprehensive outpatient rehabilitation facilities. [ITEM iv] Independent
-    clinical laboratories. [ITEM v] Independent diagnostic testing facilities. [ITEM
-    vi] Physical therapists enrolling as individuals or as group practices. [ITEM
-    vii] Portable x-ray suppliers. [ITEM viii] Prospective (newly enrolling) and revalidating
-    opioid treatment programs that have been fully and continuously certified by the
-    Substance Abuse and Mental Health Services Administration (SAMHSA) since October
-    23, 2018. [ITEM ix] Revalidating opioid treatment programs that have not been
-    fully and continuously certified by SAMHSA since October 23, 2018, revalidating
-    DMEPOS suppliers, revalidating MDPP'
-- source_sentence: the the monthly provision mental health substance use treatment
-    an IMD meet the requirements for lieu of services at (e 2) () through (iii . For
-    of rate setting of enrollee this section health disorder the but utilization the
-    the same through providers under . CITATIONS
+  - '[SUBSECTION d] Changes in hospitals'' status.. For purposes of exclusion from
+    the prospective payment systems under this subpart, the status of each currently
+    participating hospital (excluded or not excluded) is determined at the beginning
+    of each cost reporting period and is effective for the entire cost reporting period.
+    Any changes in the status of the hospital are made only at the start of a cost
+    reporting period.'
+  - '[SUBSECTION c] Procedures the State uses to accomplish coordination of CHIP with
+    other public and private health insurance programs, sources of health benefits
+    coverage for children, and relevant child health programs, such as title V, that
+    provide health care services for low-income children. Such procedures include
+    those designed to— [CLAUSE 2] Assist in the enrollment in CHIP of children determined
+    ineligible for Medicaid; and [CLAUSE 3] Ensure coordination with other insurance
+    affordability programs in the determination of eligibility and enrollment in coverage
+    to ensure that all eligible individuals are enrolled in the appropriate program,
+    including through use of the procedures described in § § 457.305, 457.348 and
+    457.350 of this part. [CITATIONS]'
+  - '[SECTION HEADING] § 71.41 General provisions. Carriers arriving at a U.S. port
+    from a foreign area shall be subject to a sanitary inspection to determine whether
+    there exists rodent, insect, or other vermin infestation, contaminated food or
+    water, or other insanitary conditions requiring measures for the prevention of
+    the introduction, transmission, or spread of communicable disease.'
+- source_sentence: '[SUBSECTION c] Adjustment for cost reporting period.. (1) If a
+    facility has a cost reporting [MASK] the contractor increases the labor-related
+    and nonlabor-related portions of the prospective payment rate that would otherwise
+    apply to the SNF by an adjustment factor. Each factor represents the projected
+    increase in the market basket index for a specific 12-month period. The factors
+    are used to account for inflation in costs for cost reporting periods beginning
+    after October 1. Adjustment factors are published in the annual notice of prospectively
+    determined payment rates described in § 413.320.'
   sentences:
-  - more than 15 days during the period of the monthly capitation payment. The provision
-    of inpatient mental health or substance use disorder treatment in an IMD must
-    meet the requirements for in lieu of services at § 438.3(e)(2)(i) through (iii).
-    For purposes of rate setting, the State may use the utilization of services provided
-    to an enrollee under this section when developing the inpatient mental health
-    or substance use disorder component of the capitation rate, but must price utilization
-    at the cost of the same services through providers included under the State plan.
-    [CITATIONS]
-  - '[SUBSECTION b] The regulations in this part are applicable to and binding on
-    the Office of Inspector General (OIG) in imposing and proposing exclusions, as
-    well as to Administrative Law Judges (ALJs), the Departmental Appeals Board (DAB),
-    and federal courts in reviewing the imposition of exclusions by the OIG (and,
-    where applicable, in imposing exclusions proposed by the OIG). [CITATIONS]'
-  - '[SUBSECTION c] Keep all loan accounts in good standing, provide timely documentation
-    as needed, including payment verification, service verification, change of research,
-    change of institution, etc. Failure to provide such documentation may result in
-    early termination, and the individual may be subject to statutory financial penalties;
-    and'
-- source_sentence: '[] the ALJ determines that the following [CLAUSE Sends a to parties
-    and of number and deadline for record 2] of any submitted, and the letter described
-    in (d (to contractor 3 CMS or to send a LCD record ALJ parties 30 of ALJ of complaint,
-    extension'
+  - '[SUBSECTION c] Adjustment for cost reporting period.. (1) If a facility has a
+    cost reporting period beginning after the beginning of the Federal fiscal year,
+    the contractor increases the labor-related and nonlabor-related portions of the
+    prospective payment rate that would otherwise apply to the SNF by an adjustment
+    factor. Each factor represents the projected increase in the market basket index
+    for a specific 12-month period. The factors are used to account for inflation
+    in costs for cost reporting periods beginning after October 1. Adjustment factors
+    are published in the annual notice of prospectively determined payment rates described
+    in § 413.320.'
+  - '[SUBSECTION B] QCDR measure considerations for approval include, but are not
+    limited to: [CLAUSE 1] () Measures that are outcome-based rather than clinical
+    process measures. [CLAUSE 3] () Measures that identify appropriate use of diagnosis
+    and therapeutics. [CLAUSE 5] () Measures that address the domain for patient and
+    caregiver experience. [CLAUSE 7] () Beginning with the CY 2021 performance period/2023
+    MIPS payment year - [ITEM i] () That QCDRs link their QCDR measures as feasible
+    to at least one cost measure, improvement activity, or an MVP at the time of self-nomination.
+    [ITEM ii] () In cases where a QCDR measure does not have a clear link to a cost
+    measure, improvement activity, or an MVP, CMS would consider exceptions if the
+    potential QCDR measure otherwise meets the QCDR measure requirements and considerations.'
+  - this section may be considered evidence that the MPPP supplier standards have
+    not been met. This information must be kept at each administrative location and
+    made available to CMS or its contractors upon request.
+- source_sentence: '[SECTION HEADING] § 24.6 Performance appraisal system. The members
+    of the Service shall be subject to a performance appraisal system that is designed
+    to encourage excellence in performance and shall provide for periodic and systematic
+    assessment of the performance of members.'
   sentences:
-  - '[SUBSECTION d] Acceptable complaint.. If the ALJ determines that the complaint
-    (or amended complaint) is acceptable, the ALJ does the following: [CLAUSE 1] Sends
-    a letter to the aggrieved party (or parties) acknowledging the complaint and informing
-    the aggrieved party (or parties) of the docket number and the deadline for the
-    contractor to produce the LCD record. [CLAUSE 2] Forwards a copy of the complaint,
-    any evidence submitted in the complaint, and the letter described in paragraph
-    (d)(1) of this section to the applicable contractor and CMS. [CLAUSE 3] Requires
-    CMS or the contractor to send a copy of the LCD record to the ALJ and all parties
-    to the LCD review within 30 days of receiving the ALJ''s letter, the copy of the
-    complaint, and any associated evidence, subject to extension for good cause shown.'
-  - '[SUBSECTION d] Payment for drugs and biologicals.. Drugs and biologicals that
-    are CORF services under § 410.100(j) of this chapter, are paid the lesser of 80
-    percent of the following: [CLAUSE 1] The actual charge for the service provided
-    that payment for such item is not included in the payment amount for other CORF
-    services paid under paragraphs (a) or (c); or [ENUM drug] (2) The amount determined
-    using the same methodology for drugs (as defined in § 414.704 of this chapter)
-    described in section 1842(o)(1) of the Act provided that payment for such is not
-    included in the payment amount for other CORF services paid under paragraphs (a)
-    or (c).'
-  - '[SUBSECTION a] Basis and purpose.. This section implements section 1902(a)(24)
-    of the Act, which requires that the State plan provide for consultative services
-    by State agencies to certain institutions furnishing Medicaid services.'
+  - '[SECTION HEADING] § 24.6 Performance appraisal system. The members of the Service
+    shall be subject to a performance appraisal system that is designed to encourage
+    excellence in performance and shall provide for periodic and systematic assessment
+    of the performance of members.'
+  - '[SUBSECTION g] Under the terms of the contract, the approved CAP vendor must
+    provide assistance to beneficiaries experiencing financial difficulty in paying
+    their cost-sharing amounts through any one or all of the following:'
+  - '[SUBSECTION a] General rules.. (1) An HMO or CMP that has an APCRP (as determined
+    under § 417.590) greater than its ACR (as determined under § 417.594) must elect
+    one of the options specified in paragraph (b) of this section. [CLAUSE 2] The
+    dollar value of the elected option must, over the course of a contract period,
+    be at least equal to the difference between the APCRP and the proposed ACR.'
 pipeline_tag: sentence-similarity
 library_name: sentence-transformers
 ---
@@ -184,9 +192,9 @@ from sentence_transformers import SentenceTransformer
 model = SentenceTransformer("sentence_transformers_model_id")
 # Run inference
 sentences = [
-    '[] the ALJ determines that the following [CLAUSE Sends a to parties and of number and deadline for record 2] of any submitted, and the letter described in (d (to contractor 3 CMS or to send a LCD record ALJ parties 30 of ALJ of complaint, extension',
-    "[SUBSECTION d] Acceptable complaint.. If the ALJ determines that the complaint (or amended complaint) is acceptable, the ALJ does the following: [CLAUSE 1] Sends a letter to the aggrieved party (or parties) acknowledging the complaint and informing the aggrieved party (or parties) of the docket number and the deadline for the contractor to produce the LCD record. [CLAUSE 2] Forwards a copy of the complaint, any evidence submitted in the complaint, and the letter described in paragraph (d)(1) of this section to the applicable contractor and CMS. [CLAUSE 3] Requires CMS or the contractor to send a copy of the LCD record to the ALJ and all parties to the LCD review within 30 days of receiving the ALJ's letter, the copy of the complaint, and any associated evidence, subject to extension for good cause shown.",
-    '[SUBSECTION a] Basis and purpose.. This section implements section 1902(a)(24) of the Act, which requires that the State plan provide for consultative services by State agencies to certain institutions furnishing Medicaid services.',
+    '[SECTION HEADING] § 24.6 Performance appraisal system. The members of the Service shall be subject to a performance appraisal system that is designed to encourage excellence in performance and shall provide for periodic and systematic assessment of the performance of members.',
+    '[SECTION HEADING] § 24.6 Performance appraisal system. The members of the Service shall be subject to a performance appraisal system that is designed to encourage excellence in performance and shall provide for periodic and systematic assessment of the performance of members.',
+    '[SUBSECTION a] General rules.. (1) An HMO or CMP that has an APCRP (as determined under § 417.590) greater than its ACR (as determined under § 417.594) must elect one of the options specified in paragraph (b) of this section. [CLAUSE 2] The dollar value of the elected option must, over the course of a contract period, be at least equal to the difference between the APCRP and the proposed ACR.',
 ]
 embeddings = model.encode(sentences)
 print(embeddings.shape)
@@ -195,9 +203,9 @@ print(embeddings.shape)
 # Get the similarity scores for the embeddings
 similarities = model.similarity(embeddings, embeddings)
 print(similarities)
-# tensor([[1.0000, 0.9850, 0.8258],
-#         [0.9850, 1.0000, 0.8203],
-#         [0.8258, 0.8203, 1.0000]])
+# tensor([[1.0000, 1.0000, 0.6782],
+#         [1.0000, 1.0000, 0.6782],
+#         [0.6782, 0.6782, 1.0000]])
 ```
 
 <!--
@@ -242,27 +250,26 @@ You can finetune this model on your own dataset.
 
 #### Unnamed Dataset
 
-* Size: 24,888 training samples
+* Size: 24,880 training samples
 * Columns: <code>sentence_0</code> and <code>sentence_1</code>
 * Approximate statistics based on the first 1000 samples:
-  |         | sentence_0                                                                          | sentence_1                                                                          |
-  |:--------|:------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
-  | type    | string                                                                              | string                                                                              |
-  | details | <ul><li>min: 11 tokens</li><li>mean: 45.55 tokens</li><li>max: 132 tokens</li></ul> | <ul><li>min: 37 tokens</li><li>mean: 111.1 tokens</li><li>max: 291 tokens</li></ul> |
+  |         | sentence_0                                                                           | sentence_1                                                                           |
+  |:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                               |
+  | details | <ul><li>min: 35 tokens</li><li>mean: 105.52 tokens</li><li>max: 335 tokens</li></ul> | <ul><li>min: 37 tokens</li><li>mean: 112.72 tokens</li><li>max: 335 tokens</li></ul> |
 * Samples:
-  | sentence_0                                                                                                                                                                                                                                                                                                                                          | sentence_1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
-  |:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
-  | <code>SUBSECTION b qualifying MA organization qualifying MA an equivalent under of this part CLAUSE MA must 2 months of the of annual to services that be covered as professional B received EP for enrollees plans of MA [] the MA organization for each qualifying EP an amount of the (() of the under o (1 () of.</code>                        | <code>[SUBSECTION b] Amount payable to qualifying MA organization for qualifying MA EPs.. (1) CMS substitutes an amount determined to be equivalent to the amount computed under § 495.102 of this part. [CLAUSE 2] The qualifying MA organization must report to CMS within 2 months of the close of the calendar year, the aggregate annual amount of revenue attributable to providing services that would otherwise be covered as professional services under Part B received by each qualifying MA EP for enrollees in MA plans of the MA organization in the payment year. [CLAUSE 3] CMS calculates the incentive amount for the MA organization for each qualifying MA EP as an amount equal to 75 percent of the reported annual revenue specified in paragraph (b)(2) of this section, up to the maximum amounts specified under section 1848(o)(1)(B) of the Act.</code> |
-  | <code>(assurance that the, protects underutilization,, including measurable appropriate; [CLAUSE 5) Protection from other than and and [CLAUSE 6 Federal care program beneficiaries than other because of their Federal care program beneficiaries [() than 10 Medicare beneficiaries, not for whom a Federal program is the secondary payer</code> | <code>[CLAUSE 3] () A quality assurance program that promotes the coordination of care, protects against underutilization, and specifies patient goals, including measurable outcomes where appropriate; [CLAUSE 5] () Protection of enrollees from incurring financial liability other than copayments and deductibles; and [CLAUSE 6] () Treatment for Federal health care program beneficiaries that is not different than treatment for other enrollees because of their status as Federal health care program beneficiaries; and [CLAUSE 1] () No more than 10 percent are Medicare beneficiaries, not including persons for whom a Federal health care program is the secondary payer; or</code>                                                                                                                                                                              |
-  | <code>is Prescription Plan] A brief the iii] A about the can be .] program participation payment received the, amount last and of by participant . balance from prior including any missed payments . vii] Itemized by for the being billed [viii The from</code>                                                                                   | <code>[ITEM i] A statement that the bill is for the Medicare Prescription Payment Plan. [ITEM ii] A brief description of the program. [ITEM iii] A reference to where additional information about the program can be found. [ITEM iv] The effective date of program participation. [ITEM v] The last payment received, showing the date, amount of the last payment, and the means of payment made by the participant. [ITEM vi] Any balance carried over from the prior month, including any missed payments. [ITEM vii] Itemized out-of-pocket costs by prescription for the month being billed. [ITEM viii] The amount due from the</code>                                                                                                                                                                                                                                      |
+  | sentence_0                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            | sentence_1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        |
+  |:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>[ITEM i] The name and TIN of the CJR collaborator and the name, TIN, and NPI of the collaboration agent. [ITEM ii] The start date and, if applicable, end date, for the distribution arrangement between the CJR collaborator and the collaboration agent. [ENUM Downstream collaboration agents.] (3) For each physician, nonphysician practitioner, or therapist who is a downstream collaboration agent during the period of the CJR performance year specified by CMS— [ITEM i] The name and TIN of the CJR collaborator and the [MASK] TIN, and NPI of the downstream collaboration</code>                                                 | <code>[ITEM i] The name and TIN of the CJR collaborator and the name, TIN, and NPI of the collaboration agent. [ITEM ii] The start date and, if applicable, end date, for the distribution arrangement between the CJR collaborator and the collaboration agent. [ENUM Downstream collaboration agents.] (3) For each physician, nonphysician practitioner, or therapist who is a downstream collaboration agent during the period of the CJR performance year specified by CMS— [ITEM i] The name and TIN of the CJR collaborator and the name and TIN of the collaboration agent and the name, TIN, and NPI of the downstream collaboration</code>                                              |
+  | <code>[SUBSECTION a] Termination of agreements.. (1) CMS may terminate any approved agreement if it finds, after the procedures described in this paragraph are followed that the State system does not satisfactorily meet the requirements of section 1886(c) of the Act or the regulations in this subpart. A termination must be effective on the last day of a calendar quarter. [CLAUSE 2] CMS will give the State reasonable notice of the proposed termination of an agreement [MASK] days before the effective date of the termination. [CLAUSE 3] CMS will give the State the opportunity to present evidence to refute the finding.</code> | <code>[SUBSECTION a] Termination of agreements.. (1) CMS may terminate any approved agreement if it finds, after the procedures described in this paragraph are followed that the State system does not satisfactorily meet the requirements of section 1886(c) of the Act or the regulations in this subpart. A termination must be effective on the last day of a calendar quarter. [CLAUSE 2] CMS will give the State reasonable notice of the proposed termination of an agreement and of the reasons for the termination at least 90 days before the effective date of the termination. [CLAUSE 3] CMS will give the State the opportunity to present evidence to refute the finding.</code> |
+  | <code>[CLAUSE 4] The amount of the post-TDAPA add-on payment adjustment is equal to 65 percent of the amount calculated in paragraph (g)(2) of this section, multiplied by the reduction factor specified in paragraph (g)(3) of this section, and multiplied by the latest available forecast of annual growth in the ESRD bundled market basket composite price proxy for pharmaceuticals. [CLAUSE 5] The post-TDAPA [MASK] ESRD PPS claim is adjsuted by any applicable patient-level case-mix adjustments under § 413.235. [CITATIONS]</code>                                                                                                     | <code>[CLAUSE 4] The amount of the post-TDAPA add-on payment adjustment is equal to 65 percent of the amount calculated in paragraph (g)(2) of this section, multiplied by the reduction factor specified in paragraph (g)(3) of this section, and multiplied by the latest available forecast of annual growth in the ESRD bundled market basket composite price proxy for pharmaceuticals. [CLAUSE 5] The post-TDAPA add-on payment adjustment that is applied to an ESRD PPS claim is adjsuted by any applicable patient-level case-mix adjustments under § 413.235. [CITATIONS]</code>                                                                                                        |
 * Loss: [<code>DenoisingAutoEncoderLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#denoisingautoencoderloss)
 
 ### Training Hyperparameters
 #### Non-Default Hyperparameters
 
-- `per_device_train_batch_size`: 24
-- `per_device_eval_batch_size`: 24
-- `num_train_epochs`: 2
+- `per_device_train_batch_size`: 16
+- `per_device_eval_batch_size`: 16
 - `multi_dataset_batch_sampler`: round_robin
 
 #### All Hyperparameters
@@ -272,8 +279,8 @@ You can finetune this model on your own dataset.
 - `do_predict`: False
 - `eval_strategy`: no
 - `prediction_loss_only`: True
-- `per_device_train_batch_size`: 24
-- `per_device_eval_batch_size`: 24
+- `per_device_train_batch_size`: 16
+- `per_device_eval_batch_size`: 16
 - `per_gpu_train_batch_size`: None
 - `per_gpu_eval_batch_size`: None
 - `gradient_accumulation_steps`: 1
@@ -285,7 +292,7 @@ You can finetune this model on your own dataset.
 - `adam_beta2`: 0.999
 - `adam_epsilon`: 1e-08
 - `max_grad_norm`: 1
-- `num_train_epochs`: 2
+- `num_train_epochs`: 3
 - `max_steps`: -1
 - `lr_scheduler_type`: linear
 - `lr_scheduler_kwargs`: {}
@@ -392,10 +399,15 @@ You can finetune this model on your own dataset.
 ### Training Logs
 | Epoch  | Step | Training Loss |
 |:------:|:----:|:-------------:|
-| 0.4822 | 500  | 5.8369        |
-| 0.9643 | 1000 | 4.2938        |
-| 1.4465 | 1500 | 3.7972        |
-| 1.9286 | 2000 | 3.5272        |
+| 0.3215 | 500  | 5.7169        |
+| 0.6431 | 1000 | 4.3196        |
+| 0.9646 | 1500 | 3.8613        |
+| 1.2862 | 2000 | 3.5443        |
+| 1.6077 | 2500 | 3.357         |
+| 1.9293 | 3000 | 3.2075        |
+| 2.2508 | 3500 | 3.0466        |
+| 2.5723 | 4000 | 2.9261        |
+| 2.8939 | 4500 | 2.8525        |
 
 
 ### Framework Versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:671ffbf4f6f6d7a90128b2a446bbd37102ea2bed4d3beb454887da86e5eceae3
+oid sha256:f6ec979ed0a5f997c093a4486ae7cb95684d851792e427c26d525954b520a966
 size 437951328