Add new SentenceTransformer model

1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+    "word_embedding_dimension": 768,
+    "pooling_mode_cls_token": false,
+    "pooling_mode_mean_tokens": true,
+    "pooling_mode_max_tokens": false,
+    "pooling_mode_mean_sqrt_len_tokens": false,
+    "pooling_mode_weightedmean_tokens": false,
+    "pooling_mode_lasttoken": false,
+    "include_prompt": true
+}

README.md

@@ -0,0 +1,590 @@
+---
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- dense
+- generated_from_trainer
+- dataset_size:3016
+- loss:MultipleNegativesRankingLoss
+base_model: nomic-ai/modernbert-embed-base
+widget:
+- source_sentence: The Market and Liquidity Risk Analyst is responsible for conducting
+    routine identification, measurement, mitigation, monitoring, and reporting of
+    market and liquidity risks. He/She also conducts independent analyses to provide
+    greater insight into risk exposures and mitigation efforts within market and liquidity
+    risk scenarios. He actively supports the compliance of regulatory requirements
+    relating to market and liquidity risk management in order to ensure the financial
+    health of the organisation. The Market and Liquidity Risk Analyst's duties may
+    require him to be contactable after office hours. He is well-versed with financial
+    risks relating to the organisation and products. He possesses strong analytical
+    and practical abilities in applying various methodologies to identify and analyse
+    risks. He is a strong communicator, works well in teams, and is self-motivated
+    in achieving individual and organisational goals.
+  sentences:
+  - The Underwriting Manager leads the underwriting team by providing strategic direction
+    and oversight. This role involves thoroughly evaluating insurance applications
+    from potential clients, analyzing associated risks, and making informed underwriting
+    decisions in line with company policies. The manager monitors team performance
+    to ensure timely case processing and high customer satisfaction. Collaborating
+    closely with customer service teams, the Underwriting Manager facilitates clear
+    communication regarding underwriting procedures and business rules. Responsibilities
+    also include managing relationships with intermediaries, in-house underwriters,
+    and external clients within a fast-paced environment. The ideal candidate demonstrates
+    strong analytical and numerical proficiency, is adept with risk evaluation tools,
+    and effectively communicates complex information to diverse stakeholders. Sound
+    judgment and logical thinking are essential for driving effective decision-making
+    in this role.
+  - The Market and Liquidity Risk Manager oversees the strategic direction and governance
+    of market and liquidity risk frameworks, leading a team responsible for risk identification,
+    measurement, and mitigation. This senior role involves setting policies, managing
+    escalations, and liaising with regulatory bodies to ensure compliance with evolving
+    risk management standards across multiple jurisdictions. The manager is accountable
+    for high-level decision making and resource allocation, requiring extensive experience
+    and leadership skills. The position demands proactive communication with executive
+    leadership and may involve international travel to coordinate risk activities
+    across global offices.
+  - The Market and Liquidity Risk Analyst is tasked with the ongoing identification,
+    assessment, control, and reporting of market and liquidity risks. This role involves
+    performing independent evaluations to deepen understanding of risk exposures and
+    the effectiveness of mitigation strategies within market and liquidity contexts.
+    The analyst ensures adherence to regulatory standards related to market and liquidity
+    risk management to safeguard the organisation’s financial stability. Availability
+    beyond standard working hours may be required. The ideal candidate has comprehensive
+    knowledge of financial risks associated with the company and its products, demonstrates
+    strong analytical skills in applying risk assessment techniques, communicates
+    effectively, collaborates efficiently within teams, and is driven to meet both
+    personal and corporate objectives.
+- source_sentence: A Senior Pharmacy Technician Executive in the Patient Care Services
+    sub-track is responsible for co-managing dispensing errors, performing medication
+    management and providing patient education. S/He reviews day-to-day operations
+    of department-based functions to maximise service provision. S/He is required
+    to develop and review training curriculum, plans and materials. S/He works in
+    various settings such as hospitals, outpatient clinics, polyclinics and retail
+    pharmacies. S/He should be proactive and conscientious. S/He should possess effective
+    interpersonal, leadership and problem-solving skills.
+  sentences:
+  - The Senior Pharmacy Technician Executive plays a key role in overseeing medication
+    dispensing accuracy, managing pharmaceutical care, and educating patients within
+    the Patient Care Services domain. This position involves supervising daily departmental
+    activities to enhance service delivery and contributing to the design and evaluation
+    of training programs and materials. Operating across diverse healthcare environments
+    including hospitals, outpatient clinics, polyclinics, and retail pharmacies, the
+    role demands a proactive and diligent professional equipped with strong leadership,
+    communication, and analytical problem-solving skills.
+  - The Senior Pharmacy Technician Executive is responsible for managing the procurement
+    and inventory control of pharmaceutical supplies within hospital logistics. This
+    role focuses on coordinating supply chain activities, ensuring timely stock replenishment,
+    and maintaining vendor relationships rather than direct patient care or medication
+    dispensing. It requires expertise in inventory management systems, negotiation
+    skills, and operational planning, and is typically performed in warehouse or supply
+    management settings rather than clinical environments.
+  - The Senior Technician (Mechanical and Electrical) is responsible for conducting
+    both preventive and corrective maintenance on mechanical and electrical equipment.
+    This role demands strong technical expertise and hands-on skills in managing diverse
+    mechanical and electrical systems. Key responsibilities include diagnosing system
+    faults, delivering technical support and mentorship to junior technicians, and
+    overseeing contractors and external parties to ensure adherence to safety protocols
+    and operational standards. The technician operates in shifts and performs tasks
+    across multiple rail facilities, including workshops and train stations. Effective
+    teamwork and clear communication are essential to facilitate maintenance operations.
+- source_sentence: The Engineer (Engineering Procurement) is responsible for conducting
+    procurement activities to support engineering projects. He/She is responsible
+    for developing sourcing proposals and conducting vendor pre-qualification and
+    assessment. He typically has an engineering background and is able to translate
+    project requirements into specifications for materials, equipment and services
+    to procure. He manages a team of officers and contributes to the improvement of
+    business operations. He is comfortable in engaging and interacting with vendors
+    and other external parties to fulfil his responsibilities in coordinating vendor
+    selection processes, maintaining vendor contract records and databases, and following
+    up on vendors' deliverables.
+  sentences:
+  - The Engineer (Quality Assurance) is tasked with developing and implementing quality
+    control protocols across engineering projects. This role requires expertise in
+    defining quality standards, conducting product inspections, and ensuring compliance
+    with industry regulations. The engineer supervises a team focused on testing procedures
+    and corrective actions, collaborating closely with production units to maintain
+    high-quality outputs. Vendor interactions are limited to ensuring product conformity
+    rather than procurement activities.
+  - The Executive - On-Demand Media Technology and Operations is responsible for managing
+    the organisation’s content distribution across various on-demand media platforms.
+    This role involves handling key processes such as content ingestion, encoding,
+    transcoding, and performing rigorous quality assurance to ensure adherence to
+    the company’s technical guidelines. The executive develops and implements media
+    software solutions tailored to streamline media workflows and satisfy customer
+    delivery expectations. Additionally, they architect, deploy, and manage content
+    delivery networks (CDNs) to guarantee seamless content access for viewers. Their
+    duties encompass the full cycle of on-demand media operations from design through
+    to maintenance. A strong focus on innovation, process optimization, and effective
+    collaboration with cross-functional teams is essential for success in this position.
+  - The Engineer (Engineering Procurement) oversees procurement processes essential
+    to engineering initiatives. This role involves creating sourcing strategies, evaluating
+    and pre-qualifying suppliers, and translating engineering needs into detailed
+    specifications for purchasing materials, equipment, and services. The engineer
+    leads a group of officers and actively supports operational enhancements. Strong
+    vendor relationship management and coordination of supplier selection, contract
+    documentation, and deliverable tracking are key aspects of this position.
+- source_sentence: The Civil and Structural Engineer manages planning and development
+    of projects. He/She develops engineering designs based on project requirements,
+    from conceptual to schematic and detailed designs. He conducts project assessments
+    and is able to provide feasible and creative solutions based on the assessment
+    results. He participates in the tendering processes and monitors the work of contractors
+    and subcontractors. He plans the team's manpower allocation and provides on-the-job
+    coaching to junior staff. He is meticulous and highly detail-orientated. He is
+    well versed in civil and structural engineering practices. He is analytical, has
+    excellent problem-solving skills, and also possesses strong interpersonal skills
+    essential for engagement with internal and external stakeholders. He is required
+    to work both in office and at project sites.
+  sentences:
+  - The Civil and Structural Engineer leads the financial auditing processes within
+    a construction firm, focusing on budget compliance and cost-saving strategies.
+    They review accounting records, prepare financial reports, and ensure adherence
+    to corporate financial policies. The engineer supervises the auditing team, provides
+    training on auditing standards, and liaises with external auditors. Strong knowledge
+    of accounting principles, financial regulations, and audit software is essential.
+    This role demands meticulous attention to financial details, analytical skills
+    for detecting discrepancies, and the ability to communicate effectively with finance
+    and project management departments. Work is primarily conducted in an office environment
+    with occasional visits to project sites for financial inspections.
+  - The Design Project Manager oversees the planning and execution of design initiatives,
+    coordinating project schedules and activities with relevant stakeholders. They
+    manage scope adjustments, address challenges, and mitigate risks that could affect
+    project delivery. In their leadership role, they allocate personnel and resources
+    effectively across projects and mentor team members to enhance their capabilities.
+    The Design Project Manager directs a team towards achieving project goals, often
+    engaging in extensive stakeholder communication, reviewing deliverables, and offering
+    strategic guidance. Strong organizational skills and task prioritization are essential,
+    alongside a thorough understanding of quality assurance processes to ensure optimal
+    product performance.
+  - The Civil and Structural Engineer oversees the planning and execution of engineering
+    projects, creating designs that meet specific project criteria from initial concept
+    through detailed development. They perform thorough project evaluations and propose
+    innovative, practical solutions based on these analyses. The engineer is actively
+    involved in the tendering process and supervises contractors and subcontractors
+    to ensure compliance and quality. Additionally, they manage team resource allocation
+    and mentor junior engineers, demonstrating a strong attention to detail and in-depth
+    knowledge of civil and structural engineering principles. Excellent analytical
+    thinking, problem-solving abilities, and interpersonal communication skills are
+    vital for effective collaboration with both internal teams and external partners.
+    This role requires working in both office settings and on-site project locations.
+- source_sentence: The Sales Account Manager acts as a key point of contact between
+    an organisation and its clients. He/She possesses thorough product knowledge and
+    oversees product and/or service sales. He works with customers to identify their
+    wants and prepares reports by collecting, analysing, and summarising sales information.
+    He contacts existing customers to discuss and give recommendations on how specific
+    products or services can meet their needs. He maintains customer relationships
+    to strategically place new products and drive sales for long-term growth. He works
+    in a fast-paced and dynamic environment, and travels frequently to clients' premises
+    for meetings. He is familiar with client relationship management and sales tools.
+    He is knowledgeable of the organisation's products and services, as well as trends,
+    developments and challenges of the industry domain. The Sales Account Manager
+    is a resourceful, people-focused and persistent individual, who takes rejection
+    as a personal challenge to succeed when given opportunity. He appreciates the
+    value of long lasting relationships and prioritises efforts to build trust with
+    existing and potential customers. He exhibits good listening skills and is able
+    to establish rapport with customers and team members alike easily.
+  sentences:
+  - The Centre Leader is responsible for shaping strategic initiatives and organizational
+    frameworks that promote a supportive and trust-based environment, encouraging
+    mentorship, teamwork, and ongoing professional growth within the Centre. This
+    role oversees the effective management and improvement of Centre functions in
+    compliance with relevant industry standards. The Centre Leader champions operational
+    and programmatic quality by establishing robust procedures across key domains
+    such as governance, stakeholder engagement, continuous learning, curriculum design,
+    and teaching methodologies. With excellent communication and influential leadership,
+    they build lasting partnerships and embody the Centre’s core mission, vision,
+    and values, while ensuring the welfare of all personnel.
+  - The Sales Account Manager serves as the primary liaison between the company and
+    its clientele, leveraging deep product expertise to drive sales of products and
+    services. This role involves collaborating closely with customers to understand
+    their requirements, preparing detailed sales reports through data collection and
+    analysis, and proactively reaching out to current clients to offer tailored recommendations.
+    The Sales Account Manager nurtures client relationships with the objective of
+    introducing new products and fostering sustainable revenue growth. Operating in
+    a dynamic and fast-moving setting, frequent travel to client locations is expected.
+    Proficiency in customer relationship management software and sales platforms is
+    essential. In addition to comprehensive knowledge of the company’s offerings,
+    the individual stays informed of industry trends and challenges. The Sales Account
+    Manager demonstrates resilience, strong interpersonal skills, and a commitment
+    to building trust through attentive listening and relationship cultivation.
+  - The Sales Account Manager leads a team responsible for developing marketing strategies
+    and overseeing brand promotion within the organisation. He/She designs campaigns
+    to increase product awareness, coordinates with advertising agencies, and manages
+    digital content creation to enhance market presence. The role requires supervising
+    junior marketing staff, setting performance targets, and analysing campaign metrics
+    to adjust marketing approaches. The Sales Account Manager operates primarily from
+    the office, with limited travel obligations, and collaborates closely with the
+    product development team to align messaging. Strong skills in marketing analytics,
+    campaign management tools, and creative communication are essential. This role
+    focuses on strategic branding and promotional activities rather than direct client
+    sales or relationship management.
+datasets:
+- dnth/ssf-train-valid-v3
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+---
+
+# SentenceTransformer based on nomic-ai/modernbert-embed-base
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base) on the [ssf-train-valid-v3](https://huggingface.co/datasets/dnth/ssf-train-valid-v3) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base) <!-- at revision d556a88e332558790b210f7bdbe87da2fa94a8d8 -->
+- **Maximum Sequence Length:** 8192 tokens
+- **Output Dimensionality:** 768 dimensions
+- **Similarity Function:** Cosine Similarity
+- **Training Dataset:**
+    - [ssf-train-valid-v3](https://huggingface.co/datasets/dnth/ssf-train-valid-v3)
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
+  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("Fatini/ssf-retriever-modernbert-embed-base-attempt1")
+# Run inference
+sentences = [
+    "The Sales Account Manager acts as a key point of contact between an organisation and its clients. He/She possesses thorough product knowledge and oversees product and/or service sales. He works with customers to identify their wants and prepares reports by collecting, analysing, and summarising sales information. He contacts existing customers to discuss and give recommendations on how specific products or services can meet their needs. He maintains customer relationships to strategically place new products and drive sales for long-term growth. He works in a fast-paced and dynamic environment, and travels frequently to clients' premises for meetings. He is familiar with client relationship management and sales tools. He is knowledgeable of the organisation's products and services, as well as trends, developments and challenges of the industry domain. The Sales Account Manager is a resourceful, people-focused and persistent individual, who takes rejection as a personal challenge to succeed when given opportunity. He appreciates the value of long lasting relationships and prioritises efforts to build trust with existing and potential customers. He exhibits good listening skills and is able to establish rapport with customers and team members alike easily.",
+    'The Sales Account Manager serves as the primary liaison between the company and its clientele, leveraging deep product expertise to drive sales of products and services. This role involves collaborating closely with customers to understand their requirements, preparing detailed sales reports through data collection and analysis, and proactively reaching out to current clients to offer tailored recommendations. The Sales Account Manager nurtures client relationships with the objective of introducing new products and fostering sustainable revenue growth. Operating in a dynamic and fast-moving setting, frequent travel to client locations is expected. Proficiency in customer relationship management software and sales platforms is essential. In addition to comprehensive knowledge of the company’s offerings, the individual stays informed of industry trends and challenges. The Sales Account Manager demonstrates resilience, strong interpersonal skills, and a commitment to building trust through attentive listening and relationship cultivation.',
+    'The Sales Account Manager leads a team responsible for developing marketing strategies and overseeing brand promotion within the organisation. He/She designs campaigns to increase product awareness, coordinates with advertising agencies, and manages digital content creation to enhance market presence. The role requires supervising junior marketing staff, setting performance targets, and analysing campaign metrics to adjust marketing approaches. The Sales Account Manager operates primarily from the office, with limited travel obligations, and collaborates closely with the product development team to align messaging. Strong skills in marketing analytics, campaign management tools, and creative communication are essential. This role focuses on strategic branding and promotional activities rather than direct client sales or relationship management.',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 768]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities)
+# tensor([[1.0000, 0.9011, 0.5820],
+#         [0.9011, 1.0000, 0.6250],
+#         [0.5820, 0.6250, 1.0000]])
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### ssf-train-valid-v3
+
+* Dataset: [ssf-train-valid-v3](https://huggingface.co/datasets/dnth/ssf-train-valid-v3) at [f461fff](https://huggingface.co/datasets/dnth/ssf-train-valid-v3/tree/f461fffdfdab1358c6d34b5ed221db30c7444744)
+* Size: 3,016 training samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | anchor                                                                               | positive                                                                             | negative                                                                            |
+  |:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                               | string                                                                              |
+  | details | <ul><li>min: 57 tokens</li><li>mean: 169.03 tokens</li><li>max: 403 tokens</li></ul> | <ul><li>min: 55 tokens</li><li>mean: 138.39 tokens</li><li>max: 275 tokens</li></ul> | <ul><li>min: 37 tokens</li><li>mean: 109.4 tokens</li><li>max: 201 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The Marketing Director drives the organisations business strategy by establishing the organisation's integrated marketing communications (IMC) strategy, partnership marketing arrangements and advices on product development and enhancement. He/She provides senior management with marketing advise, develops budget and manpower plans; and focuses on executing the IMC and partnership marketing plans to achieve business results. He directs the research and data analytics to obtain market and client insights, translates client insights into products and product features with market interest or potential market demand. He operates in a rapidly transforming business environment and functions through his understanding of consumers insights, market trends and industry landscape to promote the organisation and increase market demand. He is a results-oriented, astute leader who is able to negotiate strategically. He possesses strong business acumen and broad understanding of consumer, market and in...</code> | <code>The Marketing Director spearheads the company’s business growth by formulating and implementing a comprehensive integrated marketing communications (IMC) strategy and fostering strategic partnerships. This role advises senior leadership on marketing initiatives, oversees budget allocation and manpower planning, and ensures the successful execution of IMC and partnership campaigns to meet business objectives. The Marketing Director leads market research and data analysis efforts to capture consumer and market insights, translating these findings into innovative product developments aligned with emerging market demands. Operating within a dynamic and evolving business landscape, the director leverages deep knowledge of consumer behavior, market trends, and the competitive environment to enhance brand presence and drive demand. A decisive and visionary leader, this individual excels in strategic negotiations, demonstrates strong commercial insight, and inspires teams with a customer-centr...</code> | <code>The Marketing Analyst directs the organisation’s market research functions by designing and implementing data collection frameworks, analysing consumer data, and supporting the development of targeted marketing campaigns. He/She collaborates with product teams to provide data-driven recommendations for product positioning and pricing strategies. Responsible for preparing detailed reports and presentations for marketing managers, the analyst works under close supervision and focuses on executing market segmentation and consumer behavior studies. This role operates in a structured environment, requiring proficiency in data analytics tools and an understanding of marketing metrics to support decision-making. The Marketing Analyst is a detail-oriented individual with strong quantitative skills and the ability to communicate insights to internal teams but does not hold strategic leadership responsibilities or negotiate external partnerships.</code> |
+  | <code>An Enrolled Nurse is responsible for providing basic nursing care and patient education under the supervision and direction of a registered nurse, in collaboration with the healthcare teams according to the established policies, procedures and guidelines. S/He attends relevant nursing training to ensure that her/his skills remain up-to-date to provide patients with quality nursing care. S/He coaches new enrolled nurses, students and support care staff. S/He operates in a wide variety of settings such as acute care, primary care, community hospitals, integrated care and long-term care facilities. S/He should be meticulous, accountable and a team player.</code>                                                                                                                                                                                                                                                                                                                                                        | <code>The Enrolled Nurse delivers fundamental nursing care and patient education while working under the guidance of a registered nurse and collaborating with multidisciplinary healthcare teams in accordance with established protocols and guidelines. This role involves participating in ongoing nursing training to maintain current competencies and ensure high-quality patient care. Additionally, the Enrolled Nurse mentors newly recruited enrolled nurses, nursing students, and support care personnel. The position operates across diverse healthcare environments, including acute hospitals, primary care centers, community hospitals, integrated care networks, and long-term care institutions. Candidates should demonstrate thoroughness, responsibility, and strong teamwork skills.</code>                                                                                                                                                                                                                                     | <code>The Enrolled Nurse manages patient admission processes and medical records under the supervision of healthcare administrators, coordinating with hospital support services according to institutional policies and administrative guidelines. The role requires attending workshops on healthcare administration to keep skills current and providing training to new administrative staff and interns. This position functions primarily within hospital admissions, billing departments, outpatient clinics, and medical records offices. Attention to detail, accountability, and effective collaboration are essential for success.</code>                                                                                                                                                                                                                                                                                                                                                |
+  | <code>The Depot Train Controller directs the movement of trains within the depot, including launching and withdrawing trains in accordance with train service standards and requirements, and facilitating the stabling of trains in the depot for service and maintenance works. He/She coordinates with relevant internal and external stakeholders to execute first-line recovery of trains during train service disruptions. He is organised, meticulous, and systematic in managing the movement and stabling of trains, and in coordinating track access, so as to ensure the highest safety standards for personnel and train movement are upheld in the depot premises.</code>                                                                                                                                                                                                                                                                                                                                                                   | <code>The Depot Train Controller oversees the scheduling and movement of trains within the depot, managing the deployment and withdrawal of trains following operational standards and service protocols. This role involves collaborating with various internal teams and external partners to facilitate initial recovery actions during service interruptions. The controller must be detail-oriented, methodical, and well-organized when handling train positioning and track allocation to maintain strict safety compliance for both staff and train operations within the depot.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                          | <code>The Depot Maintenance Planner coordinates the scheduling of routine and emergency maintenance activities for trains across the network, ensuring maintenance tasks align with safety regulations and service availability. This role requires liaising with engineering teams and suppliers to optimize resource allocation and minimize downtime. The planner must be proactive, analytical, and adept at balancing maintenance priorities while adhering to compliance standards for depot facilities.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim",
+      "gather_across_devices": false
+  }
+  ```
+
+### Evaluation Dataset
+
+#### ssf-train-valid-v3
+
+* Dataset: [ssf-train-valid-v3](https://huggingface.co/datasets/dnth/ssf-train-valid-v3) at [f461fff](https://huggingface.co/datasets/dnth/ssf-train-valid-v3/tree/f461fffdfdab1358c6d34b5ed221db30c7444744)
+* Size: 754 evaluation samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 754 samples:
+  |         | anchor                                                                               | positive                                                                             | negative                                                                             |
+  |:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                               | string                                                                               |
+  | details | <ul><li>min: 57 tokens</li><li>mean: 169.99 tokens</li><li>max: 352 tokens</li></ul> | <ul><li>min: 59 tokens</li><li>mean: 138.43 tokens</li><li>max: 285 tokens</li></ul> | <ul><li>min: 34 tokens</li><li>mean: 109.81 tokens</li><li>max: 274 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The Quality Control Laboratory Analyst/Chemist/Microbiologist monitors sampling, cleanliness and product quality testing activities, performs non-standard quality tests, and manages associated documentation and data. He/She identifies the operating criteria for the tools, equipment and materials to be used, and collaborates with the Engineering and Maintenance department to ensure that laboratory equipment and infrastructure function as required. In addition, he/ implements Standard Operating Procedures (SOPs) and workflow improvements in the laboratory. The Quality Control Laboratory Analyst/Chemist/Microbiologist works in a laboratory setting, primarily in a cleanroom environment, and may be required to work on a shift. He has to exercise critical and analytical thinking to review data and identify discrepancies against set criteria. He requires strong communication and teamwork to collaborate effectively with others in order to fulfil work objectives.</code>                                    | <code>The Quality Control Laboratory Analyst/Chemist/Microbiologist is responsible for overseeing sampling processes, ensuring cleanliness standards, and conducting product quality assessments, including specialized testing procedures. This role involves determining optimal operating parameters for laboratory instruments, coordinating with Engineering and Maintenance teams to maintain equipment functionality, and enforcing Standard Operating Procedures (SOPs) alongside continuous workflow enhancements. Operating mainly within a cleanroom laboratory environment, often on rotational shifts, the analyst must apply strong analytical skills to evaluate data accuracy and detect inconsistencies. Effective communication and collaborative teamwork are essential to achieving quality assurance objectives.</code>                                                                                                                                                   | <code>The Quality Control Laboratory Technician coordinates sampling and cleanliness checks, but primarily focuses on maintaining inventory and ordering laboratory supplies. This position works closely with procurement and logistics teams rather than Engineering or Maintenance, ensuring that laboratory consumables are stocked and equipment calibration schedules are tracked. The technician operates in a standard laboratory space and follows established SOPs without involvement in workflow improvements or critical data analysis. While teamwork is necessary for administrative tasks, the role requires minimal analytical judgment and no shift work is typically expected.</code>                                                                                                          |
+  | <code>The Assistant Keeper/Assistant Aquarist assists in the care and management of wildlife within the organisation/attractions sites. This includes supporting the preparation of food to the wildlife, caring for ill animals, checking enclosures and cages for signs of wear or damage for animal, staff and visitor safety, and giving educational talks/tours to the visitors. He/she also assists in maintaining animal training behaviours and promoting conservation awareness through animal presentations. Conscientious and responsible, he is attentive to the needs of the wildlife under his care, and leverages his strong observation skills to monitor and report the status of characteristics and behaviours of the wildlife under his care. He is able to work both independently and under direction. He is physically fit and works in a shift system encompassing weekends and public holidays. Outside the working hours, he may be on a rota for call-outs. He often stays outdoors for long periods of time even t...</code> | <code>The Assistant Keeper/Assistant Aquarist supports the daily care and management of animals at wildlife facilities or attraction sites. Responsibilities include assisting with feeding routines, providing care for sick animals, inspecting enclosures for safety hazards, and delivering educational tours to visitors. This role involves helping to maintain animal training programs and raising public awareness about conservation through animal demonstrations. The assistant is diligent and attentive, closely observing animal health and behavior to report any changes. Capable of working independently or under supervision, the incumbent must be physically resilient, work shifts including weekends and public holidays, and be prepared for on-call duties. The position often requires extended outdoor work in various weather conditions and may necessitate a valid driving licence or scuba-diving certification depending on the workplace environment.</code> | <code>The Animal Nutritionist develops dietary plans and nutritional programs for wildlife and captive animals within zoological and conservation organizations. This role focuses on formulating balanced diets, analyzing feed components, and collaborating with veterinary teams to optimize animal health through specialized nutrition. The Animal Nutritionist primarily works in laboratory and office settings, conducting research and evaluating the effects of various feed formulations. Unlike hands-on caretaking roles, this position requires advanced knowledge of animal physiology and dietetics, with minimal direct interaction with visitors or enclosure maintenance. This role typically operates during standard office hours and does not involve shift work or outdoor duties.</code> |
+  | <code>The Senior Manager works in the field of counselling management. He/She should be qualified and trained to monitor and manage the organisation's strategic initiative, resource management, collaboration and corporate governance to ensure operational efficiency. He oversees strategic implementation, budgets the use of capital and human resources, develops professional development programmes, and initiates professional relationships across agencies. He also ensures operational and governance efficiency through supervision of a multi-disciplinary staff performance evaluation, and policy implementation. He is an experienced management staff who is meticulous, committed and possesses good problem-solving skills.</code>                                                                                                                                                                                                                                                                                                 | <code>The Senior Manager in counselling leadership is responsible for guiding and overseeing the organisation’s strategic priorities, resource allocation, and inter-agency partnerships to maximise operational effectiveness. This role entails supervising the execution of strategic plans, managing budgets for both financial and human capital, designing continuing professional development initiatives, and fostering collaborative networks across different agencies. The Senior Manager also ensures adherence to governance policies and evaluates the performance of a multidisciplinary team. This position requires an experienced, detail-oriented leader with strong commitment and advanced problem-solving capabilities.</code>                                                                                                                                                                                                                                           | <code>The Senior Manager in community health administration leads initiatives in healthcare program management and service delivery. He/She coordinates healthcare resources, manages patient care budgets, and develops training programs for medical staff. The role involves overseeing clinical operations, ensuring compliance with health regulations, and supervising multidisciplinary healthcare teams. This professional must be highly experienced, organized, and skilled in resolving complex clinical and administrative issues.</code>                                                                                                                                                                                                                                                             |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim",
+      "gather_across_devices": false
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `eval_strategy`: epoch
+- `per_device_train_batch_size`: 32
+- `per_device_eval_batch_size`: 16
+- `gradient_accumulation_steps`: 16
+- `learning_rate`: 2e-05
+- `num_train_epochs`: 5
+- `lr_scheduler_type`: cosine
+- `warmup_ratio`: 0.1
+- `bf16`: True
+- `tf32`: False
+- `load_best_model_at_end`: True
+- `batch_sampler`: no_duplicates
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: epoch
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 32
+- `per_device_eval_batch_size`: 16
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 16
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 2e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1.0
+- `num_train_epochs`: 5
+- `max_steps`: -1
+- `lr_scheduler_type`: cosine
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.1
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: True
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: False
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: True
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch_fused
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `hub_revision`: None
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `liger_kernel_config`: None
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: no_duplicates
+- `multi_dataset_batch_sampler`: proportional
+- `router_mapping`: {}
+- `learning_rate_mapping`: {}
+
+</details>
+
+### Training Logs
+| Epoch   | Step   | Training Loss | Validation Loss |
+|:-------:|:------:|:-------------:|:---------------:|
+| 1.0     | 6      | 0.1655        | 0.0144          |
+| 2.0     | 12     | 0.0099        | 0.0039          |
+| 3.0     | 18     | 0.0055        | 0.0027          |
+| 4.0     | 24     | 0.0046        | 0.0023          |
+| **5.0** | **30** | **0.0042**    | **0.0022**      |
+
+* The bold row denotes the saved checkpoint.
+
+### Framework Versions
+- Python: 3.12.11
+- Sentence Transformers: 5.1.0
+- Transformers: 4.55.0
+- PyTorch: 2.8.0+cu128
+- Accelerate: 1.10.0
+- Datasets: 4.0.0
+- Tokenizers: 0.21.4
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+#### MultipleNegativesRankingLoss
+```bibtex
+@misc{henderson2017efficient,
+    title={Efficient Natural Language Response Suggestion for Smart Reply},
+    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
+    year={2017},
+    eprint={1705.00652},
+    archivePrefix={arXiv},
+    primaryClass={cs.CL}
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -0,0 +1,45 @@
+{
+  "architectures": [
+    "ModernBertModel"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 50281,
+  "classifier_activation": "gelu",
+  "classifier_bias": false,
+  "classifier_dropout": 0.0,
+  "classifier_pooling": "mean",
+  "cls_token_id": 50281,
+  "decoder_bias": true,
+  "deterministic_flash_attn": false,
+  "embedding_dropout": 0.0,
+  "eos_token_id": 50282,
+  "global_attn_every_n_layers": 3,
+  "global_rope_theta": 160000.0,
+  "gradient_checkpointing": false,
+  "hidden_activation": "gelu",
+  "hidden_size": 768,
+  "initializer_cutoff_factor": 2.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 1152,
+  "layer_norm_eps": 1e-05,
+  "local_attention": 128,
+  "local_rope_theta": 10000.0,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "mlp_dropout": 0.0,
+  "model_type": "modernbert",
+  "norm_bias": false,
+  "norm_eps": 1e-05,
+  "num_attention_heads": 12,
+  "num_hidden_layers": 22,
+  "pad_token_id": 50283,
+  "position_embedding_type": "absolute",
+  "repad_logits_with_grad": false,
+  "sep_token_id": 50282,
+  "sparse_pred_ignore_index": -100,
+  "sparse_prediction": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.55.0",
+  "vocab_size": 50368
+}

config_sentence_transformers.json

@@ -0,0 +1,14 @@
+{
+  "__version__": {
+    "sentence_transformers": "5.1.0",
+    "transformers": "4.55.0",
+    "pytorch": "2.8.0+cu128"
+  },
+  "prompts": {
+    "query": "",
+    "document": ""
+  },
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine",
+  "model_type": "SentenceTransformer"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d575d112c6f8bffbbb56118df9fb38a419c35f180215ffdab579b98ae3811b8
+size 596070136

modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.models.Normalize"
+  }
+]

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+    "max_seq_length": 8192,
+    "do_lower_case": false
+}

special_tokens_map.json

@@ -0,0 +1,37 @@
+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": true,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,945 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "|||IP_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "1": {
+      "content": "<|padding|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50254": {
+      "content": "                        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50255": {
+      "content": "                       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50256": {
+      "content": "                      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50257": {
+      "content": "                     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50258": {
+      "content": "                    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50259": {
+      "content": "                   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50260": {
+      "content": "                  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50261": {
+      "content": "                 ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50262": {
+      "content": "                ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50263": {
+      "content": "               ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50264": {
+      "content": "              ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50265": {
+      "content": "             ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50266": {
+      "content": "            ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50267": {
+      "content": "           ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50268": {
+      "content": "          ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50269": {
+      "content": "         ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50270": {
+      "content": "        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50271": {
+      "content": "       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50272": {
+      "content": "      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50273": {
+      "content": "     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50274": {
+      "content": "    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50275": {
+      "content": "   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50276": {
+      "content": "  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50277": {
+      "content": "|||EMAIL_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50278": {
+      "content": "|||PHONE_NUMBER|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50279": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50280": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50281": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50282": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50283": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50284": {
+      "content": "[MASK]",
+      "lstrip": true,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50285": {
+      "content": "[unused0]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50286": {
+      "content": "[unused1]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50287": {
+      "content": "[unused2]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50288": {
+      "content": "[unused3]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50289": {
+      "content": "[unused4]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50290": {
+      "content": "[unused5]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50291": {
+      "content": "[unused6]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50292": {
+      "content": "[unused7]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50293": {
+      "content": "[unused8]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50294": {
+      "content": "[unused9]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50295": {
+      "content": "[unused10]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50296": {
+      "content": "[unused11]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50297": {
+      "content": "[unused12]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50298": {
+      "content": "[unused13]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50299": {
+      "content": "[unused14]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50300": {
+      "content": "[unused15]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50301": {
+      "content": "[unused16]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50302": {
+      "content": "[unused17]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50303": {
+      "content": "[unused18]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50304": {
+      "content": "[unused19]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50305": {
+      "content": "[unused20]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50306": {
+      "content": "[unused21]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50307": {
+      "content": "[unused22]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50308": {
+      "content": "[unused23]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50309": {
+      "content": "[unused24]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50310": {
+      "content": "[unused25]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50311": {
+      "content": "[unused26]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50312": {
+      "content": "[unused27]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50313": {
+      "content": "[unused28]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50314": {
+      "content": "[unused29]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50315": {
+      "content": "[unused30]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50316": {
+      "content": "[unused31]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50317": {
+      "content": "[unused32]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50318": {
+      "content": "[unused33]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50319": {
+      "content": "[unused34]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50320": {
+      "content": "[unused35]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50321": {
+      "content": "[unused36]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50322": {
+      "content": "[unused37]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50323": {
+      "content": "[unused38]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50324": {
+      "content": "[unused39]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50325": {
+      "content": "[unused40]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50326": {
+      "content": "[unused41]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50327": {
+      "content": "[unused42]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50328": {
+      "content": "[unused43]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50329": {
+      "content": "[unused44]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50330": {
+      "content": "[unused45]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50331": {
+      "content": "[unused46]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50332": {
+      "content": "[unused47]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50333": {
+      "content": "[unused48]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50334": {
+      "content": "[unused49]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50335": {
+      "content": "[unused50]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50336": {
+      "content": "[unused51]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50337": {
+      "content": "[unused52]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50338": {
+      "content": "[unused53]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50339": {
+      "content": "[unused54]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50340": {
+      "content": "[unused55]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50341": {
+      "content": "[unused56]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50342": {
+      "content": "[unused57]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50343": {
+      "content": "[unused58]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50344": {
+      "content": "[unused59]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50345": {
+      "content": "[unused60]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50346": {
+      "content": "[unused61]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50347": {
+      "content": "[unused62]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50348": {
+      "content": "[unused63]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50349": {
+      "content": "[unused64]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50350": {
+      "content": "[unused65]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50351": {
+      "content": "[unused66]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50352": {
+      "content": "[unused67]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50353": {
+      "content": "[unused68]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50354": {
+      "content": "[unused69]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50355": {
+      "content": "[unused70]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50356": {
+      "content": "[unused71]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50357": {
+      "content": "[unused72]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50358": {
+      "content": "[unused73]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50359": {
+      "content": "[unused74]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50360": {
+      "content": "[unused75]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50361": {
+      "content": "[unused76]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50362": {
+      "content": "[unused77]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50363": {
+      "content": "[unused78]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50364": {
+      "content": "[unused79]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50365": {
+      "content": "[unused80]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50366": {
+      "content": "[unused81]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50367": {
+      "content": "[unused82]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 8192,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": "[UNK]"
+}