Add new SentenceTransformer model

1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+    "word_embedding_dimension": 768,
+    "pooling_mode_cls_token": false,
+    "pooling_mode_mean_tokens": true,
+    "pooling_mode_max_tokens": false,
+    "pooling_mode_mean_sqrt_len_tokens": false,
+    "pooling_mode_weightedmean_tokens": false,
+    "pooling_mode_lasttoken": false,
+    "include_prompt": true
+}

README.md

@@ -0,0 +1,610 @@
+---
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- dense
+- generated_from_trainer
+- dataset_size:6032
+- loss:MultipleNegativesRankingLoss
+base_model: nomic-ai/modernbert-embed-base
+widget:
+- source_sentence: The Ship Agency Manager liaises with port officials and terminal
+    operators to plan husbandry works and/or cargo Operations, and is responsible
+    for ships interests when they are in port. He/She has a sound knowledge of customs
+    and immigration procedures, and port and flag state regulations, and is able to
+    anticipate potential disruptions to work plans. He oversees a team and possesses
+    strong interpersonal skills to establish strong relationships with the industry.
+  sentences:
+  - The Port Operations Analyst monitors shipping schedules and cargo data to optimize
+    berth allocations and terminal efficiency. This role requires strong analytical
+    skills and familiarity with logistics software but does not involve direct liaison
+    with port officials or supervision of personnel. The analyst focuses primarily
+    on data-driven decision making within port operations, without responsibility
+    for customs or flag state compliance.
+  - The Ship Agency Manager coordinates closely with port authorities and terminal
+    operators to organize husbandry services and cargo handling activities, ensuring
+    the protection of the ship's interests while docked. This role demands thorough
+    understanding of customs, immigration protocols, as well as port and flag state
+    regulations, enabling proactive management of any operational interruptions. Leading
+    a dedicated team, the manager also demonstrates excellent interpersonal abilities
+    to foster robust industry partnerships.
+  - The Network Development Technician supports the implementation of projects related
+    to electricity transmission and distribution networks, including the integration
+    of renewable energy sources and energy storage with the grid. This role involves
+    coordinating civil construction activities for substations, cable laying, and
+    equipment installation. The technician performs meter readings, installs and tests
+    metering devices, and secures necessary work permits while adhering strictly to
+    Safe System of Work protocols. As part of the Emergency Response Team, the technician
+    responds promptly during urgent situations following established safety procedures.
+    Work is conducted primarily outdoors at construction sites and customer locations
+    to develop power transmission and distribution systems. The technician must demonstrate
+    strong teamwork, effective communication with various stakeholders, and meticulous
+    attention to procedural compliance.
+- source_sentence: The Vice President leads and manages the endorsement of policies
+    that govern the Standard Operating Procedures (SOPs) to be executed in the event
+    of emergencies. He/She works with senior representatives from different departments
+    to enhance emergency response readiness of the organisation and formulates contingency
+    plans for different services affected during incidents or accidents. He is in
+    charge of evaluating all activities with regards to airport emergency services
+    in order to identify and establish goals for long-term planning. He also initiates
+    new projects for the airport and builds broad professional networks within and
+    outside the organisation. As the Vice President for Airport Emergency Services,
+    he possesses an in-depth knowledge of all airport and aviation facilities and
+    operations. He is cognisant of new technologies and regulations impacting the
+    aviation industry. In addition, he has exceptional leadership and negotiation
+    skills to lead the organisation and manage external stakeholders effectively.
+    He also possesses strong networking skills and a high level of resourcefulness
+    in order to establish partnerships with industrial professionals and alliances
+    internally, externally and virtually.
+  sentences:
+  - The Senior Assistant Engineer (Engineering Train) leads a team responsible for
+    both preventive and corrective maintenance of engineering trains. Proficient in
+    operating calibration and diagnostic tools, he ensures the upkeep and functionality
+    of train systems while supporting continuous process enhancements. He oversees
+    team performance against defined KPIs and works on a rotating shift basis across
+    multiple train depots and maintenance workshops. Demonstrating strong leadership
+    and attention to detail, he enforces stringent safety protocols to guarantee safe
+    and organized maintenance operations.
+  - The Vice President of Airport Emergency Services is responsible for overseeing
+    the development and approval of policies that dictate the Standard Operating Procedures
+    (SOPs) during emergencies. Collaborating closely with senior leaders across multiple
+    departments, this role enhances the organisation’s readiness to respond to emergencies
+    and devises contingency strategies for services impacted by incidents. The Vice
+    President evaluates airport emergency operations to set strategic objectives for
+    future growth and initiates innovative projects to improve airport safety. Possessing
+    comprehensive expertise in aviation facilities and operational protocols, this
+    individual stays abreast of evolving technologies and regulatory changes in the
+    aviation sector. Strong leadership, negotiation, and networking abilities enable
+    the Vice President to effectively guide the organisation and foster partnerships
+    with both internal teams and external industry stakeholders.
+  - The Vice President of Airport Security oversees the implementation of security
+    protocols and manages teams responsible for passenger screening, threat detection,
+    and access control at the airport. This role focuses on developing security measures
+    to prevent unauthorized access and mitigate security risks while ensuring compliance
+    with national and international aviation security regulations. The Vice President
+    leads security personnel, coordinates with government agencies, and manages crisis
+    situations related to security breaches. Expertise in surveillance technology,
+    threat assessment, and counter-terrorism strategies is essential. Strong leadership
+    and communication skills are required to maintain security standards and liaise
+    with external security partners.
+- source_sentence: The Process Specialist/Shift Leader/Team Leader coordinates the
+    day-to-day operations of a production team to meet production and quality standards,
+    while ensuring compliance with workplace safety and health (WSH) procedures. He/She
+    also works with the team to assess the feasibility of improvements to enhance
+    productivity and efficiency at the workplace. He also diagnoses faults, maintains
+    machines and oversees the housekeeping of machine tools and devices. He may be
+    required to work on rotating shifts in a factory setting. He possesses good communication
+    and leadership skills to guide his team and ensure compliance to WSH requirements,
+    organisational quality control and other parameters.
+  sentences:
+  - The Process Specialist/Shift Leader/Team Leader oversees the scheduling and coordination
+    of logistics operations to meet delivery deadlines and customer service standards,
+    while ensuring compliance with transportation safety regulations. This role requires
+    working with cross-functional teams to develop strategies that optimize supply
+    chain efficiency. The incumbent is responsible for managing fleet maintenance,
+    monitoring shipment tracking systems, and supervising warehouse organization.
+    Shift work may be necessary to support 24/7 logistics activities. Excellent communication
+    and leadership skills are needed to lead the team and ensure adherence to safety
+    policies, service quality, and operational guidelines.
+  - The Process Specialist/Shift Leader/Team Leader manages daily operations of a
+    manufacturing team to achieve production targets and quality benchmarks, while
+    ensuring adherence to workplace safety and health (WSH) regulations. This role
+    involves collaborating with the team to evaluate potential process enhancements
+    that improve operational productivity and efficiency. The incumbent is also responsible
+    for troubleshooting equipment issues, performing routine maintenance, and supervising
+    the cleanliness and orderliness of machinery and tools. The position may require
+    shift work within a factory environment. Strong leadership and communication abilities
+    are essential to effectively direct the team and uphold compliance with WSH standards,
+    organizational quality controls, and related protocols.
+  - The Enterprise Risk Management Manager oversees the identification and mitigation
+    of risks across the entire organisation by partnering with various risk functions.
+    This role involves collaborating with internal teams to define risk thresholds
+    within business segments, designing risk reporting tools, and recommending control
+    measures aligned with enterprise-wide risk frameworks. The manager develops comprehensive
+    risk assessments to evaluate risk impact and severity while supporting recovery
+    planning following significant risk events. The ideal candidate is proactive,
+    innovative, and capable of working autonomously, with a strong understanding of
+    organisational operations, decision-making protocols, and business strategy. They
+    possess sharp analytical abilities, communicate effectively with senior leadership
+    on critical risk matters, and lead cross-functional teams adeptly. Familiarity
+    with multiple risk areas across different sectors and a broad understanding of
+    risk types are essential for success in this role.
+- source_sentence: The Financial Forensics Manager guides his/her financial forensics
+    team in delivering forensic investigation, prevention and detection activities,
+    reviewing and communicating the results and recommendations to clients and stakeholders.
+    The Financial Forensics Manager reviews findings from fraud risk identification
+    exercises and fraud investigations and recommendations to improve prevention and
+    detection of fraud schemes. He critiques other expert reports and provides advice
+    on settlements for litigation purposes. He also engages in business development
+    opportunities, developing proposals for clients if in an external consultant role.
+    He conducts fraud awareness and fraud prevention training for both internal and
+    external parties. The Financial Forensics Manager may manage the internal team
+    or a team of forensic consultants who provide forensic services to external clients.
+    He should be results-oriented in his work and is able to deliver reports and findings
+    needed for different client groups. He is able to communicate with senior management
+    and stakeholders on sensitive issues. He applies the principles of the Code of
+    Professional Conduct and Ethics in all his tasks.
+  sentences:
+  - The Engineer is responsible for overseeing the bus fleet’s operational performance
+    to ensure safety and reliability, detecting any system degradations, diagnosing
+    underlying issues, and applying corrective measures to minimize service interruptions.
+    This role involves providing technical guidance to the maintenance team, leveraging
+    a deep understanding of bus systems and engineering concepts. The Engineer also
+    undertakes engineering research to optimize bus operations and maintenance strategies
+    by adopting industry best practices and integrating advanced technological solutions.
+    With strong analytical capabilities, technological proficiency, and innovation-driven
+    mindset, the Engineer effectively manages projects aimed at implementing fleet-wide
+    improvements and new technology deployments to boost overall fleet performance
+    and maintenance effectiveness.
+  - The Financial Planning Manager oversees the development and implementation of
+    financial strategies to optimize company resources and maximize profitability.
+    This role involves budgeting, forecasting, and financial analysis to support operational
+    decisions, working closely with department heads to align financial plans with
+    organizational goals. The manager leads a team responsible for monitoring expenditures,
+    preparing management reports, and ensuring compliance with financial regulations.
+    Engaging with external partners, the Financial Planning Manager also handles contract
+    negotiations and supports investor relations activities. Strong analytical and
+    communication skills are essential for this role, which requires adherence to
+    corporate governance and ethical standards.
+  - The Financial Forensics Manager leads a team dedicated to conducting forensic
+    investigations, focusing on detecting and preventing fraudulent activities. This
+    role involves analyzing fraud risk assessments, reviewing investigative outcomes,
+    and advising clients and stakeholders on recommended actions. The manager evaluates
+    expert analyses and offers guidance on litigation settlements, while also pursuing
+    business development by preparing client proposals when serving as an external
+    consultant. Additionally, the manager designs and delivers fraud prevention training
+    programs to internal teams and external audiences. Overseeing either an in-house
+    unit or forensic consultants working with external clients, this position demands
+    a results-driven professional capable of producing comprehensive reports tailored
+    for various stakeholders and effectively communicating sensitive issues to senior
+    leadership. The manager consistently upholds the standards set forth in the Code
+    of Professional Conduct and Ethics.
+- source_sentence: The Sound Recordist executes sound recording operations. He/She
+    is responsible for recording sound on location or in a studio. He usually records
+    sounds in synchronisation with the camera to enable high quality sounds to be
+    captured at the time of shooting. He coordinates with other crew members to assess
+    the shoot location and studio configuration, and plans the placement of sound
+    equipment to ensure that it does not cast shadows on frames. He operates the sound
+    recording equipment based on the sound design briefs and ensures that recordings
+    are stored appropriately. He monitors the quality of the sound recording and sound
+    effects by using headphones and channels it to the appropriate teams for further
+    sound quality checks. After the shoot, he has to dismantle and clean the sound
+    equipment. He is required to follow workplace safety and health standards and
+    escalate any reports or breaches to the relevant authorities. The work involves
+    long hours of physically demanding tasks, especially during the operation of sound
+    recording equipment. He needs to be physically strong to operate the equipment
+    for long periods of time. He is required to have a strong knowledge of sound technology,
+    sound equipment, camera equipment and radio transmission technology. He ought
+    to be an effective team player and should be able to think of creative solutions
+    to problems posed by particular locations and situations. He should have a good
+    sense of timing and an excellent sense of hearing.
+  sentences:
+  - The Airport Emergency Assistant Manager plays a crucial role in evaluating and
+    addressing the airport’s safety and security requirements while managing emergency
+    response operations. This role involves directing personnel deployment during
+    incidents and coordinating with various airport stakeholders to effectively handle
+    emergencies, accidents, and other critical situations. The assistant manager also
+    organizes external training sessions for new equipment use, and develops comprehensive
+    workforce development plans including on-the-job training initiatives. To ensure
+    a high standard of safety and security, the individual promotes a rigorous safety
+    culture and recommends necessary corrective actions. Leading and mentoring the
+    emergency response team, the assistant manager participates in ongoing training
+    programs to stay current with emergency preparedness protocols. The position requires
+    shift work, possession of a Class 3 driving licence and Airfield Driving Permit
+    (ADP) to operate specialised fire apparatus and vehicles. Candidates must demonstrate
+    strong physical and mental fitness, keen hearing and vision, as well as the ability
+    to maintain calmness and clear judgment under pressure. Effective leadership and
+    team coaching skills are essential to identify and fulfill team training needs.
+  - The Sound Engineer is tasked with mixing and mastering audio tracks in a post-production
+    studio setting. Unlike on-location recording, this role focuses on enhancing recorded
+    sound by applying effects, balancing audio levels, and ensuring clarity for final
+    distribution. The Sound Engineer works independently to manipulate sound files
+    using digital audio workstations and collaborates with music producers to meet
+    artistic goals. This position requires advanced knowledge of sound editing software,
+    acoustics, and mastering techniques rather than live sound capture. Physical demands
+    are minimal compared to field recording, and the role emphasizes technical proficiency
+    in audio manipulation over equipment setup and synchronization with camera operations.
+    Safety protocols pertain mainly to studio ergonomics and electrical standards.
+  - The Sound Recordist is responsible for capturing high-quality audio during both
+    studio and on-location shoots. This role involves synchronizing audio recordings
+    with camera footage and collaborating closely with the production crew to evaluate
+    shooting environments and strategically position sound equipment to avoid visual
+    interference. The Sound Recordist operates specialized recording gear following
+    sound design requirements, ensures proper storage of audio files, and constantly
+    monitors audio quality through headphones, forwarding recordings for further sound
+    refinement. Post-shoot duties include equipment breakdown and maintenance. The
+    position demands adherence to health and safety regulations, physical stamina
+    for handling equipment over extended periods, and a thorough understanding of
+    audio technology, camera gear, and wireless transmission. Strong teamwork, creative
+    problem-solving, precise timing, and acute auditory skills are essential for success.
+datasets:
+- dnth/ssf-train-valid-v4
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+---
+
+# SentenceTransformer based on nomic-ai/modernbert-embed-base
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base) on the [ssf-train-valid-v4](https://huggingface.co/datasets/dnth/ssf-train-valid-v4) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base) <!-- at revision d556a88e332558790b210f7bdbe87da2fa94a8d8 -->
+- **Maximum Sequence Length:** 8192 tokens
+- **Output Dimensionality:** 768 dimensions
+- **Similarity Function:** Cosine Similarity
+- **Training Dataset:**
+    - [ssf-train-valid-v4](https://huggingface.co/datasets/dnth/ssf-train-valid-v4)
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
+  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("dnth/ssf-retriever-modernbert-embed-base-v4")
+# Run inference
+sentences = [
+    'The Sound Recordist executes sound recording operations. He/She is responsible for recording sound on location or in a studio. He usually records sounds in synchronisation with the camera to enable high quality sounds to be captured at the time of shooting. He coordinates with other crew members to assess the shoot location and studio configuration, and plans the placement of sound equipment to ensure that it does not cast shadows on frames. He operates the sound recording equipment based on the sound design briefs and ensures that recordings are stored appropriately. He monitors the quality of the sound recording and sound effects by using headphones and channels it to the appropriate teams for further sound quality checks. After the shoot, he has to dismantle and clean the sound equipment. He is required to follow workplace safety and health standards and escalate any reports or breaches to the relevant authorities. The work involves long hours of physically demanding tasks, especially during the operation of sound recording equipment. He needs to be physically strong to operate the equipment for long periods of time. He is required to have a strong knowledge of sound technology, sound equipment, camera equipment and radio transmission technology. He ought to be an effective team player and should be able to think of creative solutions to problems posed by particular locations and situations. He should have a good sense of timing and an excellent sense of hearing.',
+    'The Sound Recordist is responsible for capturing high-quality audio during both studio and on-location shoots. This role involves synchronizing audio recordings with camera footage and collaborating closely with the production crew to evaluate shooting environments and strategically position sound equipment to avoid visual interference. The Sound Recordist operates specialized recording gear following sound design requirements, ensures proper storage of audio files, and constantly monitors audio quality through headphones, forwarding recordings for further sound refinement. Post-shoot duties include equipment breakdown and maintenance. The position demands adherence to health and safety regulations, physical stamina for handling equipment over extended periods, and a thorough understanding of audio technology, camera gear, and wireless transmission. Strong teamwork, creative problem-solving, precise timing, and acute auditory skills are essential for success.',
+    'The Sound Engineer is tasked with mixing and mastering audio tracks in a post-production studio setting. Unlike on-location recording, this role focuses on enhancing recorded sound by applying effects, balancing audio levels, and ensuring clarity for final distribution. The Sound Engineer works independently to manipulate sound files using digital audio workstations and collaborates with music producers to meet artistic goals. This position requires advanced knowledge of sound editing software, acoustics, and mastering techniques rather than live sound capture. Physical demands are minimal compared to field recording, and the role emphasizes technical proficiency in audio manipulation over equipment setup and synchronization with camera operations. Safety protocols pertain mainly to studio ergonomics and electrical standards.',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 768]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities)
+# tensor([[1.0000, 0.8566, 0.4381],
+#         [0.8566, 1.0000, 0.4453],
+#         [0.4381, 0.4453, 1.0000]])
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### ssf-train-valid-v4
+
+* Dataset: [ssf-train-valid-v4](https://huggingface.co/datasets/dnth/ssf-train-valid-v4) at [8fe074a](https://huggingface.co/datasets/dnth/ssf-train-valid-v4/tree/8fe074acfa95ccc23f130bfbf4bce81683edb1a3)
+* Size: 6,032 training samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | anchor                                                                               | positive                                                                             | negative                                                                             |
+  |:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                               | string                                                                               |
+  | details | <ul><li>min: 58 tokens</li><li>mean: 170.17 tokens</li><li>max: 403 tokens</li></ul> | <ul><li>min: 58 tokens</li><li>mean: 138.51 tokens</li><li>max: 268 tokens</li></ul> | <ul><li>min: 47 tokens</li><li>mean: 108.13 tokens</li><li>max: 237 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>An Occupational Therapist is responsible for providing client care, performing therapy execution and client education activities to an assigned group of clients. S/He performs continuing education and research to achieve quality client care. S/He is also conscientious in providing therapy recommendations based on evaluation of the clients condition. S/He may work in various settings such as public and private institutions, acute and community hospitals, rehabilitation centres, voluntary welfare organisations, schools, long-term care facilities and clients homes and work environments. S/He may also work as part of collaborative, interdisciplinary teams which may include teachers, doctors, audiologists, psychologists, social workers, physiotherapists and speech therapists. S/He should have initiative and be sensitive to the needs of her/his clients. S/He should possess communication and problem-solving skills.</code>                                                                                   | <code>The Occupational Therapist delivers direct therapeutic interventions and educates clients within an assigned caseload, ensuring high-quality care through ongoing professional development and research. This role entails assessing client conditions to formulate tailored therapy plans and collaborating with multidisciplinary teams including medical, educational, and social care professionals. The Occupational Therapist may practice across diverse environments such as hospitals, rehabilitation centres, schools, community agencies, and client residences. Strong communication, empathy, and problem-solving abilities are essential to effectively address client needs and promote optimal outcomes.</code>                                                                                                                                                                                          | <code>The Speech Therapist provides specialized assessment and intervention for clients with speech, language, and communication disorders across healthcare and educational settings. This role focuses on diagnosing communication challenges, developing individualized therapy programs, and collaborating with educators and healthcare providers to support client progress. Unlike the Occupational Therapist, the Speech Therapist’s expertise centers on speech pathology rather than functional and occupational rehabilitation. Effective communication skills and teamwork are critical for success in this position.</code>                                                                                                                              |
+  | <code>The Producer - Film leads the end-to-end management of film production from a creative and operational perspective. He/She oversees and manages the entire lifecycle of film production from the ideation of content to pre-production, production, post-production to finally reaching the audience by distribution. He performs creative as well as management responsibilities and leads a team responsible for the creative coordination and logistical management of production to ensure smooth production operations. He leads production operations and spends long hours on the production location. He is also required to liaise with multiple internal and external stakeholders to have his proposals approved. In some instances, he is also responsible for the hiring of the right cast for the production to enable the achievement of the creative vision of the production, The work involves leading projects or teams and provision of guidance to the production department in identifying projects with high cust...</code> | <code>The Producer - Film is responsible for overseeing the entire film production process from initial concept development through to final distribution. This role combines creative vision with operational leadership, managing all phases including pre-production, shooting, and post-production. The Producer directs a team to coordinate creative efforts and logistical arrangements, ensuring seamless production workflows. They work extensively on set and collaborate with a variety of internal teams and external partners to secure necessary approvals. Additionally, the Producer may handle casting decisions to align with the creative goals of the project. This position requires strong project management skills to deliver films on schedule and within budget, as well as an acute understanding of audience preferences to select projects with high engagement and commercial potential.</code> | <code>The Producer - Documentary leads the research and content development for non-fiction film projects, focusing primarily on factual storytelling and investigative reporting. Unlike the traditional film producer who manages large-scale productions, this role emphasizes gathering real-world information, conducting interviews, and ensuring factual accuracy. The Producer - Documentary works closely with editorial teams and subject matter experts, spending significant time in the field rather than on a production set. While still coordinating project timelines and budgets, this position requires a deep understanding of documentary ethics and compliance with broadcasting standards rather than commercial entertainment metrics.</code> |
+  | <code>The Crewing Manager leads the development of recruitment and deployment strategies for seafarers. He/She oversees the crew recruitment processes and ensures that candidate selection, training and deployment procedures are up-to-date with industry best practices, and in compliance with International Maritime Organisation (IMO) regulations, the Standards for Training, Certification and Watchkeeping for Seafarers (STCW) conventions and the Maritime Labour Convention. He leads engagements with key stakeholders over protection and indemnity (P&I) claims, legal claims and compensation pay-outs, in the event of accidents and/or incidents occurring. He leads negotiations with seafaring unions for collective bargaining agreements and reviews crewing expenditure reports to ensure budget compliance.</code>                                                                                                                                                                                                             | <code>The Crewing Manager is responsible for directing the recruitment and placement strategies for maritime personnel. This role involves managing the end-to-end crew hiring process, ensuring that selection, training, and deployment align with the latest industry standards and comply with regulations such as those set by the International Maritime Organisation (IMO), the STCW conventions, and the Maritime Labour Convention. The Crewing Manager also coordinates with stakeholders regarding protection and indemnity (P&I) claims, legal matters, and compensation related to maritime incidents. Additionally, this position leads union negotiations for collective bargaining agreements and monitors crewing budgets to maintain financial adherence.</code>                                                                                                                                             | <code>The Crewing Coordinator manages the scheduling and logistical support for shipboard operations within the maritime industry. They focus primarily on coordinating daily crew assignments and travel arrangements, without direct involvement in recruitment or regulatory compliance. The role requires strong organizational skills to handle personnel rotations and onboard welfare, but does not include negotiation of collective agreements or oversight of legal claims and budgetary control.</code>                                                                                                                                                                                                                                                    |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim",
+      "gather_across_devices": false
+  }
+  ```
+
+### Evaluation Dataset
+
+#### ssf-train-valid-v4
+
+* Dataset: [ssf-train-valid-v4](https://huggingface.co/datasets/dnth/ssf-train-valid-v4) at [8fe074a](https://huggingface.co/datasets/dnth/ssf-train-valid-v4/tree/8fe074acfa95ccc23f130bfbf4bce81683edb1a3)
+* Size: 1,508 evaluation samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | anchor                                                                               | positive                                                                            | negative                                                                             |
+  |:--------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                              | string                                                                               |
+  | details | <ul><li>min: 57 tokens</li><li>mean: 167.41 tokens</li><li>max: 349 tokens</li></ul> | <ul><li>min: 58 tokens</li><li>mean: 135.9 tokens</li><li>max: 269 tokens</li></ul> | <ul><li>min: 49 tokens</li><li>mean: 106.77 tokens</li><li>max: 250 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |
+  |:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The Chief Executive Officer/Chief Operating Officer/Managing Director/General Manager/Vice-President provides the overall direction of the organisation. As a systems thinker, he/she strategises and directs operational activities at the highest level of management with the help of a management team. He translates broad goals into achievable steps, anticipates and stays ahead of trends and takes advantage of opportunities. He also represents the organisation before customers, investors and business partners. He also formulates ideas and drives change in an organisation, while maintaining a culture of innovativeness to sustain value creation in meeting the organisations competitive position and long-term objectives. With a nurturing mindset, he also mentors and develops talent as future leaders.</code>                              | <code>The Chief Executive Officer/Chief Operating Officer/Managing Director/General Manager/Vice-President leads the organisation by setting strategic direction and overseeing high-level operational functions alongside a management team. Acting as a visionary, this leader converts broad organisational goals into practical initiatives, anticipates market trends, and leverages opportunities to maintain competitive advantage. They represent the company in interactions with clients, investors, and partners, while fostering a culture of innovation and continuous improvement. Additionally, they are committed to talent development, mentoring future leaders to support the organisation’s long-term success.</code>                                                                                                                    | <code>The Chief Marketing Officer leads the organisation’s marketing efforts by developing branding strategies and managing campaigns to enhance customer engagement. Collaborating with the marketing team, they analyze market data, plan promotional activities, and oversee digital marketing channels. This role requires expertise in consumer behavior, advertising, and communications, focusing on driving sales and brand awareness rather than overall organisational strategy or operational management.</code>                                                                                                                                                                             |
+  | <code>The Business Development Manager assumes the responsibility of leading the organisation's business development strategies by prospecting new buyers and sellers, expanding current business portfolio, and identifying new business ventures both locally and regionally. He/She is expected to maintain extensive knowledge of current market conditions to identify and develop the organisation's propositions and differentiators. The Business Development Manager also collaborates with regional teams to stay informed with the latest geographical trends. In addition, he maintains relationships with existing and new buyers and sellers, and manages a diverse group of stakeholders. He is a highly-driven individual whom possesses great attention to detail and is able to address complex problems in a dynamic business environment.</code>          | <code>The Business Development Manager is tasked with spearheading the company’s growth initiatives by identifying potential clients and partners, broadening the existing business portfolio, and exploring new market opportunities both domestically and across the region. This role requires up-to-date insights into prevailing market trends to shape the company’s value propositions and competitive advantages. The Business Development Manager works closely with regional counterparts to monitor emerging geographical market dynamics and sustains strong relationships with a wide range of stakeholders, including current and prospective buyers and sellers. The ideal candidate is a results-oriented professional with meticulous attention to detail, capable of solving complex challenges in a fast-paced commercial setting.</code> | <code>The Business Development Analyst supports the organisation by researching market data and compiling reports on buyer and seller trends to aid decision-making. This role focuses on data gathering rather than direct client engagement and does not involve leading business initiatives or managing stakeholder relationships. The Analyst collaborates with internal teams to update market intelligence and assists in regional market analysis, requiring strong analytical skills and attention to detail but limited strategic responsibility. This position operates under close supervision and is primarily focused on supporting functions rather than driving business growth.</code> |
+  | <code>The Senior Care Staff supervises the provision of care to clients. He/She supervises the performance of tasks in care plans by care team members and provides input in the development and review of care plans with social service and/or healthcare professionals. He also supervises the daily operations and maintenance of the care environment and advises on measures to ensure clients observe house rules. He designs activities for clients to promote independence, health, wellness, and quality of life and monitors operations to ensure adherence to relevant statutory requirements and organisational policies. A resourceful, proactive and responsible professional who possesses good leadership and team management skills, the Senior Care Staff works in various voluntary welfare organisations, communities and institutional settings.</code> | <code>The Senior Care Staff oversees the delivery of client care by guiding care team members in executing care plans. They collaborate with social service and healthcare professionals to contribute to the formulation and assessment of these plans. Additionally, they manage daily operations and upkeep of the care environment, ensuring clients comply with house regulations. The role involves creating client activities aimed at enhancing independence, health, and overall quality of life, while ensuring all procedures comply with statutory and organizational standards. As a dependable and proactive leader with strong team management capabilities, the Senior Care Staff typically operates within voluntary welfare organizations, community settings, and institutional care facilities.</code>                                   | <code>The Senior Administrative Officer manages office operations within healthcare organizations, coordinating administrative tasks and supporting staff to ensure efficient workflow. This role focuses on handling documentation, scheduling, and communication rather than direct client care. The Senior Administrative Officer requires strong organizational and clerical skills, with an emphasis on policy compliance and office management, serving primarily in healthcare administration rather than frontline care services.</code>                                                                                                                                                        |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim",
+      "gather_across_devices": false
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `eval_strategy`: epoch
+- `per_device_train_batch_size`: 32
+- `per_device_eval_batch_size`: 16
+- `gradient_accumulation_steps`: 16
+- `learning_rate`: 2e-05
+- `num_train_epochs`: 5
+- `lr_scheduler_type`: cosine
+- `warmup_ratio`: 0.2
+- `bf16`: True
+- `tf32`: True
+- `load_best_model_at_end`: True
+- `batch_sampler`: no_duplicates
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: epoch
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 32
+- `per_device_eval_batch_size`: 16
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 16
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 2e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1.0
+- `num_train_epochs`: 5
+- `max_steps`: -1
+- `lr_scheduler_type`: cosine
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.2
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: True
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: True
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: True
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch_fused
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `hub_revision`: None
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `liger_kernel_config`: None
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: no_duplicates
+- `multi_dataset_batch_sampler`: proportional
+- `router_mapping`: {}
+- `learning_rate_mapping`: {}
+
+</details>
+
+### Training Logs
+| Epoch   | Step   | Training Loss | Validation Loss |
+|:-------:|:------:|:-------------:|:---------------:|
+| 1.0     | 12     | 0.1255        | 0.0076          |
+| 2.0     | 24     | 0.0049        | 0.0028          |
+| 3.0     | 36     | 0.0026        | 0.0020          |
+| 4.0     | 48     | 0.002         | 0.0018          |
+| **5.0** | **60** | **0.002**     | **0.0018**      |
+
+* The bold row denotes the saved checkpoint.
+
+### Framework Versions
+- Python: 3.12.8
+- Sentence Transformers: 5.1.0
+- Transformers: 4.55.0
+- PyTorch: 2.8.0+cu128
+- Accelerate: 1.10.0
+- Datasets: 4.0.0
+- Tokenizers: 0.21.4
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+#### MultipleNegativesRankingLoss
+```bibtex
+@misc{henderson2017efficient,
+    title={Efficient Natural Language Response Suggestion for Smart Reply},
+    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
+    year={2017},
+    eprint={1705.00652},
+    archivePrefix={arXiv},
+    primaryClass={cs.CL}
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -0,0 +1,45 @@
+{
+  "architectures": [
+    "ModernBertModel"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 50281,
+  "classifier_activation": "gelu",
+  "classifier_bias": false,
+  "classifier_dropout": 0.0,
+  "classifier_pooling": "mean",
+  "cls_token_id": 50281,
+  "decoder_bias": true,
+  "deterministic_flash_attn": false,
+  "embedding_dropout": 0.0,
+  "eos_token_id": 50282,
+  "global_attn_every_n_layers": 3,
+  "global_rope_theta": 160000.0,
+  "gradient_checkpointing": false,
+  "hidden_activation": "gelu",
+  "hidden_size": 768,
+  "initializer_cutoff_factor": 2.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 1152,
+  "layer_norm_eps": 1e-05,
+  "local_attention": 128,
+  "local_rope_theta": 10000.0,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "mlp_dropout": 0.0,
+  "model_type": "modernbert",
+  "norm_bias": false,
+  "norm_eps": 1e-05,
+  "num_attention_heads": 12,
+  "num_hidden_layers": 22,
+  "pad_token_id": 50283,
+  "position_embedding_type": "absolute",
+  "repad_logits_with_grad": false,
+  "sep_token_id": 50282,
+  "sparse_pred_ignore_index": -100,
+  "sparse_prediction": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.55.0",
+  "vocab_size": 50368
+}

config_sentence_transformers.json

@@ -0,0 +1,14 @@
+{
+  "__version__": {
+    "sentence_transformers": "5.1.0",
+    "transformers": "4.55.0",
+    "pytorch": "2.8.0+cu128"
+  },
+  "prompts": {
+    "query": "",
+    "document": ""
+  },
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine",
+  "model_type": "SentenceTransformer"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5c06770ab34ed7f7d4e5e85349652e23fb964f9706f76b5d05eb3dd5c6bff993
+size 596070136

modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.models.Normalize"
+  }
+]

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+    "max_seq_length": 8192,
+    "do_lower_case": false
+}

special_tokens_map.json

@@ -0,0 +1,37 @@
+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": true,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,945 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "|||IP_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "1": {
+      "content": "<|padding|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50254": {
+      "content": "                        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50255": {
+      "content": "                       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50256": {
+      "content": "                      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50257": {
+      "content": "                     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50258": {
+      "content": "                    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50259": {
+      "content": "                   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50260": {
+      "content": "                  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50261": {
+      "content": "                 ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50262": {
+      "content": "                ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50263": {
+      "content": "               ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50264": {
+      "content": "              ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50265": {
+      "content": "             ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50266": {
+      "content": "            ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50267": {
+      "content": "           ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50268": {
+      "content": "          ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50269": {
+      "content": "         ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50270": {
+      "content": "        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50271": {
+      "content": "       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50272": {
+      "content": "      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50273": {
+      "content": "     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50274": {
+      "content": "    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50275": {
+      "content": "   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50276": {
+      "content": "  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50277": {
+      "content": "|||EMAIL_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50278": {
+      "content": "|||PHONE_NUMBER|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50279": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50280": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50281": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50282": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50283": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50284": {
+      "content": "[MASK]",
+      "lstrip": true,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50285": {
+      "content": "[unused0]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50286": {
+      "content": "[unused1]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50287": {
+      "content": "[unused2]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50288": {
+      "content": "[unused3]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50289": {
+      "content": "[unused4]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50290": {
+      "content": "[unused5]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50291": {
+      "content": "[unused6]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50292": {
+      "content": "[unused7]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50293": {
+      "content": "[unused8]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50294": {
+      "content": "[unused9]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50295": {
+      "content": "[unused10]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50296": {
+      "content": "[unused11]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50297": {
+      "content": "[unused12]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50298": {
+      "content": "[unused13]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50299": {
+      "content": "[unused14]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50300": {
+      "content": "[unused15]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50301": {
+      "content": "[unused16]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50302": {
+      "content": "[unused17]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50303": {
+      "content": "[unused18]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50304": {
+      "content": "[unused19]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50305": {
+      "content": "[unused20]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50306": {
+      "content": "[unused21]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50307": {
+      "content": "[unused22]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50308": {
+      "content": "[unused23]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50309": {
+      "content": "[unused24]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50310": {
+      "content": "[unused25]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50311": {
+      "content": "[unused26]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50312": {
+      "content": "[unused27]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50313": {
+      "content": "[unused28]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50314": {
+      "content": "[unused29]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50315": {
+      "content": "[unused30]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50316": {
+      "content": "[unused31]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50317": {
+      "content": "[unused32]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50318": {
+      "content": "[unused33]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50319": {
+      "content": "[unused34]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50320": {
+      "content": "[unused35]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50321": {
+      "content": "[unused36]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50322": {
+      "content": "[unused37]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50323": {
+      "content": "[unused38]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50324": {
+      "content": "[unused39]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50325": {
+      "content": "[unused40]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50326": {
+      "content": "[unused41]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50327": {
+      "content": "[unused42]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50328": {
+      "content": "[unused43]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50329": {
+      "content": "[unused44]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50330": {
+      "content": "[unused45]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50331": {
+      "content": "[unused46]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50332": {
+      "content": "[unused47]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50333": {
+      "content": "[unused48]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50334": {
+      "content": "[unused49]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50335": {
+      "content": "[unused50]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50336": {
+      "content": "[unused51]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50337": {
+      "content": "[unused52]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50338": {
+      "content": "[unused53]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50339": {
+      "content": "[unused54]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50340": {
+      "content": "[unused55]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50341": {
+      "content": "[unused56]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50342": {
+      "content": "[unused57]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50343": {
+      "content": "[unused58]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50344": {
+      "content": "[unused59]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50345": {
+      "content": "[unused60]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50346": {
+      "content": "[unused61]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50347": {
+      "content": "[unused62]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50348": {
+      "content": "[unused63]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50349": {
+      "content": "[unused64]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50350": {
+      "content": "[unused65]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50351": {
+      "content": "[unused66]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50352": {
+      "content": "[unused67]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50353": {
+      "content": "[unused68]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50354": {
+      "content": "[unused69]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50355": {
+      "content": "[unused70]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50356": {
+      "content": "[unused71]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50357": {
+      "content": "[unused72]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50358": {
+      "content": "[unused73]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50359": {
+      "content": "[unused74]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50360": {
+      "content": "[unused75]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50361": {
+      "content": "[unused76]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50362": {
+      "content": "[unused77]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50363": {
+      "content": "[unused78]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50364": {
+      "content": "[unused79]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50365": {
+      "content": "[unused80]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50366": {
+      "content": "[unused81]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50367": {
+      "content": "[unused82]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 8192,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": "[UNK]"
+}