Add new SentenceTransformer model

1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+    "word_embedding_dimension": 768,
+    "pooling_mode_cls_token": false,
+    "pooling_mode_mean_tokens": true,
+    "pooling_mode_max_tokens": false,
+    "pooling_mode_mean_sqrt_len_tokens": false,
+    "pooling_mode_weightedmean_tokens": false,
+    "pooling_mode_lasttoken": false,
+    "include_prompt": true
+}

README.md

@@ -0,0 +1,569 @@
+---
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- dense
+- generated_from_trainer
+- dataset_size:3016
+- loss:MultipleNegativesRankingLoss
+base_model: nomic-ai/modernbert-embed-base
+widget:
+- source_sentence: The Business-to-Business Sales and Key Accounts Executive executes
+    technical sales strategies and business plans, identifies potential new business
+    avenues and platforms through the client base, rectifies technical issues for
+    clients during the sales process, and contributes to the organising of networking
+    events to enhance client relationships. He/She implements new account development
+    strategies to capitalise on potential opportunities. He works in a customer-centric,
+    dynamic and challenging sales environment. He is a resourceful, self-driven and
+    sales-savvy team player who is able to interact with others effectively and work
+    under pressure within tight deadlines to deliver sales results.
+  sentences:
+  - The Senior Risk Analyst is responsible for collaborating with various internal
+    teams to pinpoint and articulate complex risks linked to particular business areas.
+    This role involves evaluating and emphasizing significant risks to aid in comprehensive
+    risk evaluations and shaping risk profiles. The analyst ensures compliance with
+    established risk policies and procedures while facilitating effective risk communication
+    and reporting. Additionally, the Senior Risk Analyst reviews and improves risk
+    assessment methodologies throughout the organisation’s regional operations, contributing
+    to ongoing risk research initiatives. The ideal candidate is analytical, detail-oriented,
+    methodical, and demonstrates strong problem-solving and critical thinking abilities.
+  - The Business-to-Business Marketing and Brand Executive develops marketing campaigns
+    and branding strategies, analyses market trends to identify new promotional channels,
+    manages product positioning, and coordinates advertising events to boost brand
+    visibility. This role requires creativity, strategic thinking, and the ability
+    to work collaboratively in a deadline-driven environment to enhance the company’s
+    market presence.
+  - The Business-to-Business Sales and Key Accounts Executive is responsible for deploying
+    effective sales tactics and developing comprehensive business plans to expand
+    the client portfolio. This role involves identifying new market opportunities
+    within existing accounts, resolving any technical concerns raised by clients during
+    the sales cycle, and assisting in the coordination of networking events aimed
+    at strengthening client engagement. Operating in a fast-paced and customer-focused
+    sales environment, the executive must be proactive, commercially astute, and able
+    to collaborate well with colleagues while managing tight deadlines to achieve
+    targeted sales outcomes.
+- source_sentence: The Senior Customer Service Officer/Customer Service Specialist
+    is responsible for analysing and planning overall customer service excellence,
+    developing and reviewing process reviews and implementing customer service process
+    review initiatives. He/She is also responsible for measuring results and managing
+    change management communications. Systematic and analytical, he is required to
+    identify areas for improvements and perform customer quality analysis. He is also
+    expected to coordinate closely with internal and external stakeholders to implement
+    new processes.
+  sentences:
+  - The Senior Customer Service Specialist oversees the design and execution of strategies
+    aimed at enhancing customer service quality. This role involves evaluating current
+    service processes, initiating improvements, and tracking performance metrics.
+    With strong analytical skills, the Specialist identifies opportunities for service
+    enhancement and leads communication efforts related to change management. Collaboration
+    with various internal teams and external partners is essential to successfully
+    roll out new customer service initiatives.
+  - The Senior Marketing Officer is responsible for developing and executing marketing
+    campaigns, managing brand promotion activities, and conducting market research
+    to identify consumer trends. This role requires strong creative and communication
+    skills to engage target audiences and coordinate with advertising agencies. The
+    officer also monitors campaign effectiveness and adjusts strategies accordingly
+    to maximize market reach and customer engagement.
+  - The Associate Applications Support Engineer is tasked with supporting and maintaining
+    designated software applications, whether developed internally or sourced from
+    third parties. This role requires a thorough understanding of application functionality
+    and backend processes. The engineer collaborates closely with application development,
+    transition, and testing teams to troubleshoot and document application issues
+    effectively. Working within a team environment, the individual is skilled in application
+    development, monitoring tools, and relevant software platforms deployed by the
+    organisation. Strong analytical thinking and problem-solving abilities are essential,
+    along with excellent communication and interpersonal skills to address technical
+    challenges promptly.
+- source_sentence: The Pre-Sales Consultant is responsible for providing pre-sales
+    technical expertise to the sales team and clients during the sales process. He/She
+    delivers presentations and technical demonstrations of the organisation's products
+    to prospective clients. He translates the client's business requirements into
+    technical specifications and requirements, and provides technical inputs for proposals,
+    tenders, bids and any relevant documents. He uses prescribed guidelines or policies
+    to analyse and solve problems. He works in a fast-paced and dynamic environment,
+    and travels frequently to clients' premises for technical sales pitches and meetings.
+    He is familiar with client relationship management and sales tools. He possesses
+    deep product and technical knowledge, and is knowledgeable of the trends, developments
+    and challenges of the industry domain. The Pre-Sales Consultant displays effective
+    listening skills and is inquisitive in nature. He possesses deep technical and
+    domain knowledge, pays attention to detail, and has strong analytical and problem-solving
+    capabilities. He has a service-oriented personality and is a team player who works
+    towards developing solutions collaboratively.
+  sentences:
+  - The Sales Operations Analyst manages internal sales processes and data analytics
+    to optimize the effectiveness of the sales team within the technology sector.
+    This role focuses on generating sales reports, analyzing performance metrics,
+    and streamlining customer data workflows rather than direct client engagement.
+    The analyst supports strategic decision-making by providing actionable insights
+    through CRM systems and sales software but is not involved in technical demonstrations
+    or client-facing presentations. Working primarily from the office, this position
+    requires proficiency in data analysis, reporting tools, and a thorough understanding
+    of sales operations, rather
+  - The Producer is responsible for managing the full production process from initial
+    concept development through pre-production and the actual production phase. They
+    coordinate a team that handles both creative and logistical aspects to guarantee
+    seamless production workflows. The Producer collaborates with various internal
+    departments and external partners to recruit technical and creative personnel,
+    schedule timelines, and organize production activities. Additionally, they engage
+    with regulatory bodies to obtain necessary legal and compliance clearances. Managing
+    the production budget, including pricing strategies and securing financial support
+    through sponsorships and funding, also falls under their purview. They furthermore
+    create and implement marketing plans to effectively promote the production.
+  - The Pre-Sales Consultant provides expert technical support throughout the sales
+    cycle, collaborating closely with the sales team and prospective clients. This
+    role involves delivering detailed product demonstrations and presentations that
+    align with client needs. The consultant interprets business requirements into
+    precise technical specifications, contributing key insights to proposals, bids,
+    and tender documents. Operating within established policies, the consultant addresses
+    technical challenges effectively. Frequent travel to client sites for sales engagements
+    is expected in this fast-moving environment. Proficiency in client relationship
+    management tools and sales platforms is essential. The consultant maintains up-to-date
+    knowledge of product features and industry trends, demonstrating strong listening
+    skills, curiosity, and meticulous attention to detail. A collaborative, service-minded
+    approach and advanced analytical abilities are vital for success in this position.
+- source_sentence: The Head of Port Business Development/Operations works closely
+    with management and external stakeholders in strategic planning to grow the business
+    portfolio and enterprise value and formulating the organisation's risk management
+    strategy and mitigation measures. He/She keeps abreast of the latest developments
+    in the organisation and industry and inspires a culture of process improvement
+    to leverage on new technologies to enhance port productivity and efficiency. He
+    also drives service delivery excellence and adds value to customers and the business.
+    He is a well-organised person with excellent planning skills, and mentors a team.
+  sentences:
+  - The Senior Maritime Compliance Officer oversees regulatory adherence and conducts
+    audits within the shipping industry, ensuring vessels meet international safety
+    and environmental standards. This role requires deep knowledge of maritime laws
+    and regulations, proficiency in compliance reporting, and coordination with regulatory
+    bodies. The officer develops compliance policies, conducts risk assessments, and
+    provides training to operational teams. While the position involves leadership
+    duties, it focuses primarily on regulatory enforcement rather than business development
+    or operational efficiency.
+  - The R&D Chemist conducts intricate laboratory experiments, analyses, and evaluations
+    to advance Research and Development initiatives. This role involves formulating
+    research goals and proposals aimed at pioneering new products and supporting projects
+    involving novel technologies, materials, or ingredients. The chemist contributes
+    to the creation of innovative formulations and solutions, ensuring adherence to
+    Intellectual Property rights and patent laws, while establishing product specifications
+    for scaling up production processes. Detailed documentation of research activities
+    is maintained for both internal stakeholders and external clients, with insights
+    provided to enhance product development based on experimental findings. The chemist
+    also oversees the Management of Hazardous Chemicals Programme in the lab, aligning
+    with Workplace Safety and Health and Environmental Management System standards.
+    Collaborating within a multidisciplinary laboratory team and partnering with application
+    and technical service groups, the R&D Chemist demonstrates strong teamwork, creativity,
+    and problem-solving abilities, manages multiple projects autonomously, and excels
+    in technical communication and presentations.
+  - The Head of Port Business Development and Operations collaborates with senior
+    management and external partners to devise strategic initiatives aimed at expanding
+    the business portfolio and increasing enterprise value. This role involves developing
+    risk management frameworks and mitigation plans for the organisation. Staying
+    informed on industry trends and organisational changes, the incumbent fosters
+    a culture of continuous process improvement by integrating innovative technologies
+    to boost port productivity and operational efficiency. Additionally, they champion
+    service excellence to enhance customer satisfaction and business outcomes. The
+    position demands strong organisational capabilities, advanced planning skills,
+    and includes mentoring responsibilities for a team.
+- source_sentence: The Financial Planner/Insurance Agent/Bancassurance Specialist
+    is responsible for developing and implementing financial plans to help customers
+    meet their objectives, and managing customer relationships. He/She understands
+    customer profiles and recommends suitable solutions to them. He is also in charge
+    of attracting his own customers through networking sessions, relationship building
+    and referrals. The Financial Planner/Insurance Agent/Bancassurance Specialist's
+    duties might require him to work on weekends and after office hours and may involve
+    travel to customers' locations. He has a friendly and outgoing nature and is able
+    to build rapport with customers easily in order to establish trust.
+  sentences:
+  - The Pharmacy Technician Executive supports pharmacists by preparing sterile and
+    non-sterile medications according to prescriptions and oversees quality assurance
+    processes and departmental improvement projects. This role ensures adherence to
+    medication safety protocols across diverse healthcare environments including hospitals,
+    outpatient clinics, polyclinics, and retail pharmacies. The incumbent is expected
+    to demonstrate initiative, attention to detail, and strong interpersonal, leadership,
+    and analytical abilities.
+  - The Financial Planner/Insurance Agent/Bancassurance Specialist designs and executes
+    tailored financial strategies to assist clients in achieving their financial goals
+    while maintaining strong client relationships. This role requires a thorough understanding
+    of client needs to propose appropriate financial products. The specialist actively
+    seeks new clients through networking, referrals, and relationship management.
+    Flexibility in working hours, including evenings, weekends, and occasional travel
+    to client sites, is essential. Strong interpersonal skills and an approachable
+    demeanor enable effective trust-building with customers.
+  - The Financial Analyst/Investment Consultant/Bancassurance Coordinator conducts
+    in-depth market research and analyzes investment portfolios to provide strategic
+    advice to corporate clients. This role focuses on evaluating financial data rather
+    than direct customer acquisition and requires collaboration with internal teams
+    rather than individual networking. Work hours are generally standard office hours
+    with minimal client site visits. The position demands analytical proficiency and
+    detailed reporting skills, with limited emphasis on personal rapport or direct
+    sales activities.
+datasets:
+- dnth/ssf-train-valid-v2
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+---
+
+# SentenceTransformer based on nomic-ai/modernbert-embed-base
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base) on the [ssf-train-valid-v2](https://huggingface.co/datasets/dnth/ssf-train-valid-v2) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base) <!-- at revision d556a88e332558790b210f7bdbe87da2fa94a8d8 -->
+- **Maximum Sequence Length:** 8192 tokens
+- **Output Dimensionality:** 768 dimensions
+- **Similarity Function:** Cosine Similarity
+- **Training Dataset:**
+    - [ssf-train-valid-v2](https://huggingface.co/datasets/dnth/ssf-train-valid-v2)
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
+  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("dnth/ssf-retriever-modernbert-embed-base-v2")
+# Run inference
+sentences = [
+    "The Financial Planner/Insurance Agent/Bancassurance Specialist is responsible for developing and implementing financial plans to help customers meet their objectives, and managing customer relationships. He/She understands customer profiles and recommends suitable solutions to them. He is also in charge of attracting his own customers through networking sessions, relationship building and referrals. The Financial Planner/Insurance Agent/Bancassurance Specialist's duties might require him to work on weekends and after office hours and may involve travel to customers' locations. He has a friendly and outgoing nature and is able to build rapport with customers easily in order to establish trust.",
+    'The Financial Planner/Insurance Agent/Bancassurance Specialist designs and executes tailored financial strategies to assist clients in achieving their financial goals while maintaining strong client relationships. This role requires a thorough understanding of client needs to propose appropriate financial products. The specialist actively seeks new clients through networking, referrals, and relationship management. Flexibility in working hours, including evenings, weekends, and occasional travel to client sites, is essential. Strong interpersonal skills and an approachable demeanor enable effective trust-building with customers.',
+    'The Financial Analyst/Investment Consultant/Bancassurance Coordinator conducts in-depth market research and analyzes investment portfolios to provide strategic advice to corporate clients. This role focuses on evaluating financial data rather than direct customer acquisition and requires collaboration with internal teams rather than individual networking. Work hours are generally standard office hours with minimal client site visits. The position demands analytical proficiency and detailed reporting skills, with limited emphasis on personal rapport or direct sales activities.',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 768]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities)
+# tensor([[1.0000, 0.8627, 0.5380],
+#         [0.8627, 1.0000, 0.5945],
+#         [0.5380, 0.5945, 1.0000]])
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### ssf-train-valid-v2
+
+* Dataset: [ssf-train-valid-v2](https://huggingface.co/datasets/dnth/ssf-train-valid-v2) at [fb19ed3](https://huggingface.co/datasets/dnth/ssf-train-valid-v2/tree/fb19ed3200e91badb0cb224e0debe909f1d7c2bd)
+* Size: 3,016 training samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | anchor                                                                               | positive                                                                             | negative                                                                             |
+  |:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                               | string                                                                               |
+  | details | <ul><li>min: 57 tokens</li><li>mean: 167.72 tokens</li><li>max: 403 tokens</li></ul> | <ul><li>min: 54 tokens</li><li>mean: 135.01 tokens</li><li>max: 250 tokens</li></ul> | <ul><li>min: 15 tokens</li><li>mean: 100.13 tokens</li><li>max: 212 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
+  |:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The Senior Technician (Automatic Fare Collection) is responsible for preventive and corrective maintenance of Automatic Fare Collection (AFC) systems. His/Her duties include troubleshooting of faults, providing technical guidance and on-the-job coaching to his team, as well as supervising the work of contractors and external stakeholders in ensuring compliance to safety requirements and operating standards. He is required to carry out his duties in the depot, workshop and/or at various train stations during train operating hours. He is technically inclined and well-verse in various AFC systems and machines and builds good teamwork amongst his team to support maintenance activities.</code>                         | <code>The Senior Technician (Automatic Fare Collection) oversees both preventive and corrective maintenance tasks related to Automatic Fare Collection (AFC) systems. This role involves diagnosing system faults, offering expert technical advice, and mentoring team members on operational procedures. The technician also manages contractors and external partners, ensuring adherence to safety protocols and operational guidelines. Responsibilities are performed across depots, workshops, and multiple train stations during service hours. A solid technical background in AFC equipment and strong team leadership skills are essential to effectively support maintenance operations.</code>                                          | <code>The Senior Technician (Automatic Fare Collection) is responsible for conducting routine inspections and repairs of automated ticket vending machines in retail environments. This role includes assisting customers with machine usage, coordinating with sales teams, and ensuring compliance with commercial service standards. Work is primarily carried out within shopping malls during business hours. The technician requires customer service skills and basic technical knowledge of vending equipment but is not involved in supervising maintenance teams or external contractors.</code>                                                                           |
+  | <code>The Venue Operations Manager is responsible for overseeing the running of venue operations, including the logistics requirements. He/She works closely with event services department to ensure client requirements are fulfilled in compliance to local health and safety standards. He reviews event plans to ensure generation of maximum yield for organisation. Meticulous and resourceful, he possesses excellent problem-solving skills and is able to react quickly to deviations in the project plans. He is able to work in a flexible workweek, including weekends, evenings, and public holidays, and is comfortable working in both an indoor and outdoor environment depending on the nature and requirements of the events.</code> | <code>The Venue Operations Manager oversees all aspects of venue management, coordinating logistics and collaborating with the event services team to meet client expectations while adhering to local health and safety regulations. This role involves reviewing event strategies to optimize organizational revenue and demands strong problem-solving abilities to address unforeseen challenges promptly. The manager must be adaptable to a variable schedule, including weekends, evenings, and public holidays, and comfortable operating in diverse environments, both indoor and outdoor, based on event needs.</code>                                                                                                                     | <code>The Venue Marketing Manager is responsible for developing and executing promotional campaigns for the venue, working closely with the sales department to attract clients and increase bookings. They analyze market trends to maximize revenue opportunities and must be creative and communicative, addressing branding challenges as they arise. This role typically operates standard weekday hours and focuses primarily on indoor office environments rather than on-site event coordination.</code>                                                                                                                                                                     |
+  | <code>The Liquefied Natural Gas Research Analyst supports the LNG Trading team in identifying opportunities for closing deals and increasing portfolio value. He/She conducts research using market and economic data for the preparation of market reports and analyses data regarding risks associated with trading deals. He engages clients on presentations on market insights and liaises with key stakeholders for the preparation of hedging activities. He works in a dynamic and fast-paced environment where he must provide accurate analyses and research material to support the closing of deals. He is a decisive, analytical and self-motivated individual who is comfortable with numbers and able to work under pressure.</code>     | <code>The Liquefied Natural Gas Research Analyst collaborates closely with the LNG Trading team to discover profitable trading opportunities and enhance portfolio performance. This role involves gathering and analyzing market and economic data to produce comprehensive reports and assess the risks linked to trading transactions. The analyst presents market insights to clients and coordinates with stakeholders to facilitate hedging strategies. Operating in a fast-moving and challenging environment, the analyst must deliver precise research and data analyses to aid deal execution. Candidates should be analytical, proactive, confident with numerical data, and capable of working effectively under tight deadlines.</code> | <code>The Renewable Energy Project Coordinator manages the planning and execution of solar and wind energy initiatives within the energy sector. This position requires coordinating with multiple vendors and regulatory bodies, overseeing project timelines, and ensuring compliance with environmental standards. The coordinator communicates progress updates to stakeholders and resolves logistical challenges to keep projects on track. Strong organizational skills, experience in project management, and the ability to navigate regulatory frameworks are essential. This role focuses on operational delivery rather than market research or trading analysis.</code> |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim",
+      "gather_across_devices": false
+  }
+  ```
+
+### Evaluation Dataset
+
+#### ssf-train-valid-v2
+
+* Dataset: [ssf-train-valid-v2](https://huggingface.co/datasets/dnth/ssf-train-valid-v2) at [fb19ed3](https://huggingface.co/datasets/dnth/ssf-train-valid-v2/tree/fb19ed3200e91badb0cb224e0debe909f1d7c2bd)
+* Size: 754 evaluation samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 754 samples:
+  |         | anchor                                                                               | positive                                                                             | negative                                                                            |
+  |:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                               | string                                                                              |
+  | details | <ul><li>min: 58 tokens</li><li>mean: 166.89 tokens</li><li>max: 347 tokens</li></ul> | <ul><li>min: 58 tokens</li><li>mean: 136.23 tokens</li><li>max: 256 tokens</li></ul> | <ul><li>min: 19 tokens</li><li>mean: 99.02 tokens</li><li>max: 202 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The Head of Client Implementation is responsible for driving strategic relationship building activities and ensuring client implementation plans are carried out at standards that are satisfactory to clients. He/She oversees the team's compliance with implementation policies and regulations when executing tasks during implementation, often collaborating with relevant internal teams for the successful design and delivery of client implementation plans. The Head of Client Implementation possesses strong leadership, interpersonal and teamwork skills. His work environment is highly diverse and evolves based on clients' requirements and needs. He is flexible to change and has quick problem-solving skills.</code>                                                                                                                                                                                                                                                                                                        | <code>The Head of Client Implementation leads the strategic development of client relationships and ensures that implementation projects meet client expectations and quality standards. This role supervises the team's adherence to implementation guidelines and regulatory requirements, coordinating closely with internal departments to design and deliver effective client onboarding plans. The Head of Client Implementation demonstrates strong leadership, excellent communication, and teamwork abilities. Working in a dynamic and multicultural environment, this individual adapts swiftly to changing client demands and efficiently resolves challenges.</code>                                                                                                                                                                                                                                                                                                                                                                        | <code>The Project Manager in Client Services focuses on managing project timelines and resource allocation within the client support division. Instead of overseeing implementation strategies, this role emphasizes coordinating operational activities and ensuring service delivery efficiency. The Project Manager requires strong organizational and planning skills and works under a structured reporting hierarchy, primarily handling routine client service requests rather than strategic relationship management.</code> |
+  | <code>The Set Designer executes the realisation of the overall visual aspects of the production by conceptualising the set design or locations for film, video or a concept based on the script and the overall visual concept. He/She is responsible for studying scripts and interpreting the descriptions of locations, creating sketches and drawings, translating these into technical drawings and models for sets to be built or locations to be identified and prepared. He lays out a comprehensive set of requirements for the materials needed for set design. He oversees the right look or feel for a production and ensure that other areas of technical production such as lighting or sound recording are aligned with the set. He also identifies and commissions set construction vendors. He prepares cost estimates for set design and construction and manages project schedule of his team. He oversees the construction of set and ensures that the sets evoke the intended style, mood and theme. He/She may specialis...</code> | <code>The Set Designer is responsible for bringing the visual concept of a production to life by designing and coordinating the physical environment for film, video, or other visual media based on the script and overall artistic direction. This role involves analyzing scripts to interpret location and set requirements, producing sketches and detailed technical drawings, and developing models for set construction or location preparation. The Set Designer specifies material needs, supervises the aesthetic alignment of the set with lighting and sound departments, and manages relationships with construction vendors. They prepare cost estimates, oversee project timelines, and ensure sets reflect the intended mood, style, and theme. Specialization in set decoration or prop management may be required, with responsibilities including the artistic selection and upkeep of props. The role demands creativity, strong coordination with other technical teams, proficiency in design techniques and fabricatio...</code> | <code>The Set Designer manages the logistical planning and operational execution of event setups, coordinating venue layouts and technical support for conferences, exhibitions, and corporate functions. Responsible for assessing client requirements, preparing floor plans, and directing the installation of audio-visual equipment and staging, the Set Designer ensures all elements align with event objectives and branding guidelines. They oversee vendor</code>                                                          |
+  | <code>The Senior Producer/Producer - News is responsible for managing the daily news agenda, overall news content and flow of a newscast. He/She has an overview of the agendas being pursued and looks out for newsworthy stories that will attract and engage target audience. He manages the resourcing of news content and is responsible for assigning news stories to internal teams. He is also required to edit scripts and reports that are submitted for the newscast and ensure that editorial guidelines and policies set by the organisation are adhered to. He is in charge of maintaining the newscast's presence and image on social media platforms and monitors the competitors' activities and trends. In addition, he collaborates with the production teams to ensure continuity of content across different programmes throughout the day. He typically works in a newsroom but may be assigned field activities at times. He should be able to adapt quickly to changes and perform well in a dynamic environment. He s...</code> | <code>The Senior Producer/Producer - News oversees the daily planning and execution of news broadcasts, ensuring the seamless flow and compelling content throughout the newscast. This role involves identifying and prioritizing news stories that resonate with the target audience while managing the allocation of editorial resources across teams. The incumbent reviews and refines scripts and reports to guarantee compliance with the organization’s editorial policies. Additionally, this position maintains the newscast’s brand presence on social media channels and keeps abreast of competitor activities and industry trends. Collaboration with production units is essential to maintain content consistency across multiple programs during the broadcast day. Operating primarily within a newsroom environment, the Senior Producer/Producer must be adaptable to fast-paced changes and possess solid knowledge of both local and global current events. Experience with production technology such as cameras, audio...</code> | <code>The Marketing Coordinator - News Media is responsible for planning and executing marketing campaigns to promote news programming across various digital platforms. This role focuses on developing brand awareness strategies, managing advertising budgets, and coordinating with external agencies for content creation and distribution. The incumbent monitors market trends and audience analytics to optimize campaign performance but does not</code>                                                                   |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim",
+      "gather_across_devices": false
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `eval_strategy`: epoch
+- `per_device_train_batch_size`: 32
+- `per_device_eval_batch_size`: 16
+- `gradient_accumulation_steps`: 16
+- `learning_rate`: 2e-05
+- `num_train_epochs`: 5
+- `lr_scheduler_type`: cosine
+- `warmup_ratio`: 0.1
+- `bf16`: True
+- `tf32`: False
+- `load_best_model_at_end`: True
+- `batch_sampler`: no_duplicates
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: epoch
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 32
+- `per_device_eval_batch_size`: 16
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 16
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 2e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1.0
+- `num_train_epochs`: 5
+- `max_steps`: -1
+- `lr_scheduler_type`: cosine
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.1
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: True
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: False
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: True
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch_fused
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `hub_revision`: None
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `liger_kernel_config`: None
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: no_duplicates
+- `multi_dataset_batch_sampler`: proportional
+- `router_mapping`: {}
+- `learning_rate_mapping`: {}
+
+</details>
+
+### Training Logs
+| Epoch   | Step   | Training Loss | Validation Loss |
+|:-------:|:------:|:-------------:|:---------------:|
+| 1.0     | 6      | 0.1487        | 0.0112          |
+| 2.0     | 12     | 0.0095        | 0.0037          |
+| 3.0     | 18     | 0.0047        | 0.0026          |
+| 4.0     | 24     | 0.0041        | 0.0023          |
+| **5.0** | **30** | **0.0032**    | **0.0022**      |
+
+* The bold row denotes the saved checkpoint.
+
+### Framework Versions
+- Python: 3.12.8
+- Sentence Transformers: 5.1.0
+- Transformers: 4.55.0
+- PyTorch: 2.8.0+cu128
+- Accelerate: 1.10.0
+- Datasets: 4.0.0
+- Tokenizers: 0.21.4
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+#### MultipleNegativesRankingLoss
+```bibtex
+@misc{henderson2017efficient,
+    title={Efficient Natural Language Response Suggestion for Smart Reply},
+    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
+    year={2017},
+    eprint={1705.00652},
+    archivePrefix={arXiv},
+    primaryClass={cs.CL}
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -0,0 +1,45 @@
+{
+  "architectures": [
+    "ModernBertModel"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 50281,
+  "classifier_activation": "gelu",
+  "classifier_bias": false,
+  "classifier_dropout": 0.0,
+  "classifier_pooling": "mean",
+  "cls_token_id": 50281,
+  "decoder_bias": true,
+  "deterministic_flash_attn": false,
+  "embedding_dropout": 0.0,
+  "eos_token_id": 50282,
+  "global_attn_every_n_layers": 3,
+  "global_rope_theta": 160000.0,
+  "gradient_checkpointing": false,
+  "hidden_activation": "gelu",
+  "hidden_size": 768,
+  "initializer_cutoff_factor": 2.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 1152,
+  "layer_norm_eps": 1e-05,
+  "local_attention": 128,
+  "local_rope_theta": 10000.0,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "mlp_dropout": 0.0,
+  "model_type": "modernbert",
+  "norm_bias": false,
+  "norm_eps": 1e-05,
+  "num_attention_heads": 12,
+  "num_hidden_layers": 22,
+  "pad_token_id": 50283,
+  "position_embedding_type": "absolute",
+  "repad_logits_with_grad": false,
+  "sep_token_id": 50282,
+  "sparse_pred_ignore_index": -100,
+  "sparse_prediction": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.55.0",
+  "vocab_size": 50368
+}

config_sentence_transformers.json

@@ -0,0 +1,14 @@
+{
+  "__version__": {
+    "sentence_transformers": "5.1.0",
+    "transformers": "4.55.0",
+    "pytorch": "2.8.0+cu128"
+  },
+  "prompts": {
+    "query": "",
+    "document": ""
+  },
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine",
+  "model_type": "SentenceTransformer"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3ac0bd0f9732c50703ab44f7523255a5f3af314abc9c63b0e3506f1d0c33e206
+size 596070136

modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.models.Normalize"
+  }
+]

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+    "max_seq_length": 8192,
+    "do_lower_case": false
+}

special_tokens_map.json

@@ -0,0 +1,37 @@
+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": true,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,945 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "|||IP_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "1": {
+      "content": "<|padding|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50254": {
+      "content": "                        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50255": {
+      "content": "                       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50256": {
+      "content": "                      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50257": {
+      "content": "                     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50258": {
+      "content": "                    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50259": {
+      "content": "                   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50260": {
+      "content": "                  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50261": {
+      "content": "                 ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50262": {
+      "content": "                ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50263": {
+      "content": "               ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50264": {
+      "content": "              ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50265": {
+      "content": "             ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50266": {
+      "content": "            ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50267": {
+      "content": "           ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50268": {
+      "content": "          ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50269": {
+      "content": "         ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50270": {
+      "content": "        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50271": {
+      "content": "       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50272": {
+      "content": "      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50273": {
+      "content": "     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50274": {
+      "content": "    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50275": {
+      "content": "   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50276": {
+      "content": "  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50277": {
+      "content": "|||EMAIL_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50278": {
+      "content": "|||PHONE_NUMBER|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50279": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50280": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50281": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50282": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50283": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50284": {
+      "content": "[MASK]",
+      "lstrip": true,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50285": {
+      "content": "[unused0]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50286": {
+      "content": "[unused1]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50287": {
+      "content": "[unused2]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50288": {
+      "content": "[unused3]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50289": {
+      "content": "[unused4]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50290": {
+      "content": "[unused5]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50291": {
+      "content": "[unused6]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50292": {
+      "content": "[unused7]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50293": {
+      "content": "[unused8]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50294": {
+      "content": "[unused9]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50295": {
+      "content": "[unused10]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50296": {
+      "content": "[unused11]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50297": {
+      "content": "[unused12]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50298": {
+      "content": "[unused13]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50299": {
+      "content": "[unused14]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50300": {
+      "content": "[unused15]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50301": {
+      "content": "[unused16]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50302": {
+      "content": "[unused17]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50303": {
+      "content": "[unused18]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50304": {
+      "content": "[unused19]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50305": {
+      "content": "[unused20]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50306": {
+      "content": "[unused21]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50307": {
+      "content": "[unused22]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50308": {
+      "content": "[unused23]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50309": {
+      "content": "[unused24]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50310": {
+      "content": "[unused25]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50311": {
+      "content": "[unused26]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50312": {
+      "content": "[unused27]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50313": {
+      "content": "[unused28]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50314": {
+      "content": "[unused29]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50315": {
+      "content": "[unused30]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50316": {
+      "content": "[unused31]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50317": {
+      "content": "[unused32]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50318": {
+      "content": "[unused33]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50319": {
+      "content": "[unused34]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50320": {
+      "content": "[unused35]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50321": {
+      "content": "[unused36]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50322": {
+      "content": "[unused37]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50323": {
+      "content": "[unused38]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50324": {
+      "content": "[unused39]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50325": {
+      "content": "[unused40]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50326": {
+      "content": "[unused41]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50327": {
+      "content": "[unused42]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50328": {
+      "content": "[unused43]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50329": {
+      "content": "[unused44]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50330": {
+      "content": "[unused45]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50331": {
+      "content": "[unused46]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50332": {
+      "content": "[unused47]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50333": {
+      "content": "[unused48]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50334": {
+      "content": "[unused49]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50335": {
+      "content": "[unused50]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50336": {
+      "content": "[unused51]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50337": {
+      "content": "[unused52]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50338": {
+      "content": "[unused53]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50339": {
+      "content": "[unused54]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50340": {
+      "content": "[unused55]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50341": {
+      "content": "[unused56]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50342": {
+      "content": "[unused57]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50343": {
+      "content": "[unused58]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50344": {
+      "content": "[unused59]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50345": {
+      "content": "[unused60]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50346": {
+      "content": "[unused61]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50347": {
+      "content": "[unused62]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50348": {
+      "content": "[unused63]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50349": {
+      "content": "[unused64]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50350": {
+      "content": "[unused65]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50351": {
+      "content": "[unused66]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50352": {
+      "content": "[unused67]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50353": {
+      "content": "[unused68]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50354": {
+      "content": "[unused69]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50355": {
+      "content": "[unused70]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50356": {
+      "content": "[unused71]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50357": {
+      "content": "[unused72]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50358": {
+      "content": "[unused73]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50359": {
+      "content": "[unused74]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50360": {
+      "content": "[unused75]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50361": {
+      "content": "[unused76]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50362": {
+      "content": "[unused77]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50363": {
+      "content": "[unused78]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50364": {
+      "content": "[unused79]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50365": {
+      "content": "[unused80]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50366": {
+      "content": "[unused81]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50367": {
+      "content": "[unused82]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 8192,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": "[UNK]"
+}