Fatin757/ssf-retriever-modernber-dataset-2

SentenceTransformer based on answerdotai/ModernBERT-base

This is a sentence-transformers model finetuned from answerdotai/ModernBERT-base on the ssf-train-valid_v2 dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: answerdotai/ModernBERT-base
• Maximum Sequence Length: 8192 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • ssf-train-valid_v2

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("Fatin757/ssf-retriever-modernber-dataset-2")
# Run inference
sentences = [
    'The Operation Specialist supports plant operations by coordinating day-to-day production activities, as well as maintenance and turnaround schedules and activities, for production shift teams, so as to meet production plans and schedules. He/She supports the Site Incident Controller (SIC) during emergency response situations. The Operation Specialist contributes to plant operation improvements by working closely with the production, process engineering and discipline engineering teams to define and execute plant improvement projects, and by reviewing Standard Operating Procedures (SOPs) for the process area under his charge. He also supports the implementation of the Process Safety Management (PSM) framework for production activities, and ensures compliance with Workplace Safety and Health (WSH) and Environmental Management System (EMS) requirements across production teams. The Operation Specialist may work on either a rotating or day shift in the field. He works closely with other departments, is able to work independently, and possesses good problem-solving, organisational, communication and interpersonal skills.',
    'The Production Coordinator plays a vital role in ensuring efficient plant operations by managing daily production tasks, maintenance schedules, and turnaround activities for production teams to achieve production targets. This position involves assisting the Site Incident Controller (SIC) during emergency situations, ensuring a swift and effective response. The Production Coordinator actively participates in enhancing operational efficiency by collaborating with production, process engineering, and discipline engineering teams to identify and implement improvement projects. Additionally, he/she reviews and updates Standard Operating Procedures (SOPs) for the assigned process area. The role also includes supporting the implementation of the Process Safety Management (PSM) framework for production tasks, and ensuring adherence to Workplace Safety and Health (WSH) and Environmental Management System (EMS) regulations across production teams. The Production Coordinator may work on a rotating or day shift in the field and is expected to collaborate effectively with other departments while demonstrating strong problem-solving, organizational, communication, and interpersonal skills.',
    'The Operations Manager oversees the daily activities of the logistics department by coordinating shipment schedules, inventory management, and transportation logistics to meet delivery timelines. This role includes assisting the Logistics Incident Controller (LIC) during crisis situations, ensuring effective management of logistics operations. The Operations Manager contributes to logistics optimization by working closely with supply chain, inventory control, and transportation teams to identify and execute improvement initiatives. He/She is responsible for reviewing operational procedures for the logistics area. The position also involves supporting the implementation of the Safety Management System (SMS) for logistics operations and ensuring compliance with Transportation Safety and Health (TSH) and Environmental Compliance Standards (ECS) across logistics teams. The Operations Manager may work on a fixed or flexible schedule and is required to collaborate with various departments while demonstrating strong analytical, planning, communication, and teamwork abilities.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.8716, 0.1731],
#         [0.8716, 1.0000, 0.2580],
#         [0.1731, 0.2580, 1.0000]])

Training Details

Training Dataset

ssf-train-valid_v2

• Dataset: ssf-train-valid_v2 at a216be9
• Size: 6,032 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 57 tokens mean: 170.46 tokens max: 355 tokens	min: 70 tokens mean: 166.18 tokens max: 326 tokens	min: 60 tokens mean: 140.0 tokens max: 259 tokens

• Samples:

  anchor	positive	negative
  The Manager (Production/Catering-Cabin) leads collaborative efforts with other departments and airlines to review catering operations and ensure compliance with food hygiene and quality standards. He/She is responsible for driving continuous improvement and business development initiatives to improve productivity and meet customer needs. He develops Standard Operating Procedures (SOPs) and systems to mitigate safety and/or security risks and oversees adherence to safety and/or security standards. He also develops the teams technical capabilities through coaching and maintains positive morale within the teams. The Manager (Production/Catering-Cabin) has an in-depth knowledge of supply chain operations, food handling and production processes in the airline industry. He also possesses remarkable interpersonal and stakeholder management skills to build and maintain relationships with internal and external stakeholders. In addition, he has strong communication and people management skills t...	The Catering Operations Manager is responsible for leading cross-departmental collaborations with various airlines to enhance catering services while ensuring adherence to food safety and quality standards. This role focuses on fostering continuous improvement and spearheading business development initiatives aimed at increasing productivity and fulfilling customer expectations. The Catering Operations Manager formulates Standard Operating Procedures (SOPs) and implements systems designed to minimize safety and security risks, ensuring compliance with established safety protocols. In addition, this manager plays a crucial role in developing the technical skills of the team through effective coaching, while also nurturing a positive team environment. A strong understanding of supply chain operations and food production processes within the airline sector is essential. The ideal candidate will demonstrate exceptional interpersonal and stakeholder management abilities to cultivate and sus...	The Junior Marketing Coordinator is tasked with supporting the marketing team in executing promotional campaigns and managing social media content. This role involves assisting in the development of marketing materials and conducting market research to understand consumer behavior. The Junior Marketing Coordinator will help organize events and track marketing performance metrics, ensuring that all activities align with the company's branding strategies. Strong attention to detail and basic project management skills are required, along with the ability to collaborate with various departments to enhance overall marketing efforts. The candidate should possess good communication skills and a willingness to learn about the marketing landscape, while being able to adapt to the fast-paced environment of the retail industry.
  The Internal Audit Senior Manager/Internal Audit Manager determines objectives and scope of internal audit engagements based on risk assessments, staff and other resources. He/She supervises internal audit activities with the use of new and emerging technological tools to achieve intended objectives. The Internal Audit Senior Manager/Internal Audit Manager evaluates potential impact of changes and infocomm technology (IT) developments on business, and reviews business insights to focus on value-added opportunities or high-risk areas. He also identifies opportunities to leverage data analytics and business intelligence tools and methods to obtain business insights for enhancing organisational value. The Internal Audit Senior Manager/Internal Audit Manager is efficient and objective in executing his tasks and is a trustworthy leader in the organisation. He exercises due professional care in his work and manages the team to apply and conform to these standards.	The Senior Internal Audit Manager is responsible for establishing the objectives and scope of internal audit engagements by conducting thorough risk assessments and utilizing available staff and resources effectively. This role involves overseeing internal audit activities while integrating new technological advancements to meet the desired outcomes. The Senior Internal Audit Manager assesses the implications of changes and developments in information and communication technology (ICT) on the organization, while also analyzing business insights to identify value-added opportunities and high-risk areas. Furthermore, this individual seeks to harness data analytics and business intelligence tools to derive actionable insights that enhance organizational value. As a dedicated and trustworthy leader, the Senior Internal Audit Manager demonstrates efficiency and objectivity in executing tasks, ensuring that the team adheres to professional standards and practices.	The Senior Internal Audit Manager is tasked with defining the objectives and scope of external audit engagements through comprehensive risk evaluations and optimal allocation of resources. This position supervises external audit functions while incorporating innovative technological solutions to fulfill the intended goals. The Senior Internal Audit Manager analyzes the effects of regulatory changes and technological advancements in the marketplace, focusing on identifying compliance risks and operational efficiencies. Additionally, this role emphasizes the use of data analytics and business intelligence techniques to gather insights for improving compliance and operational processes. As a reliable leader, the Senior Internal Audit Manager maintains a high level of professionalism and ensures that the team follows established auditing standards and protocols.
  The Compliance Advisory Executive is responsible for supporting the provision of compliance-related advisory to organisational stakeholders. He/She supports the maintenance of compliance frameworks by keeping abreast of developments in industry regulations and trends to ensure appropriate coverage. He liaises with stakeholders to communicate current, new and changing compliance and regulatory matters and how they link to the organisation's context. He supports the conduct of training, and development of communication material, to allow for the practice and maintenance of compliance within the organisation. The Compliance Advisory Executive is familiar with local and international compliance and regulatory issues within the financial services industry. He is self-driven and comfortable working towards deadlines and executing tasks independently. He is detail-oriented, resourceful and a strong communicator. He is ethical in practice and possesses a strong sense of integrity.	The Compliance Advisory Specialist plays a crucial role in delivering compliance-related guidance to various stakeholders within the organization. This position involves maintaining and enhancing compliance frameworks by staying informed about the latest developments in industry regulations and trends to ensure comprehensive coverage. The specialist collaborates with stakeholders to effectively communicate current, emerging, and changing compliance and regulatory issues, linking them to the organizational context. Additionally, the role includes facilitating training sessions and creating communication materials to promote and uphold compliance practices throughout the organization. The Compliance Advisory Specialist is well-versed in both local and international compliance and regulatory matters within the financial services sector. This individual is proactive, capable of meeting deadlines, and adept at working independently. They exhibit strong attention to detail, resourcefulness, ...	The Compliance Analyst is tasked with reviewing and monitoring compliance-related activities within the organization. This role focuses on assessing compliance with internal policies and procedures rather than providing advisory support. The analyst works closely with various departments to gather data and prepare reports on compliance metrics, but does not engage in stakeholder communication regarding regulatory changes. Instead, the position emphasizes the analysis of compliance data and the identification of areas for improvement. Training facilitation is not a part of this role; rather, the analyst is responsible for ensuring that compliance documentation is accurate and up-to-date. The Compliance Analyst is knowledgeable about compliance issues but is primarily focused on data analysis rather than advisory functions. This position requires attention to detail and the ability to work under pressure, but it does not involve the broader strategic oversight typical of advisory roles.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim",
      "gather_across_devices": false
  }
  

Evaluation Dataset

ssf-train-valid_v2

• Dataset: ssf-train-valid_v2 at a216be9
• Size: 1,508 evaluation samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 57 tokens mean: 168.98 tokens max: 380 tokens	min: 66 tokens mean: 164.87 tokens max: 331 tokens	min: 55 tokens mean: 140.43 tokens max: 291 tokens

• Samples:

  anchor	positive	negative
  The Brand Executive/Customer Loyalty Executive implements plans and initiatives relating to the brand, customer experience and loyalty in order to drive the organisations brand equity. He/she is also responsible for conducting market research activities to forecast emerging market needs that are relevant for the organisation. He works in a fast-paced and dynamic environment where he ensures compliance of the brand identity throughout the organisation. He is a meticulous, energetic, collaborative and people-oriented individual. He is a fast and independent learner who is able to effectively multi-task effectively.	The Brand Development Specialist is tasked with executing strategies and initiatives that enhance the brand, customer experience, and loyalty to elevate the organization’s brand equity. This role involves conducting comprehensive market research to identify and anticipate emerging market trends that align with the organization’s objectives. Working in a vibrant and dynamic environment, the specialist ensures adherence to brand identity standards across all departments. The ideal candidate is detail-oriented, enthusiastic, collaborative, and possesses strong interpersonal skills. Additionally, they are quick learners who can manage multiple tasks efficiently.	The Customer Service Coordinator is responsible for managing day-to-day customer interactions and ensuring high levels of customer satisfaction. This role involves gathering feedback from customers to improve service delivery and implementing solutions to enhance the customer experience. The coordinator works in a busy environment where they focus on maintaining customer service standards and compliance with company policies. The successful candidate should be organized, proactive, and able to work well with team members. They must also be adept at handling multiple inquiries simultaneously, though the focus is primarily on service rather than brand strategy.
  The 1st Assistant Cameraman/Focus Puller supports the shooting operations for various types of camera equipment including specialty cameras. He/She is responsible for maintaining focus between the lens and subjects. He does this by setting up a complex set of indicators placed on the set, floor or props during rehearsal. He collaborates with various production teams to ensure a consistent focus during the shoot. In addition to focus pulling for the camera operator, he manages and maintains the camera equipment such as lenses, filters and camera boxes for assembling the camera and its accessories for different shots. Before shooting, he arrives on the set early to ensure that the camera and all the required lenses are prepared for a day's shoot. At the end of each day, he resolves the problems with the 'rushes' and liaises with the film lab to rectify any faults with the camera or film stock. He then proceeds to clean the equipment and pack it up in preparation for the next day's shoot....	The Camera Assistant/Focus Puller plays a vital role in supporting the filming process by managing various types of camera equipment, including specialized cameras. This position involves ensuring precise focus between the lens and the subjects by setting up a detailed array of indicators on set, the floor, or props during rehearsals. The Camera Assistant collaborates closely with production teams to maintain consistent focus throughout the shooting. Besides focus pulling for the camera operator, this role includes the management and upkeep of camera gear, such as lenses, filters, and camera boxes, to facilitate the assembly of the camera and its accessories for different shots. Arriving early on set, the Camera Assistant ensures that the camera and all necessary lenses are ready for the day's filming. At day’s end, they address any issues with the rushes and coordinate with the film lab to fix any camera or film stock problems. Following this, they clean the equipment and prepare it f...	The Camera Technician/Focus Specialist is responsible for overseeing the maintenance and operation of various camera equipment used in live events and presentations. This role involves ensuring that the focus is accurately set between the lens and the audience by implementing a series of visual indicators on stage or around the venue. The Camera Technician collaborates with event production teams to guarantee that the visual quality remains consistent throughout the event. In addition to focus adjustments for the lead technician, this position includes the upkeep of audiovisual equipment, such as projectors, screens, and sound systems, to ensure seamless presentations. Arriving early at the venue, the Camera Technician ensures that all equipment and necessary components are set up and functioning before the event begins. After the event concludes, they troubleshoot any issues with the recordings and work with technical support to resolve any equipment malfunctions. They also clean and ...
  The Chief Engineer/Senior Engineering Manager (Rolling Stock) leads and facilitates the implementation of rolling stock maintenance regime within the organisation. He/She works closely with both internal and external stakeholders in implementing new initiatives and adopting new technologies to enhance rail reliability and maintainability. He demonstrates his technical expertise by providing advice to cross-disciplinary engineering studies, review enhancement initiatives and establishes competency standards and engineering standards to ensure staff are equipped with relevant skills. He has a strong understanding of the rail operational activities, industry developments and regulatory requirements, and maintains a forward-looking mindset to contribute strategically towards achieving the department's goals.	The Senior Rolling Stock Manager is responsible for overseeing the execution of maintenance strategies for the organization’s rolling stock fleet. This role involves collaborating with both internal teams and external partners to introduce innovative initiatives and integrate cutting-edge technologies aimed at improving the reliability and maintainability of rail operations. The Senior Rolling Stock Manager leverages their extensive technical knowledge to advise on interdisciplinary engineering projects, assess enhancement proposals, and develop competency frameworks and engineering standards to ensure that the team possesses the necessary skills. A deep understanding of rail operational processes, industry trends, and regulatory frameworks is essential, along with a proactive approach to strategically align with the department's objectives.	The Senior Operations Manager is responsible for managing the implementation of operational protocols within the organization. This position requires close collaboration with both internal teams and external vendors to roll out various initiatives and incorporate new technologies to improve service reliability and efficiency. The Senior Operations Manager utilizes their operational expertise to guide cross-functional teams, evaluate improvement proposals, and set operational benchmarks and performance standards to ensure staff are adequately trained. A solid grasp of operational activities, industry trends, and compliance requirements is crucial, along with a forward-thinking perspective to strategically support the organization's mission.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim",
      "gather_across_devices": false
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: epoch
• per_device_train_batch_size: 32
• per_device_eval_batch_size: 16
• num_train_epochs: 10
• lr_scheduler_type: cosine
• warmup_ratio: 0.1
• bf16: True
• load_best_model_at_end: True
• batch_sampler: no_duplicates

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: epoch
• prediction_loss_only: True
• per_device_train_batch_size: 32
• per_device_eval_batch_size: 16
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 10
• max_steps: -1
• lr_scheduler_type: cosine
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.1
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: True
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: True
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch_fused
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: False
• prompts: None
• batch_sampler: no_duplicates
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

Epoch	Step	Training Loss	Validation Loss
1.0	189	0.4399	0.0141
2.0	378	0.0098	0.0084
3.0	567	0.0054	0.0059
4.0	756	0.0028	0.0051
5.0	945	0.0026	0.0050
6.0	1134	0.0035	0.0042
7.0	1323	0.0011	0.0027
8.0	1512	0.0025	0.0028
9.0	1701	0.0008	0.0026
10.0	1890	0.0015	0.0026

• The bold row denotes the saved checkpoint.

Framework Versions

• Python: 3.12.11
• Sentence Transformers: 5.1.0
• Transformers: 4.56.1
• PyTorch: 2.8.0+cu128
• Accelerate: 1.10.0
• Datasets: 4.0.0
• Tokenizers: 0.22.0

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}