modernbert-job-role-matcher

This is a sentence-transformers model finetuned from nomic-ai/modernbert-embed-base. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: nomic-ai/modernbert-embed-base
• Maximum Sequence Length: 8192 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Language: en
• License: apache-2.0

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False}) with Transformer model: ModernBertModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("dpravinv/modernbert-job-role-matcher")
# Run inference
sentences = [
    'Senior Aerospace Quality Control Engineer',
    "The Senior NDT Level 3 Engineer (Aircraft Maintenance) manages non-destructive testing (NDT) operations for assessing the quality of aircraft structures. He/She establishes new NDT techniques and qualifies new procedures. He drives compliance of all NDT inspections with the requirements of customers, original equipment manufacturer (OEM) and EN 4179, NAS 410, NADCAP as appropriate. He drives collaboration with workshops and engineering teams for failure investigations and recommends engineering solutions for structural flaws and defects. He develops special process control plans and manages equipment maintenance and operator certification programmes. He also monitors results of NDT for trends and corrective actions, and leads technical audits to ensure compliance with relevant standards and NDT requirements. He reviews compliance with airworthiness and legislative requirements, while proposing enhancements to the organisation's standard operating procedures (SOPs), and safety, health and quality systems. He proactively contributes to the development of lean and sustainability practices, and conducts research and digital innovation in NDT for continuous process improvements. As a team leader, he appraises staff performance and conducts coaching and training for level 1 and level 2 NDT personnel. He is able to work cross-functionally, employing critical reasoning, analytical thinking and problem-solving skills to identify deviations and mitigate potential quality risks in aircraft maintenance processes.",
    'The Automation Coordinator/Robot Coordinator oversees automated equipment and robots used in manufacturing processes. He/She is the primary responder, responsible for troubleshooting automated production systems and performing preventive and predictive maintenance on equipment. He also contributes to process optimisation by managing data from automated manufacturing systems to facilitate real-time insight gathering and decision-making.\n\nHe may be required to work on rotating shifts in a factory setting, and under strict compliance to workplace safety and health requirements, organisational quality control and other parameters.\n\nHe is able to work independently, and as part of a team, to achieve production and quality targets, and interact effectively with others to ensure that all issues are resolved appropriately and efficiently.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Evaluation

Metrics

Triplet

• Evaluated with TripletEvaluator

Metric	Value
cosine_accuracy	0.98

Training Details

Training Dataset

Unnamed Dataset

• Size: 800 training samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 800 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 4 tokens mean: 6.82 tokens max: 14 tokens	min: 73 tokens mean: 180.48 tokens max: 380 tokens	min: 73 tokens mean: 181.7 tokens max: 380 tokens

• Samples:

  anchor	positive	negative
  Port Vessel Navigator	The Helmsman manoeuvres and handles boats or crafts operating within the Port Limit of Singapore Territorial Waters. He/She is able to use the craft's navigational, fire-fighting and safety equipment and appreciate weather conditions, tides and tidal currents. He also performs basic chartwork, monitors and anticipates potential problems that may arise during daily operations and alerts the relevant authorities to them. He must pass a colour vision test and fulfil the requirements of the Port Limit Helmsman Licence issued by the Maritime and Port Authority of Singapore (MPA).	The Associate Counsellor assists in providing counselling services and support to individuals and families experiencing socioemotional and mental health challenges. This includes case management for cases of low complexity and risk and provision of clinical services through various modes of counselling such as face-to-face or online counselling and group work.He/She may also support department research through data collection and coordinate internal and external training/programmes. A patient and compassionate professional, the Associate Counsellor works in diverse settings across social services, including care homes, educational institutes, family service centres and healthcare facilities. He works under supervision as part of a collaborative team.
  Room Reservations Manager	The Reservations Executive/Reservations Supervisor is responsible for supervising the operations of the department in selling rooms and managing room inventory to maximise sales. He/She ensures that all guest requests, concerns and feedback relating to rooms reservations are addressed in a timely and professional manner and collaborates with relevant departments on booking requirements and special guest requests to provide a seamless guest experience. He performs checks to ensure the accuracy of reservation bookings and records, keeps track of room availability and inventory, monitors room sales and occupancy levels and analyses reservations forecast to maximise the property's occupancy potential. He assists to meet monthly revenue targets by identifying new contacts and proposing promotional packages to increase room sales and revenue. He is also responsible for monitoring the team's compliance with the property's policies and procedures for reservations operations. He guides and coa...	The Membership Director/Assistant Director assumes overall responsibility in driving member attraction, recruitment and retention. He/she develops membership development and engagement strategies with the support of member research. He works with multiple stakeholders to advocate for member needs and interests to the relevant government agencies. He also oversees the execution and delivery of membership activities and events. The Membership Director/Assistant Director is highly driven, detail-oriented and strategic in handling all aspects of member relations. He is articulate and has excellent communication and people management skills to develop and maintain strong relationships among various stakeholders. He is able to multi-task and rally his team to deliver excellent membership experiences.
  Quality Assurance Engineer	The Quality Engineer identifies user requirements and expectations to inform quality standards for end-products, and analyses product development processes to identify relevant quality standards. He/She incorporates relevant and suitable international standards into product development processes, quality standards and testing processes. He identifies quality-testing types and variations based on business needs and requirements and develops testing processes. He identifies suitable measures of quality for testing and contributes to the development of test scenarios and plans. He conducts various quality tests, and analyses data to identify operating and usage conditions in which performance of quality measures starts to decline. He also automates quality testing for applicable and suitable tests. He works in a team setting and is proficient in programming languages required by the organisation. He is familiar with international quality standards, and uses test automation frameworks and...	The Industry Development Director/Assistant Director plays a key role in collaborating with key government agencies and other organisations to drive industry development and transformation. He/she collaborates with multiple stakeholders to represent the industry needs and interests at relevant platforms. He drives industry innovation and adoption of technology, and oversees the execution and delivery of local industry projects and initiatives. He also builds effective relationships with strategic partners and stakeholders to identify growth opportunities for the industry.The Industry Development Director/Assistant Director is an effective communicator and presenter, able to develop strong working relationships with relevant stakeholders and strategic partners. He has good listening skills and is analytical and professional in addressing the concerns of the industry. He is forward-looking, able to set out a clear strategic direction and inspire the team towards achieving desired outcome...

• Loss: TripletLoss with these parameters:

  {
      "distance_metric": "TripletDistanceMetric.EUCLIDEAN",
      "triplet_margin": 5
  }
  

Evaluation Dataset

Unnamed Dataset

• Size: 200 evaluation samples
• Columns: anchor, positive, and negative
• Approximate statistics based on the first 200 samples:

  	anchor	positive	negative
  type	string	string	string
  details	min: 4 tokens mean: 6.95 tokens max: 12 tokens	min: 73 tokens mean: 178.67 tokens max: 313 tokens	min: 73 tokens mean: 173.81 tokens max: 380 tokens

• Samples:

  anchor	positive	negative
  Room Sales Coordinator	The Reservations Executive/Reservations Supervisor is responsible for supervising the operations of the department in selling rooms and managing room inventory to maximise sales. He/She ensures that all guest requests, concerns and feedback relating to rooms reservations are addressed in a timely and professional manner and collaborates with relevant departments on booking requirements and special guest requests to provide a seamless guest experience. He performs checks to ensure the accuracy of reservation bookings and records, keeps track of room availability and inventory, monitors room sales and occupancy levels and analyses reservations forecast to maximise the property's occupancy potential. He assists to meet monthly revenue targets by identifying new contacts and proposing promotional packages to increase room sales and revenue. He is also responsible for monitoring the team's compliance with the property's policies and procedures for reservations operations. He guides and coa...	The Technician supports the team to perform routine bus servicing and preventive corrective maintenance activities. His/Her duties include preparation of work activities, perform assigned servicing and maintenance tasks of different bus sub-systems, perform general housekeeping of workshop tools and equipment as well as adheres to Workplace Safety and Health (WSH) procedures. He may be deployed to support on-the-road bus breakdown assistance and recovery. He is required to work in the bus workshop and/or depot environment based on rotating shifts. He is able to interact effectively with others when carrying out his duties and has the opportunity to gain experience, knowledge as well as deepen his technical and maintenance skills on various bus sub-systems.
  Data Compliance Officer	The Data Protection Officer executes data governance policies and procedures. He/She ensures the Data Protection Act is implemented and enforced in the organisation, and amongst the respective teams and users. He collaborates with business and project teams in projects and ensures alignment and compliance with the organisation's data protection guidelines and policies, and with industry standards and guidelines. He also directs a team of professionals and third-party vendors or service providers to achieve organisational goals in accordance with the data governance and data protection policies. He manages risks and data breach incidents. The Data Protection Officer is knowledgeable in areas of data governance, compliance and data protection policies and frameworks, and works within and across teams to mitigate data breaches. He is expected to be proficient in the requirements under the Personal Data Protection Act 2012. The Data Protection Officer adopts a broad and global perspective ...	The Senior Process Safety Engineer provides technical advice and guidance on process safety-related activities. He/She leads the implementation of the Process Safety Management (PSM) framework in the organisation, and reviews plant safeguarding system requirements to ensure compliance with process safety standards. In addition, he provides technical input for the development and maintenance of the organisations Major Hazard Installation (MHI) Safety Case. The Senior Process Safety Engineer administers the Workplace Safety and Health (WSH) and Environmental Management Systems (EMS) by advising on the development and improvement of Safe System of Work (SSoW) frameworks, and by ensuring proper closure of process safety incident investigations and their notification to relevant authorities. He provides support and advice for asset integrity assurance and compliance, and leads process safety reviews during new projects. In addition, he contributes to staff capability development by coachin...
  Maritime Craft Handler	The Helmsman manoeuvres and handles boats or crafts operating within the Port Limit of Singapore Territorial Waters. He/She is able to use the craft's navigational, fire-fighting and safety equipment and appreciate weather conditions, tides and tidal currents. He also performs basic chartwork, monitors and anticipates potential problems that may arise during daily operations and alerts the relevant authorities to them. He must pass a colour vision test and fulfil the requirements of the Port Limit Helmsman Licence issued by the Maritime and Port Authority of Singapore (MPA).	The Head of Design strategises the design and development of the product line lifecycle, including the end-to-end iterative design process. He/She establishes design policy principles to drive product development in the conceptualisation and design phase, including endorsement of design strategies, and achieving design solutions based on insights researched by the team He provides insightful directives based on the evaluation of design concepts and drawings by the team to determine the best product and ensure that it is aligned to the latest market trends. He has a strong understanding on how product technologies and frameworks can formulate impactful design concepts, is well-versed in product development lifecycles and stays abreast of the latest emerging industry trends in terms of product design. The Head of Design adopts a global mindset while distilling market trends to incorporate them into novel product design strategies, with a clear view of how this sits within the product ...

• Loss: TripletLoss with these parameters:

  {
      "distance_metric": "TripletDistanceMetric.EUCLIDEAN",
      "triplet_margin": 5
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: epoch
• per_device_train_batch_size: 4
• per_device_eval_batch_size: 4
• gradient_accumulation_steps: 4
• learning_rate: 2e-05
• lr_scheduler_type: cosine
• warmup_ratio: 0.1
• load_best_model_at_end: True
• batch_sampler: no_duplicates

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: epoch
• prediction_loss_only: True
• per_device_train_batch_size: 4
• per_device_eval_batch_size: 4
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 4
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 2e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 3
• max_steps: -1
• lr_scheduler_type: cosine
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.1
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: True
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: None
• hub_always_push: False
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• dispatch_batches: None
• split_batches: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• eval_use_gather_object: False
• average_tokens_across_devices: False
• prompts: None
• batch_sampler: no_duplicates
• multi_dataset_batch_sampler: proportional

Training Logs

Epoch	Step	Training Loss	Validation Loss	cosine_accuracy
1.0	50	-	4.3018	0.9800
2.0	100	4.3737	4.1720	0.9850
3.0	150	-	4.1523	0.98

• The bold row denotes the saved checkpoint.

Framework Versions

• Python: 3.12.6
• Sentence Transformers: 4.1.0
• Transformers: 4.48.0.dev0
• PyTorch: 2.6.0+cu124
• Accelerate: 1.2.1
• Datasets: 3.1.0
• Tokenizers: 0.21.0

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

TripletLoss

@misc{hermans2017defense,
    title={In Defense of the Triplet Loss for Person Re-Identification},
    author={Alexander Hermans and Lucas Beyer and Bastian Leibe},
    year={2017},
    eprint={1703.07737},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}