Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Paper • 1908.10084 • Published • 17
How to use son110904/gte-resume-match with sentence-transformers:
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("son110904/gte-resume-match", trust_remote_code=True)
sentences = [
"HR COORDINATOR Professional Summary Highly efficient Hr Coordinator well established in administrative environments that are fast-paced and challenging. Core Qualifications Exceptional interpersonal skills Innovative Microsoft Office Suite expert Human resources audits Maintains confidentiality Personnel records maintenance New hire orientation Applicant Tracking System EEO Reporting HRMS People-oriented Organized Exceptional communicator Recruiting Experience HR Coordinator , 09/2012 - Current Company Name - City , State ?Responsible for initiating, tracking and follow up of background checks and drug tests. ? First day on-board for new employee - first day documents, I-9 and tour of the building. ? Conducts exit interviews - relays info back to management. ? Routes positions for approval and posts requisitions to the company careers page and to outside job boards. ? Recruits for warehouse, driver and entry level to mid level positions using Kenexa BrassRing and sourcing resumes from online jobsites/databases. ? Run applicant flow logs from applicant tracking system, putting data into AA-EEO spreadsheet. ? Attends college career fairs to recruit potential interns and fill other positions as necessary. ? Initiates and leads Best Practices initiatives. ? Administrator for employee performance review program tool (Access database). ? Responsible for reviewing manager s submissions of employee performance reviews to ensure proper content and giving feedback to the manager. ? Maintains associate personnel files from filing and retention. ? Vouches department bills for payment. ? Other administrative duties as assigned. HR Coordinator , 06/2012 - 09/2012 Company Name - City , State Assignment at Edward Don Company, temp to hire. HR Coordinator , 08/2008 - 09/2011 Company Name - City , State ?Scheduled background checks and drug screens for candidates. ? Compiled and processed expense reports for candidates. ? Communicated with the Hiring Manager about the new hire s first day. ? Administered the new hire associate experience by scheduling their first day s HR session. These sessions included reviewing company policies, completing I-9 through E-verify, dispensed WOTC survey, explain direct deposit, encouraged self-identification (EEO) and demonstrated the company portal. ? Designed and prepared printed HR materials for new hires. ? Point person for SOX compliance for the HR Department. ? SAP Administration: ran requested reports, created requested reports and entered employee information. ? Planned and managed internal corporate events. Events included: Take Your Child to Work Day, Wellness Fairs, fund raisers, blood drives, lunch and learns and employee service recognition breakfasts. ? Edited and updated the HR Department s page on the portal using SharePoint software. ? Trained in CPR and first aid. ? Responded to injured associates and dispensed employee injury statement to injured associate. Receptionist , 02/2003 - 03/2008 Company Name - City , S",
"Human Resources Business Partner \n---------------------------------------- \nWe are seeking an experienced Human Resources Business Partner to serve as a strategic advisor to leadership teams while managing the full employee lifecycle. This role requires a dynamic professional who can balance strategic HR initiatives with hands-on operational support, fostering a positive workplace culture and driving organizational effectiveness. You will work closely with department heads to align HR strategies with business objectives, manage talent acquisition and retention programs, and ensure compliance with employment laws and regulations. The ideal candidate will have exceptional interpersonal skills, strong business acumen, and the ability to influence at all levels of the organization. \n---------------------------------------- \n Bachelor s degree in Human Resources, Business Administration, Psychology, or related field; Master s degree or MBA preferred \n Minimum 5-7 years of progressive HR experience with at least 3 years in a business partner or strategic HR role \n Professional HR certification such as SHRM-CP, SHRM-SCP, PHR, or SPHR strongly preferred \n Deep knowledge of employment law, HR best practices, and current trends in talent management and organizational development \n Proven experience managing full-cycle recruitment processes and building effective talent acquisition strategies \n Strong business acumen with ability to understand financial statements, business models, and organizational dynamics \n Exceptional interpersonal and communication skills with ability to build trust and influence stakeholders at all organizational levels \n Demonstrated experience with HRIS systems and HR analytics tools; proficiency in Microsoft Office Suite required \n Strong problem-solving and critical thinking abilities with a solutions-oriented mindset \n Ability to handle sensitive and confidential information with discretion and maintain high ethical standards \n Experience leading c",
"Senior Tax Accountant \n---------------------------------------- \nWe are seeking a knowledgeable Senior Tax Accountant to manage tax compliance, planning, and advisory services for corporate clients or within a corporate tax department. This role requires a tax professional who can prepare complex tax returns, research tax regulations, identify tax-saving opportunities, and ensure compliance with federal, state, and local tax requirements. You will be responsible for managing tax audits, analyzing tax implications of business transactions, coordinating with external advisors, and supporting strategic tax planning initiatives. The ideal candidate will have strong technical tax knowledge, excellent research and analytical skills, attention to detail, and ability to communicate complex tax matters clearly to non-tax professionals. \n---------------------------------------- \n Bachelor s degree in Accounting, Finance, or related field required; Master s in Taxation or related advanced degree preferred \n CPA certification required; additional tax credentials such as Enrolled Agent beneficial \n Minimum 5-7 years of progressive tax experience in public accounting or corporate tax department with focus on corporate taxation \n Deep knowledge of federal, state, and local tax laws, regulations, and compliance requirements \n Strong understanding of ASC 740 income tax accounting including deferred taxes, uncertain tax positions, and provision calculations \n Experience preparing and reviewing complex corporate tax returns (Form 1120) and consolidated return filings \n Proficiency with tax software including CCH ProSystem fx, Thomson Reuters, or similar tax preparation and research platforms \n Excellent tax research skills using RIA, CCH, BNA, or similar tax research databases \n Strong analytical abilities with attention to detail for identifying issues, analyzing alternatives, and developing tax-efficient solutions \n Experience managing tax audits, responding to tax authority inquiri",
"Aviation Maintenance Manager \n---------------------------------------- \nWe are seeking an experienced Aviation Maintenance Manager to oversee all aircraft maintenance operations, ensuring airworthiness, regulatory compliance, and operational safety. This critical leadership role requires a licensed aviation professional who can manage maintenance technicians, coordinate inspections and repairs, ensure adherence to FAA regulations, and maintain highest standards of aircraft safety and reliability. You will be responsible for maintenance planning, quality assurance, regulatory compliance, budget management, and continuous improvement of maintenance processes and procedures. The ideal candidate will have extensive aircraft maintenance experience, strong leadership abilities, deep regulatory knowledge, and unwavering commitment to aviation safety and operational excellence. \n---------------------------------------- \n FAA Airframe and Powerplant (A P) certificate required; Inspection Authorization (IA) highly preferred \n Minimum 10+ years of aircraft maintenance experience with at least 5 years in supervisory or management roles \n Comprehensive knowledge of FAA regulations including Part 91, Part 135, or Part 121 operations as applicable \n Deep understanding of aircraft systems, maintenance procedures, troubleshooting techniques, and airworthiness standards \n Experience with specific aircraft types relevant to operation (e.g., business jets, helicopters, commercial aircraft) \n Strong leadership and personnel management skills with proven ability to build, motivate, and develop high-performing maintenance teams \n Excellent knowledge of maintenance documentation requirements, logbook entries, and regulatory recordkeeping \n Experience with maintenance tracking systems, aircraft maintenance software, and technical publications management \n Strong understanding of quality assurance principles, safety management systems, and maintenance human factors \n Proven ability to manage"
]
embeddings = model.encode(sentences)
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [4, 4]This is a sentence-transformers model finetuned from Alibaba-NLP/gte-multilingual-base. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for retrieval.
SentenceTransformer(
(0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'NewModel'})
(1): Pooling({'embedding_dimension': 768, 'pooling_mode': 'cls', 'include_prompt': True})
(2): Normalize({})
)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
'LEASING CONSULTANT Summary To attain a position with a client and team oriented business that promotes my customer service aptitude while expanding company-wide knowledge to meet office oriented goals. Experience Leasing Consultant Jan 2016 to Current Company Name City , State \xa0 Associated with the \nleasing of vacant units in the property to help ensure a high occupancy rate \nand assisting in customer service, and resident retention of current residents. \n \n \xa0 Assist in daily \ninspections and upkeep models and target units, ensuring they are presentable \nand ready to show to prospective residents. \n \n \xa0\xa0\xa0\xa0\xa0 Perform duties \nassociated with the rental of apartments, deal closing for renewals, and \noff-site marketing. Process rental \napplications and complete related forms, verify all information in rental \napplications. Obtain and review applicants credit report for review and final \napproval of the Resident Manager. \n \xa0 \xa0 Record traffic sheets, \nguest cards, and/or daily reports updated of leasing activity such as \ninquiries, appointments, rentals, intent to vacate notices, move-ins, and \nmove-outs. \xa0 \xa0Assist in maintaining \nrequired inventories for community supplies and equipment. \xa0 \xa0 Assist in maintaining \nup-to-date and accurate reports and completing all reports as requested by \nResident Manager and/or Corporate Office. \xa0 \xa0Collect and handle rents \nand deposits. Prepares rent receipts. \n \xa0 \xa0Handle resident concerns \nin the absence of Resident Manager or Assistant Manager. \n \n \xa0 \xa0Project a professional \nimage by meeting all Company Standards. \n \n\xa0 \n \n\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 \n \n Leasing Specialist Jan 2014 to Jan 2016 Company Name City , State Interviews prospective tenants and records information to ascertain needs and qualifications. Tours prospects to vacant/model apartments, discusses size and layout of rooms, available amenities, such as swimming pool and saunas, location of shopping centers, services available, and terms of lease. Conducts outreach marketing on a weekly basis including outreach to shopping centers, stores, and other businesses within the local area. Enters all traffic (walk-ins, emails, phone calls, leads) into Yardi as well as follow up on all inquiries regarding current and future unit availability. Completes lease form or agreement and collects rental deposit. Inspects condition of units prior to move-in to ensure they are clean of debris and meet company standards. Enter work orders and submit service requests to maintenance personnel for follow up and completion. Compiles listings of available rental property. Composes and posts vacancy advertisements on Craigslist at least 4 daily. Leasing Specialist Jan 2011 to Jan 2014 Company Name City , State Greet prospects and qualify by covering all criteria \n(Ask questions; utilize completed guest cards, etc.). Immediately record all telephone and in-person visits on appropriate reports. File own guest cards and maintain according to established procedures. Inspect models and',
'Management Consultant \n---------------------------------------- \nWe are seeking an experienced Management Consultant to partner with clients on strategic initiatives, operational improvements, and organizational transformations that drive measurable business results. This role requires a strategic thinker who can analyze complex business problems, develop innovative solutions, and guide implementation while building strong client relationships. You will be responsible for conducting comprehensive business assessments, developing strategic recommendations, facilitating change management, and delivering high-impact consulting engagements across diverse industries and functional areas. The ideal candidate will have strong analytical and problem-solving abilities, excellent communication skills, and proven track record of delivering value to clients through strategic consulting and implementation support. \n---------------------------------------- \n Master s degree in Business Administration (MBA) from top-tier program, or Master s in related field; Bachelor s degree minimum required \n Minimum 5-8 years of management consulting experience with top-tier consulting firm or equivalent corporate strategy experience \n Proven track record delivering successful consulting engagements across strategy, operations, organizational transformation, or related practice areas \n Strong analytical and problem-solving skills with proficiency in quantitative analysis, financial modeling, and data interpretation \n Excellent written and verbal communication skills with ability to synthesize complex information and present clearly to executive audiences \n Advanced proficiency with Microsoft Office Suite particularly Excel and PowerPoint; experience with data visualization tools preferred \n Deep knowledge of business strategy frameworks, process improvement methodologies, and change management best practices \n Experience across multiple industries preferred; expertise in specific sectors such ',
'Aviation Maintenance Manager \n---------------------------------------- \nWe are seeking an experienced Aviation Maintenance Manager to oversee all aircraft maintenance operations, ensuring airworthiness, regulatory compliance, and operational safety. This critical leadership role requires a licensed aviation professional who can manage maintenance technicians, coordinate inspections and repairs, ensure adherence to FAA regulations, and maintain highest standards of aircraft safety and reliability. You will be responsible for maintenance planning, quality assurance, regulatory compliance, budget management, and continuous improvement of maintenance processes and procedures. The ideal candidate will have extensive aircraft maintenance experience, strong leadership abilities, deep regulatory knowledge, and unwavering commitment to aviation safety and operational excellence. \n---------------------------------------- \n FAA Airframe and Powerplant (A P) certificate required; Inspection Authorization (IA) highly preferred \n Minimum 10+ years of aircraft maintenance experience with at least 5 years in supervisory or management roles \n Comprehensive knowledge of FAA regulations including Part 91, Part 135, or Part 121 operations as applicable \n Deep understanding of aircraft systems, maintenance procedures, troubleshooting techniques, and airworthiness standards \n Experience with specific aircraft types relevant to operation (e.g., business jets, helicopters, commercial aircraft) \n Strong leadership and personnel management skills with proven ability to build, motivate, and develop high-performing maintenance teams \n Excellent knowledge of maintenance documentation requirements, logbook entries, and regulatory recordkeeping \n Experience with maintenance tracking systems, aircraft maintenance software, and technical publications management \n Strong understanding of quality assurance principles, safety management systems, and maintenance human factors \n Proven ability to manage',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.1755, 0.2492],
# [0.1755, 1.0000, 0.3826],
# [0.2492, 0.3826, 1.0000]])
valEmbeddingSimilarityEvaluator| Metric | Value |
|---|---|
| pearson_cosine | 0.8555 |
| spearman_cosine | 0.8549 |
sentence1, sentence2, and label| sentence1 | sentence2 | label | |
|---|---|---|---|
| type | string | string | float |
| modality | text | text | |
| details |
|
|
|
| sentence1 | sentence2 | label |
|---|---|---|
HR ADMINISTRATOR/MARKETING ASSOCIATE |
Human Resources Business Partner |
0.494 |
HR SPECIALIST, US HR OPERATIONS Summary Versatile media professional with background in Communications, Marketing, Human Resources and Technology. Experience 09/2015 to Current HR Specialist, US HR Operations Company Name City , State Managed communication regarding launch of Operations group, policy changes and system outages Designed standard work and job aids to create comprehensive training program for new employees and contractors Audited job postings for old, pending, on-hold and draft positions. Audited union hourly, non-union hourly and salary background checks and drug screens Conducted monthly new hire benefits briefing to new employees across all business units Served as a link between HR Managers and vendors by handling questions and resolving system-related issues Provide real-time process improvement feedback on key metrics and initiatives Successfully re-branded US HR Operations SharePoint site Business Unit project manager for RFI/RFP on Background Check and Drug Scree... |
Human Resources Business Partner |
0.7764 |
HR DIRECTOR Summary Over 20 years experience in recruiting, 15 plus years in Human Resources Executive Management, 5 years of HRIS development and maintenance 4 years working in a Healthcare Enviroment Skills Recruiting FMLA/EEO/FLSA HRIS Development Benefit Administration Policy Development Web Page Development Accomplishments Kansas Health Institute -Health Outcomes for the State of Kansas -1999 |
Human Resources Business Partner |
1.0 |
CosineSimilarityLoss with these parameters:{
"loss_fct": "torch.nn.modules.loss.MSELoss",
"cos_score_transformation": "torch.nn.modules.linear.Identity"
}
sentence1, sentence2, and label| sentence1 | sentence2 | label | |
|---|---|---|---|
| type | string | string | float |
| modality | text | text | |
| details |
|
|
|
| sentence1 | sentence2 | label |
|---|---|---|
CONSTRUCTION Summary The purpose of submitting my resume to your company is to obtain a position with the opportunity to utilize my training and skills in the technician industry. I am experienced in warehouse and technician field -wiring 508 A UL soft starters, hard starters while assuring a high level of excellent customer service and satisfaction with maximum productivity; and maintaining a clean and safe warehouse. Also with security experience with skills in Microsoft Office Applications including Word, Excel, CCTV and PowerPoint; I am also competent in customer service satisfaction for installing direct TV and having the ability to gain knowledge of certain products and being able to sell them to the public. I have solid leadership and communication skills. I am also a positive person willing to take on different tasks and eager to learn. These skills are exemplified in my previous employment with Sprecher + Schuh. As a Wire-man and a Warehouse worker my duties ranged from being ... |
Construction Project Manager |
0.1655 |
LINE SERVICE TECHNICIAN Summary I currently have 42 flying hours. I am a Sophomore student at Southwestern Illinois College in the Aviation Pilot Program and I am very interested |
Aviation Maintenance Manager |
0.0802 |
VETERINARY ASSISTANT Summary To obtain a job within my chosen field that will challenge me and allow me to |
Personal Training Manager |
0.1672 |
CosineSimilarityLoss with these parameters:{
"loss_fct": "torch.nn.modules.loss.MSELoss",
"cos_score_transformation": "torch.nn.modules.linear.Identity"
}
per_device_train_batch_size: 16per_device_eval_batch_size: 32learning_rate: 2e-05warmup_steps: 40bf16: Trueload_best_model_at_end: Trueoverwrite_output_dir: Falsedo_predict: Falseprediction_loss_only: Trueper_device_train_batch_size: 16per_device_eval_batch_size: 32per_gpu_train_batch_size: Noneper_gpu_eval_batch_size: Nonegradient_accumulation_steps: 1eval_accumulation_steps: Nonetorch_empty_cache_steps: Nonelearning_rate: 2e-05weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1.0num_train_epochs: 3max_steps: -1lr_scheduler_type: linearlr_scheduler_kwargs: {}warmup_ratio: 0.0warmup_steps: 40log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Truesave_safetensors: Truesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseno_cuda: Falseuse_cpu: Falseuse_mps_device: Falseseed: 42data_seed: Nonejit_mode_eval: Falseuse_ipex: Falsebf16: Truefp16: Falsefp16_opt_level: O1half_precision_backend: autobf16_full_eval: Falsefp16_full_eval: Falsetf32: Nonelocal_rank: 0ddp_backend: Nonetpu_num_cores: Nonetpu_metrics_debug: Falsedebug: []dataloader_drop_last: Falsedataloader_num_workers: 0dataloader_prefetch_factor: Nonepast_index: -1disable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Trueignore_data_skip: Falsefsdp: []fsdp_min_num_params: 0fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}fsdp_transformer_layer_cls_to_wrap: Noneaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}parallelism_config: Nonedeepspeed: Nonelabel_smoothing_factor: 0.0optim: adamw_torchoptim_args: Noneadafactor: Falsegroup_by_length: Falselength_column_name: lengthddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Trueuse_legacy_prediction_loop: Falsepush_to_hub: Falseresume_from_checkpoint: Nonehub_model_id: Nonehub_strategy: every_savehub_private_repo: Nonehub_always_push: Falsehub_revision: Nonegradient_checkpointing: Falsegradient_checkpointing_kwargs: Noneinclude_inputs_for_metrics: Falseinclude_for_metrics: []eval_do_concat_batches: Truefp16_backend: autopush_to_hub_model_id: Nonepush_to_hub_organization: Nonemp_parameters: auto_find_batch_size: Falsefull_determinism: Falsetorchdynamo: Noneray_scope: lastddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Noneinclude_tokens_per_second: Falseinclude_num_input_tokens_seen: Falseneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseeval_on_start: Falseuse_liger_kernel: Falseliger_kernel_config: Noneeval_use_gather_object: Falseaverage_tokens_across_devices: Falseprompts: Nonebatch_sampler: batch_samplermulti_dataset_batch_sampler: proportionalrouter_mapping: {}learning_rate_mapping: {}| Epoch | Step | Training Loss | Validation Loss | val_spearman_cosine |
|---|---|---|---|---|
| 0.1481 | 20 | 0.0425 | - | - |
| 0.2963 | 40 | 0.0268 | 0.0220 | 0.7995 |
| 0.4444 | 60 | 0.0196 | - | - |
| 0.5926 | 80 | 0.0171 | 0.0193 | 0.8251 |
| 0.7407 | 100 | 0.0182 | - | - |
| 0.8889 | 120 | 0.0152 | 0.0192 | 0.8293 |
| 1.0370 | 140 | 0.0178 | - | - |
| 1.1852 | 160 | 0.0123 | 0.0165 | 0.8511 |
| 1.3333 | 180 | 0.0132 | - | - |
| 1.4815 | 200 | 0.0129 | 0.0167 | 0.8484 |
| 1.6296 | 220 | 0.0138 | - | - |
| 1.7778 | 240 | 0.0122 | 0.0167 | 0.8509 |
| 1.9259 | 260 | 0.0123 | - | - |
| 2.0741 | 280 | 0.0118 | 0.0169 | 0.8505 |
| 2.2222 | 300 | 0.0099 | - | - |
| 2.3704 | 320 | 0.0083 | 0.0173 | 0.8523 |
| 2.5185 | 340 | 0.0103 | - | - |
| 2.6667 | 360 | 0.0098 | 0.0163 | 0.8533 |
| 2.8148 | 380 | 0.0104 | - | - |
| 2.963 | 400 | 0.0084 | 0.0164 | 0.8549 |
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
Base model
Alibaba-NLP/gte-multilingual-base