kimquynh/finetuned_sbert_1

SentenceTransformer based on BAAI/bge-base-en-v1.5

This is a sentence-transformers model finetuned from BAAI/bge-base-en-v1.5. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for retrieval.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: BAAI/bge-base-en-v1.5
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Supported Modality: Text

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'BertModel'})
  (1): Pooling({'embedding_dimension': 768, 'pooling_mode': 'cls', 'include_prompt': True})
  (2): Normalize({})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'SummaryHighly motivated Sales Associate with extensive customer service and sales experience. Outgoing sales professional with track record of driving increased sales, improving buying experience and elevating company profile with target market.\nProfessional Experience05/2014toCurrentSoftware Engineer of IoT CloudBelvedere Trading–Boulder,CO,ChinaI work on the Salesforce IoT Cloud, a massively scalable event processing engine for realtime engagement and analytics.My main focus is that design and implement clusters provision and management for IoT cloud.1. Provision and manage AWS and Heroku resource, heavily involving Cloudformation, EC2, Auto-scaling and ELB, etc.2. Deploy micro-services, manage versioning, upgrading IoT platform properly, scale up and scale down micro-services when necessary. Micro-services that we support use Kafka, Storm, Spark, Cassandra, Kubernetes and so on.3. Find the best practice to store sensitive and critical information, for example, auth token, client secret.4. Customize platform when business needs dynamically, involving Jessicatabase migration, kafka migration, Cloudformation infrastructure upJessicate.We are now co-hosting workloads across 10K customers, batch transforming ~100MM rows of user Jessicata Jessicaily and real-time ingests 7 TB of events Jessicaily, ~80 MB/s sustained.02/2014to05/2014Software EngineerLocket–City,STATE,Locket is lock screen app that will display image, content based your interests.\xa0It was selected by Google as one of "Best apps of 2014".I was mainly focusing on backend development, including intelligent content generation and display.05/2013to08/2013Machine Learning Developer (Intern)British Broadcasting Corporation (BBC)–City,STATE,1. Developed a face detection and recognition program in Java, implementing machine learning algorithms,e.g., eigenfaces (PCA) and fisherfaces (LJessica);2. Applied text mining techniques to subtitles to assist the facial identification of actors in TV programs;3. Achieved up to 98% accuracy rate on stanJessicard face Jessicatabases, e.g., ORL.\nEducationExpected in2013totoMaster of Science:Computational Statistics & Machine LearningUniversity College London-London,GPA:Expected inJun 2010totoBachelor of Science:Electronic Commerce ComputingUniversity of Liverpool-Liverpool,GPA:\nTechnical SkillsProgramming: Java, Python, JavascriptBuilding tool: Gradle, MavenOps related: Puppet, Ansible, Saltstack, Docker, Kubernetes, Jenkins, BashOthers: AWS, Hibernate, Postgres',
    'Primary Location: Macon, Georgia\nRelocation offered: Yes\nEmployment status: Full-Time\nTravel: 10%\nNon-compete: No\nThe estimated base salary range for this role is $92,380 to $138,580 per year.\nIndividual pay is based on location, skills and expertise, experience, and other relevant factors\n What does it mean to work at Armstrong? \nIt means being immersed in a supportive culture that recognizes you as a key player in Armstrong\'s future. We are a large company with a local feel, where you will get to know and collaborate with leadership and your colleagues across the company.\nBy joining us, you\'ll have the opportunity to make the most of your potential. Alongside a competitive remuneration package, you will receive:\nA benefits package including: medical, dental, prescription drug, life insurance, 401k match, long-term disability coverage, vacation and sick time, and many more.\nPersonal development to grow your career with us based on your strengths and interests.\nA working culture that balances individual achievement with teamwork and collaboration. We draw on each other\'s strengths and allow for different work styles to build engagement and satisfaction to deliver results.\nJob Summary: \nArmstrong World Industries, Inc. (AWI) has a job opportunity for an Electrical Engineer to be located at our Ceilings plant in Macon, GA. As the Electrical Engineer you will be responsible for providing engineering and technical services to support the manufacturing equipment, maintenance systems, and production processes. Additionally, you will play a critical role in our lean efforts as we continuously strive to improve our processes and reduce waste. In our fast paced and dynamic environment, you will take on and execute electrical projects and studies of significant importance, scope, and complexity.\nKey Responsibilities of the Electrical Engineer:\nProviding electrical engineering and technical assistance to the manufacturing plant in terms of equipment, maintenance, and production processes and systemsManaging the plant capital budgetParticipating in identifying and resolving common cause and special cause electrical issues that impact plant reliability and performanceInvestigating manufacturing problems in the plant and recommending corrective actionsDeveloping preliminary concepts and budgetary capital estimates for new electrical products, projects, and improvementsAssisting in andor developing vendor bid packages and final vendor selection for purchased parts and servicesExecuting capital projects, ensuring cost, schedule, and performance goals are met or exceededApplying Precision Maintenance concepts and principalsEducating plant personnel on electrical engineering and technical issues to ensure their knowledge and understandingCoordinating training and start-up activities of new equipment and processesParticipating in Lean efforts, such as kaizen events, where an emphasis is placed on creativity before capital investmentProviding status updates on project progress and issues\nRequired Qualifications:\nBachelor\'s degree in Electrical Engineering 5+ years of electrical engineering experience in a manufacturing environmentPLC or HMI programming experience with the Rockwell suite of products ( Allen- Bradly) Demonstrated Project Management skillsExcellent communication skills, including verbal, written, and presentation\nPreferred Qualifications:\nDatabase systems, i.e. SQL Server 2012Networked system design and configuration480 VAC power distribution4160V motors and controlsAutoCADExperience with Wonderware application programming and support\nWhy should you join Armstrong World Industries?\nArmstrong World Industries (AWI) is a leader in the design and manufacture of innovative commercial and residential ceiling, wall and suspension system solutions in the Americas. With approximately $1B in revenue, AWI has about 2,800 employees and a manufacturing network of fifteen facilities in North America.\nAt home, at work, in healthcare facilities, classrooms, stores, or restaurants, we offer interior solutions that help to enhance comfort, save time, improve building efficiency and overall performance, and create beautiful spaces.\nFor more than 150 years, we have built our business on trust and integrity. It set us apart then, and it sets us apart now, along with our ability to collaborate with and innovate for the people we\'re here to serve - our customers, our shareholders, our communities and our employees.\nWe are committed to developing new and sustainable ceiling solutions, with design and performance possibilities that make a positive difference in spaces where we live, work, learn, heal and play. It\'s an exciting, rewarding business to be in, and we\'re committed to continue to grow and prosper for the benefit of all of our stakeholders. We hope you join us.\nOur Sustainability Ambition\n"Bringing our Purpose to Life" - lead a transformation in the design and building of spaces fit for today and tomorrow.\nWe are committed to:\nEngaging a diverse, purpose-driven workforce;Transforming buildings from structures that shelter into structures that serve and preserve the health and well-being of people and planet;Pursuing sustainable, innovative solutions for spaces where we live, work, learn heal and play;Being a catalyst for change with all of our stakeholders; andMaking a positive difference in the environments and communities we impact.\nAbout the location (Macon GA)\nOur Macon Plant, one of twelve Armstrong plants in North America, employs over 400 people working on rotating shifts, 247, in the manufacture and shipment of acoustical ceiling tile to Armstrong\'s customers. Located approximately 85 miles south of Atlanta, the Macon facility has 33 acres under one roof, or 1.5 million square feet of floor space. It is the largest ceiling tile factory in the world. The operations are complex, automated, use the latest modern management technology, and manufacture a wide range of commercial and residential ceiling products.\nMacon, also known as the "Cherry Blossom Capital of the World", is in the heart of Georgia and marks a historical crossroads in the south. The city carries with it a rich cultural heritage while creating a strong vision for the future. Macon offers the amenities of a small friendly city with the advantages of a growing community.\nArmstrong is committed to engaging a diverse, purpose-driven workforce. As part of our dedication to diversity, AWI is committed to Equal Employment Opportunity and all qualified applicants receive consideration for employment without regard for race, sex, color, national origin, ethnicity, gender, protected veteran status, disability, sexual orientation, gender identity, or religion. We are also committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at by email at AWI talent acquisition and let us know the nature of your request and your contact information. Requests for accommodation will be evaluated on a case-by-case basis. Please note that only inquiries concerning a request for reasonable accommodation will be responded to from this email address.\nCome and build your future with us and apply today!',
    "CORPORATE SENIOR STAFF ACCOUNTANT (REMOTE) POSITION SUMMARY: We are seeking a Corporate Senior Staff Accountant to join our finance and accounting team. This role is responsible for supporting various financial activities, ensuring accurate recordkeeping, and contributing to the overall financial health of the company. The Corporate Senior Staff Accountant works closely with other members of the finance team to provide valuable insights, analysis, and reporting. This is a fully remote opportunity offering an annual bonus.\nCORPORATE SENIOR STAFF ACCOUNTANT RESPONSIBILITIES:Prepare, review, and analyze financial statements, ensuring accuracy and compliance with Generally Accepted Accounting Principles.Maintain balance sheet and inventory reconciliations, journal entries, accruals, and adjustments; analyze financial data to identify trends, variances, and potential areas for improvement.Participate in month-end and year-end closing processes, including preparing necessary reconciliations and supporting schedules.Assist in financial analysis by providing insights into key performance indicators, variances, and financial trends.Provide direction to Accounting staff and support development of policies, controls, systems, and financial studies of matters of importance.\nWHAT YOU'LL NEED TO SUCCEED:Bachelors degree in Accounting or Finance preferredMinimum 4 years' experience in corporate or public accounting or finance requiredMust be proficient with Microsoft Excel and corporate accounting ERP systems",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.3358, 0.2246],
#         [0.3358, 1.0000, 0.2493],
#         [0.2246, 0.2493, 1.0000]])

Evaluation

Metrics

Semantic Similarity

• Dataset: resume-job-sim
• Evaluated with EmbeddingSimilarityEvaluator

Metric	Value
pearson_cosine	0.3443
spearman_cosine	0.35

Binary Classification

• Dataset: resume-job-bin
• Evaluated with BinaryClassificationEvaluator

Metric	Value
cosine_accuracy	0.7406
cosine_accuracy_threshold	0.9229
cosine_f1	0.5353
cosine_f1_threshold	0.6641
cosine_precision	0.3851
cosine_recall	0.8777
cosine_ap	0.4106
cosine_mcc	0.3431

Training Details

Training Dataset

Unnamed Dataset

• Size: 6,241 training samples
• Columns: sentence1, sentence2, and score
• Approximate statistics based on the first 100 samples:

  	sentence1	sentence2	score
  type	string	string	float
  modality	text	text
  details	min: 209 tokens mean: 504.92 tokens max: 512 tokens	min: 55 tokens mean: 385.64 tokens max: 512 tokens	min: 0.0 mean: 0.0 max: 0.0

• Samples:

  sentence1	sentence2	score
  SummaryHighly motivated Sales Associate with extensive customer service and sales experience. Outgoing sales professional with track record of driving increased sales, improving buying experience and elevating company profile with target market. Highlights-Soft Skills: Public Speaking, Public Relations, Team Building, Project Management, Procedure writing, Staff Supervision and Management, Ability to interface with professionals on all levels. Accomplishments, Honors, and Activities -Board of Directors Member for the Food Bank of Corpus Christi from November 2010 to April 2013. -Held Life Insurance License -Basketball Official (Referee) High School Varsity Level. ExperienceAccountant,08/2014-05/2015Aspirus–Owen,WI,Perform daily and routine accounting functions for two main companies and five small royalty companies. Responsibilities include but are not limited to the following: Accounts Payable, Accounts Receivable, Manage and reconcile funds for multiple banks accounts, Payroll, Perfo...	Net2Source Inc. is an award-winning total workforce solutions company recognized by Staffing Industry Analysts for our accelerated growth of 300% in the last 3 years with over 5500+ employees globally, with over 30+ locations in the US and global operations in 32 countries. We believe in providing staffing solutions to address the current talent gap Right Talent Right Time Right Place Right Price and acting as a Career Coach to our consultants. Role: Basel Business AnalystLocation: Washington, D.C.Work Mode: HybridHire Type: 6+ Month Contract (extendable) JD: Role Specific Experience: 6+ years of relevant technical and business work experience The Candidates who have worked on Basel related projects in Credit risks or at least are aware of credit risk. Banking & Financial domain experience, along with knowledge of risk management, familiarity with concepts of finance and accounting Proficiency in MS Excel Experience in defining and implementing technology solutions for a major...	0.0
  Professional SummaryCurrently working with Caterpillar as an contract employee Active in several NPI and CPI projects Provide technical for CAT facilities worldwide 24-hours a day Willing to travel to meet job requirements Familiar with Power Distribution Systems, NETA, NFPA 70E, and OHSA electrical standards Graduating in December 2014 with a Master's Degree in Industrial Management Excellent communication and interpersonal skills SkillsGuest servicesInventory control proceduresMerchandising expertiseLoss preventionCash register operationsProduct promotions Work History08/2012toCurrentFacilities Software Coordinator|City,STATE,Responsible for managing software across all products in Decatur IL, Joliet IL, and North Little Rock AR On-call 24 hours a day to provide support to field reps, assembly workers, and line supervisors around the world including India, Russia, China, and Brazil Traveled to various locations within the company including Russia, Mossville IL, East Peoria IL, and No...	At Salas OBrien we tell our clients that were engineered for impact. This passion for making a difference applies just as much to our team as it does to our projects. Thats why were committed to living our values every day: inspiring, achieving, and connecting as shared owners of our success with a focus on a sustainable future. Building for the long-term means that all of our team members can expect to work on amazing projects with a people-first approach to problem solving. It also means that each member of our team has truly limitless potential to build a unique, meaningful, and high-impact careerand theyll receive great total rewards along the way. About Us Founded in 1975, Salas OBrien is an employee-owned engineering and professional services firm focused on achieving impact for our clients, our team, and the world. We know that tomorrows requirements are todays opportunities, and we are here to design lasting solutions for pressing challenges. We work across a variety of industr...	0.0
  SummaryI started my construction career in June of 2017 in Jacksonville, Florida as an Electrical Apprentice working full time and attending the Jacksonville Electrical Training Alliance. this experience provided invaluable insight into electrical systems work and the related theory. Knowledgeable leader with record of accomplishment on diverse construction projects. Translates directives of architects, constructions managers and clients into actionable on-site directives to consistently meet project demands. Expert in tackling problems head-on and maintaining strict standards. Hardworking and reliable electrician apprentice with strong ability in electrical knowledge and mechanical. Offering leadership, reliability and accuracy. Highly organized, proactive and punctual with team-oriented mentality. SkillsDiagnostics and troubleshootingOSHA requirementsElectrical codes familiaritySafety awarenessPower and hand tool operationSchematics and blueprintsLift up to 20,000 poundsElectrical di...	Schweitzer Engineering Laboratories (SEL) Infrastructure Defense Division seeks a talented individual for a cybersecurity focused (Lead) Software Engineer position. The work we perform is some of the most fascinating, challenging, and rewarding that can be found in the power engineering community. Lead a team, conducting white and black box testing of devices and software for security flaws and vulnerabilities. Identify areas of concern and recommendations for an improved cybersecurity stance. Will require staying up to date and training others about current security vulnerabilities and mitigation processes. Note: United States Citizenship is required. As a Lead Software Engineer, a typical day might include the following: Lead the specification, design, implementation, and test of firmwaresoftware systems.Understand hardware and software interactions, and collaborate with Hardware Engineers.Lead the development of designs and test documentation.Mentor Engineers, Associate Engineers, a...	0.0

• Loss: ContrastiveLoss with these parameters:

  {
      "distance_metric": "SiameseDistanceMetric.COSINE_DISTANCE",
      "margin": 0.5,
      "size_average": true
  }
  

Evaluation Dataset

Unnamed Dataset

• Size: 879 evaluation samples
• Columns: sentence1, sentence2, and score
• Approximate statistics based on the first 100 samples:

  	sentence1	sentence2	score
  type	string	string	float
  modality	text	text
  details	min: 321 tokens mean: 508.33 tokens max: 512 tokens	min: 63 tokens mean: 378.46 tokens max: 512 tokens	min: 0.0 mean: 0.31 max: 1.0

• Samples:

  sentence1	sentence2	score
  Career OverviewMeticulous Senior Software Test Analyst who undertakes complex assignments, meets rigid deadlines and delivers superior performance. Possess practical knowledge on analyzing Bank Payments. Applies strong technical and analytical skills to inform Senior Management, Clients and Technology of key issues in the application and help the clients by providing good recommendations. Operates with a strong sense of urgency and thrives in a fast paced setting. QualificationsJava, SQL, PL/SQL, HTMLApplications : HP Quality Centre 10, IBM Mainframe (AS400).Visual Studio 2015, VMware 12Pro, MSOffice13, Tableau, MS Visio, E-Draw MySQL, MS Access, Oracle SQL DeveloperOperating systems : Proficient on Windows 7/ 8.1 / 10, Linux (Ubuntu, Fedora)Certification : International Software Testing Qualification Board (ISTQB), Six Sigma, MS SQL, A+academic Project: - Store Management SystemStrong analytical skillsStructured query language (SQL) expertInformation securityProje...	Description What were looking for At AppFolio, we paddle as one. We ride and make waves together, with a relentless focus on building great products for the way our customers work and live today and tomorrow. AppFolio is a destination organization where careers are made and accelerated. Here, innovation is a team sport. We're looking for experienced engineers to help build AppFolio Investment Management. AppFolio Investment Management (https:www.appfolioinvestmentmanagement.com) product is a fast-growing internal startup of a successful, established SaaS company (https:www.appfolioinc.com). We are going after the $7 trillion and growing private equity market which largely still runs on spreadsheets and email. Starting with private equity real estate, we are helping private equity firms build and manage their businesses with purpose-built software that enables them to do everything from investor relations to fundraising to managing the elaborate capital stacks common in modern-day p...	1.0
  Professional SummarySeeking Challenging and Rewarding Assignments with a growth Oriented Organization My Role Worked on Hybrid driven framework in WebDriver and Page Object Model. Good knowledge of creating xpath to find dynamic objects. Good knowledge of writing test script using Selenium-WebDriver with TestNG. Experienced in developing test automation scenarios and scripts for Web applications. Experienced in developing Generic Scripts and Project Specific Scripts. Working experience of Apache POI APIs, TestNG, , Jenkins for continuous integration testing Basic knowledge of Selenium IDE. Good understanding and analysis of client requirements and experienced in creating suitable Automation scripts. Exposure to all stages of SDLC & STLC and good understanding of ATLC (Automation Testing Life Cycle).Analyze requirements and conduct requirement clarification session for team SkillsTest Management Tools :HP ALM 11, Caliber, HP-Quality Centre, CA Central Rally ,JiraDatabase/Language:Oracle...	About Grainger Grainger is a leading broad line distributor with operations primarily in North America, Japan and the United Kingdom. We achieve our purpose, We Keep the World Working, by serving more than 4.5 million customers with a wide range of products that keep their operations running and their people safe. Grainger also delivers services and solutions, such as technical support and inventory management, to save customers time and money. We're looking for passionate people who can move our company forward. As one of the 100 Best Companies to Work For, we have a welcoming workplace where you can build a career for yourself while fulfilling our purpose to keep the world working. We embrace new ways of thinking and recognize everyone is an individual. Find your way with Grainger today. Position Details The Engineering Business Analyst has the responsibility of being very deep in our technology project and product work and being a key team member who knows all aspects. The Engineeri...	1.0
  Career OverviewSeeking a job where I can effectively utilize my academic knowledge and learn new skills to continually enhance the development of my professional skills. QualificationsProficient or familiar with a vast array of programming languages, concepts and operating systems, including:C, Windows 98/2000/03/XP/VISTA/7/8/10,Adobe Photoshop, Visual StudioNetwork fundamentals,MATLAB, SQL Server 2008R2,2012.SSIS,SSAS,SSRSMultisim, simulink, ImageProcessing.SQL, T-SQL. SQL Server 2012/2008/2005 Enterprise Edition, SSIS, SSRS, PPS, MS PowerPoint, MS Project, MS Access 2003 ,Oracle, Business Objects ,SharePoint , PL/SQL, C#,VB.Net,ASP.NET, XML, Visual Studio 2008 & 2005,MS Visio 2007,Borland StarTeam, Build Forge, Visual SourceSafe Work Experience02/2017toPresentJr Data analystApex Systems–Gulfport,MS,Underwent internship program conducted by BSNL Telecommunications Vijayawada.Trained in designing PULSE DIGITAL CIRCUITS.Underwent internship program as Data Analyst at A4 Softech.Activiti...	Who we are:Founded in 2017, Gatik is the leader in autonomous middle mile logistics. We deliver goods safely and efficiently using medium duty trucks with a focus on short-haul, B2B logistics for Fortune 500 customers such as Walmart and Loblaw. Gatik enables our customers to optimize their hub-and-spoke operations, enhance service levels and product flow across multiple locations while reducing labor costs and meeting an unprecedented expectation for faster deliveries. About the role:We are seeking passionate Staff Software Engineers, who have strong fundamentals in software development practices and are experts in C++ language in production-oriented environment. The ideal candidate is a highly experienced C++ developer with a passion for enabling the world's first safe, reliable & efficient network of autonomous vehicles. You will partner with the research and software engineers to design, develop, test and validate AV features for our autonomous fleet. This role will be onsite 4 day...	0.0

• Loss: ContrastiveLoss with these parameters:

  {
      "distance_metric": "SiameseDistanceMetric.COSINE_DISTANCE",
      "margin": 0.5,
      "size_average": true
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 16
• learning_rate: 2e-05
• warmup_steps: 0.1
• weight_decay: 0.05
• fp16: True
• per_device_eval_batch_size: 16

All Hyperparameters

Click to expand

• per_device_train_batch_size: 16
• num_train_epochs: 3
• max_steps: -1
• learning_rate: 2e-05
• lr_scheduler_type: linear
• lr_scheduler_kwargs: None
• warmup_steps: 0.1
• optim: adamw_torch_fused
• optim_args: None
• weight_decay: 0.05
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• optim_target_modules: None
• gradient_accumulation_steps: 1
• average_tokens_across_devices: True
• max_grad_norm: 1.0
• label_smoothing_factor: 0.0
• bf16: False
• fp16: True
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• use_liger_kernel: False
• liger_kernel_config: None
• use_cache: False
• neftune_noise_alpha: None
• torch_empty_cache_steps: None
• auto_find_batch_size: False
• log_on_each_node: True
• logging_nan_inf_filter: True
• include_num_input_tokens_seen: no
• log_level: passive
• log_level_replica: warning
• disable_tqdm: False
• project: huggingface
• trackio_space_id: None
• trackio_bucket_id: None
• trackio_static_space_id: None
• per_device_eval_batch_size: 16
• prediction_loss_only: True
• eval_on_start: False
• eval_do_concat_batches: True
• eval_use_gather_object: False
• eval_accumulation_steps: None
• include_for_metrics: []
• batch_eval_metrics: False
• save_only_model: False
• save_on_each_node: False
• enable_jit_checkpoint: False
• push_to_hub: False
• hub_private_repo: None
• hub_model_id: None
• hub_strategy: every_save
• hub_always_push: False
• hub_revision: None
• load_best_model_at_end: False
• ignore_data_skip: False
• restore_callback_states_from_checkpoint: False
• full_determinism: False
• seed: 42
• data_seed: None
• use_cpu: False
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• dataloader_prefetch_factor: None
• remove_unused_columns: True
• label_names: None
• train_sampling_strategy: random
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• ddp_static_graph: None
• ddp_backend: None
• ddp_timeout: 1800
• fsdp: None
• fsdp_config: None
• deepspeed: None
• debug: []
• skip_memory_metrics: True
• do_predict: False
• resume_from_checkpoint: None
• warmup_ratio: None
• local_rank: -1
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

Epoch	Step	Training Loss	Validation Loss	resume-job-sim_spearman_cosine	resume-job-bin_cosine_ap
0.2558	100	0.0206	0.0243	0.1788	0.3149
0.5115	200	0.0179	0.0231	0.2573	0.3555
0.7673	300	0.0158	0.0225	0.3042	0.3696
1.0230	400	0.0135	0.0229	0.2999	0.3931
1.2788	500	0.0114	0.0235	0.3500	0.4106

Training Time

• Training: 13.7 minutes

Framework Versions

• Python: 3.12.13
• Sentence Transformers: 5.6.1
• Transformers: 5.13.1
• PyTorch: 2.11.0+cu128
• Accelerate: 1.14.0
• Datasets: 5.0.1
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

ContrastiveLoss

@inproceedings{hadsell2006dimensionality,
    author={Hadsell, R. and Chopra, S. and LeCun, Y.},
    booktitle={2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06)},
    title={Dimensionality Reduction by Learning an Invariant Mapping},
    year={2006},
    volume={2},
    number={},
    pages={1735-1742},
    doi={10.1109/CVPR.2006.100}
}