kimquynh/finetuned_sbert

SentenceTransformer based on BAAI/bge-base-en-v1.5

This is a sentence-transformers model finetuned from BAAI/bge-base-en-v1.5. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for retrieval.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: BAAI/bge-base-en-v1.5
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 dimensions
• Similarity Function: Cosine Similarity
• Supported Modality: Text

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'BertModel'})
  (1): Pooling({'embedding_dimension': 768, 'pooling_mode': 'cls', 'include_prompt': True})
  (2): Normalize({})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'SummaryHighly motivated Sales Associate with extensive customer service and sales experience. Outgoing sales professional with track record of driving increased sales, improving buying experience and elevating company profile with target market.\nProfessional Experience05/2014toCurrentSoftware Engineer of IoT CloudBelvedere Trading–Boulder,CO,ChinaI work on the Salesforce IoT Cloud, a massively scalable event processing engine for realtime engagement and analytics.My main focus is that design and implement clusters provision and management for IoT cloud.1. Provision and manage AWS and Heroku resource, heavily involving Cloudformation, EC2, Auto-scaling and ELB, etc.2. Deploy micro-services, manage versioning, upgrading IoT platform properly, scale up and scale down micro-services when necessary. Micro-services that we support use Kafka, Storm, Spark, Cassandra, Kubernetes and so on.3. Find the best practice to store sensitive and critical information, for example, auth token, client secret.4. Customize platform when business needs dynamically, involving Jessicatabase migration, kafka migration, Cloudformation infrastructure upJessicate.We are now co-hosting workloads across 10K customers, batch transforming ~100MM rows of user Jessicata Jessicaily and real-time ingests 7 TB of events Jessicaily, ~80 MB/s sustained.02/2014to05/2014Software EngineerLocket–City,STATE,Locket is lock screen app that will display image, content based your interests.\xa0It was selected by Google as one of "Best apps of 2014".I was mainly focusing on backend development, including intelligent content generation and display.05/2013to08/2013Machine Learning Developer (Intern)British Broadcasting Corporation (BBC)–City,STATE,1. Developed a face detection and recognition program in Java, implementing machine learning algorithms,e.g., eigenfaces (PCA) and fisherfaces (LJessica);2. Applied text mining techniques to subtitles to assist the facial identification of actors in TV programs;3. Achieved up to 98% accuracy rate on stanJessicard face Jessicatabases, e.g., ORL.\nEducationExpected in2013totoMaster of Science:Computational Statistics & Machine LearningUniversity College London-London,GPA:Expected inJun 2010totoBachelor of Science:Electronic Commerce ComputingUniversity of Liverpool-Liverpool,GPA:\nTechnical SkillsProgramming: Java, Python, JavascriptBuilding tool: Gradle, MavenOps related: Puppet, Ansible, Saltstack, Docker, Kubernetes, Jenkins, BashOthers: AWS, Hibernate, Postgres',
    'Primary Location: Macon, Georgia\nRelocation offered: Yes\nEmployment status: Full-Time\nTravel: 10%\nNon-compete: No\nThe estimated base salary range for this role is $92,380 to $138,580 per year.\nIndividual pay is based on location, skills and expertise, experience, and other relevant factors\n What does it mean to work at Armstrong? \nIt means being immersed in a supportive culture that recognizes you as a key player in Armstrong\'s future. We are a large company with a local feel, where you will get to know and collaborate with leadership and your colleagues across the company.\nBy joining us, you\'ll have the opportunity to make the most of your potential. Alongside a competitive remuneration package, you will receive:\nA benefits package including: medical, dental, prescription drug, life insurance, 401k match, long-term disability coverage, vacation and sick time, and many more.\nPersonal development to grow your career with us based on your strengths and interests.\nA working culture that balances individual achievement with teamwork and collaboration. We draw on each other\'s strengths and allow for different work styles to build engagement and satisfaction to deliver results.\nJob Summary: \nArmstrong World Industries, Inc. (AWI) has a job opportunity for an Electrical Engineer to be located at our Ceilings plant in Macon, GA. As the Electrical Engineer you will be responsible for providing engineering and technical services to support the manufacturing equipment, maintenance systems, and production processes. Additionally, you will play a critical role in our lean efforts as we continuously strive to improve our processes and reduce waste. In our fast paced and dynamic environment, you will take on and execute electrical projects and studies of significant importance, scope, and complexity.\nKey Responsibilities of the Electrical Engineer:\nProviding electrical engineering and technical assistance to the manufacturing plant in terms of equipment, maintenance, and production processes and systemsManaging the plant capital budgetParticipating in identifying and resolving common cause and special cause electrical issues that impact plant reliability and performanceInvestigating manufacturing problems in the plant and recommending corrective actionsDeveloping preliminary concepts and budgetary capital estimates for new electrical products, projects, and improvementsAssisting in andor developing vendor bid packages and final vendor selection for purchased parts and servicesExecuting capital projects, ensuring cost, schedule, and performance goals are met or exceededApplying Precision Maintenance concepts and principalsEducating plant personnel on electrical engineering and technical issues to ensure their knowledge and understandingCoordinating training and start-up activities of new equipment and processesParticipating in Lean efforts, such as kaizen events, where an emphasis is placed on creativity before capital investmentProviding status updates on project progress and issues\nRequired Qualifications:\nBachelor\'s degree in Electrical Engineering 5+ years of electrical engineering experience in a manufacturing environmentPLC or HMI programming experience with the Rockwell suite of products ( Allen- Bradly) Demonstrated Project Management skillsExcellent communication skills, including verbal, written, and presentation\nPreferred Qualifications:\nDatabase systems, i.e. SQL Server 2012Networked system design and configuration480 VAC power distribution4160V motors and controlsAutoCADExperience with Wonderware application programming and support\nWhy should you join Armstrong World Industries?\nArmstrong World Industries (AWI) is a leader in the design and manufacture of innovative commercial and residential ceiling, wall and suspension system solutions in the Americas. With approximately $1B in revenue, AWI has about 2,800 employees and a manufacturing network of fifteen facilities in North America.\nAt home, at work, in healthcare facilities, classrooms, stores, or restaurants, we offer interior solutions that help to enhance comfort, save time, improve building efficiency and overall performance, and create beautiful spaces.\nFor more than 150 years, we have built our business on trust and integrity. It set us apart then, and it sets us apart now, along with our ability to collaborate with and innovate for the people we\'re here to serve - our customers, our shareholders, our communities and our employees.\nWe are committed to developing new and sustainable ceiling solutions, with design and performance possibilities that make a positive difference in spaces where we live, work, learn, heal and play. It\'s an exciting, rewarding business to be in, and we\'re committed to continue to grow and prosper for the benefit of all of our stakeholders. We hope you join us.\nOur Sustainability Ambition\n"Bringing our Purpose to Life" - lead a transformation in the design and building of spaces fit for today and tomorrow.\nWe are committed to:\nEngaging a diverse, purpose-driven workforce;Transforming buildings from structures that shelter into structures that serve and preserve the health and well-being of people and planet;Pursuing sustainable, innovative solutions for spaces where we live, work, learn heal and play;Being a catalyst for change with all of our stakeholders; andMaking a positive difference in the environments and communities we impact.\nAbout the location (Macon GA)\nOur Macon Plant, one of twelve Armstrong plants in North America, employs over 400 people working on rotating shifts, 247, in the manufacture and shipment of acoustical ceiling tile to Armstrong\'s customers. Located approximately 85 miles south of Atlanta, the Macon facility has 33 acres under one roof, or 1.5 million square feet of floor space. It is the largest ceiling tile factory in the world. The operations are complex, automated, use the latest modern management technology, and manufacture a wide range of commercial and residential ceiling products.\nMacon, also known as the "Cherry Blossom Capital of the World", is in the heart of Georgia and marks a historical crossroads in the south. The city carries with it a rich cultural heritage while creating a strong vision for the future. Macon offers the amenities of a small friendly city with the advantages of a growing community.\nArmstrong is committed to engaging a diverse, purpose-driven workforce. As part of our dedication to diversity, AWI is committed to Equal Employment Opportunity and all qualified applicants receive consideration for employment without regard for race, sex, color, national origin, ethnicity, gender, protected veteran status, disability, sexual orientation, gender identity, or religion. We are also committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at by email at AWI talent acquisition and let us know the nature of your request and your contact information. Requests for accommodation will be evaluated on a case-by-case basis. Please note that only inquiries concerning a request for reasonable accommodation will be responded to from this email address.\nCome and build your future with us and apply today!',
    "CORPORATE SENIOR STAFF ACCOUNTANT (REMOTE) POSITION SUMMARY: We are seeking a Corporate Senior Staff Accountant to join our finance and accounting team. This role is responsible for supporting various financial activities, ensuring accurate recordkeeping, and contributing to the overall financial health of the company. The Corporate Senior Staff Accountant works closely with other members of the finance team to provide valuable insights, analysis, and reporting. This is a fully remote opportunity offering an annual bonus.\nCORPORATE SENIOR STAFF ACCOUNTANT RESPONSIBILITIES:Prepare, review, and analyze financial statements, ensuring accuracy and compliance with Generally Accepted Accounting Principles.Maintain balance sheet and inventory reconciliations, journal entries, accruals, and adjustments; analyze financial data to identify trends, variances, and potential areas for improvement.Participate in month-end and year-end closing processes, including preparing necessary reconciliations and supporting schedules.Assist in financial analysis by providing insights into key performance indicators, variances, and financial trends.Provide direction to Accounting staff and support development of policies, controls, systems, and financial studies of matters of importance.\nWHAT YOU'LL NEED TO SUCCEED:Bachelors degree in Accounting or Finance preferredMinimum 4 years' experience in corporate or public accounting or finance requiredMust be proficient with Microsoft Excel and corporate accounting ERP systems",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[ 1.0000,  0.0816, -0.0686],
#         [ 0.0816,  1.0000,  0.0851],
#         [-0.0686,  0.0851,  1.0000]])

Evaluation

Metrics

Semantic Similarity

• Dataset: resume-job-valid
• Evaluated with EmbeddingSimilarityEvaluator

Metric	Value
pearson_cosine	0.3267
spearman_cosine	0.3509

Training Details

Training Dataset

Unnamed Dataset

• Size: 9,398 training samples
• Columns: sentence1, sentence2, and score
• Approximate statistics based on the first 100 samples:

  	sentence1	sentence2	score
  type	string	string	float
  modality	text	text
  details	min: 374 tokens mean: 506.48 tokens max: 512 tokens	min: 43 tokens mean: 357.66 tokens max: 512 tokens	min: 0.0 mean: 0.54 max: 1.0

• Samples:

  sentence1	sentence2	score
  SummaryAn accomplished professional with 8+ years (which includes 3 years as application developer) of experience in business systems/data analytics, with in-depth knowledge of business operations, analytics tools and data transformations. Excellent problem solving skills with ability to think laterally for practical solutions. Areas of ExpertiseAGILE (Scrum) implementationsDesign, Gap & Risk AnalysisRegression AnalysisUser story & Use Case AnalysisTest Cases DesignQA Test automationSDLC implementationsData/Functional AnalysisData WarehousingObject Oriented ProgrammingData Mapping & AggregationBI Reporting and Analytics SkillsProgramming Languages:SQL, PL-SQL, XML, C++, Java/J2EE, UML 2.0, VBA – Excel, SAS programmingTools/Technologies:ERWin, MS-Visio, SQL Developer 1.5.1, Toad, Teradata Client, Excel (Analytics),HP’s ALM,JIRA, SharePoint, JavaScript, JSP, Servlets, IBM’s RAD, EclipseDBMS:Oracle 10g, PostGreSQL, MySQL, MS-SQL, SQL Server, Teradata, Cassandra (No-SQL)BI& Reporting:Ab In...	Reviews, analyzes, and evaluates business systems and user needs. Formulates systems to parallel overall business strategies. Experienced with business process reengineering and identifying new applications of technology to business problems to make business more effective. Familiar with industry standard business process mapping, and reengineering. Prepares solution options, risk identification, and financial analyses such as costbenefit, ROI, buybuild, etc. Writes detailed description of user needs, program functions, and steps required to develop or modify computer programs. This position will work on the Grants Management application. This position will perform the duties of a Business Analyst including requirement gathering, analysis of requirements, development of requirements and design for required system modifications, completing business requirement documents, user stories, and business area collaboration andor coordination. Will also work with technical teams to coordinate ...	0.0
  SummaryCapable Accountant successful at managing multiple projects and consistently meeting deadlines under pressure. Extensive knowledge of accounting software and processes.Insightful and self-directed with seven years of experience delivering quality. Employed critical thinking skills to examine issues and develop best practice solutions. Currently working towards becoming a CPA. ExperienceSenior Accountant,09/2014-CurrentGraco Inc.–North Canton,OH,Founded in 2010, Panda Power Funds is a private equity firm headquartered in Dallas, Texas, which has the ability to develop, acquire, construct, finance and operate large-scale, natural gas-fueled power generation facilities. PPF raised a $6 billion fund and operates 6  power plants throughout the United States.​Prepared financial statements for different projects on monthly, quarterly basisPrepared journal entries, account analyses, reconciliations and internal reporting in a four day financial closeReconciled sub-ledger to general ledg...	Position Title: Senior Construction Accountant (Req #: 116) Location: Fresno, CA Date Posted: 08082023 Pay Range: $82,000 - $118,000 Position Description: Job Summary Responsible for maintaining financial records and ensures that financial transactions are properly recorded. Verifies the accuracy of entries to ledger accounts and reconciles subsidiary ledger accounts to the general ledger. Prepares complex balance sheets, profit and loss statements, and other financial reports. Analyzes current costs, revenues, financial commitments, and obligations incurred to predict future revenues and expenses. Essential Duties and Responsibilities Essential duties and other responsibilities include but are not limited to the following:Ensures accurate and timely reporting of all financial data in accordance with GAAP.Monitors revenue and expenses while coordinating collection, consolidation, and review of all financial data.Verifies the accuracy of all job costs as well as reconciling all...	1.0
  Professional SummaryDetail-driven accounting professional experienced in examining and analyzing accounting records, financial statements, and financial reports to assess accuracy and compliance with GAAP standards. Personable in managing client relationships and assisting clients to resolve problems and find solutions. Excels in high-pressure environments with critical deadlines. SkillsGeneral LedgerMonthly Account ReconciliationClosing ProcessesRegulatory ComplianceBudgeting & Variance AnalysisMonthly Journal EntriesMicrosoft Excel, Hyperion, & OracleAccounts Payable and ReceivableInternal ControlsMonthly / Quarterly / Year End ReportsFinancial AnalysisAudit CoordinationCredit MemosFinancial ReportingAccount Reconciliation, PricingAccounting, ProcessesAccounts Payable and Receivable, Variance AnalysisBalance sheet, Year-endBillingBudgetingCash receiptsClosingContractsCreditClientsDeliveryDocumentationFinancialFinancial AnalysisFinancial auditsFinancial ReportingGeneral LedgerGLHyperi...	Catholic Charities of Baltimore is currently seeking a Senior Accountant, who will be accountable for program accounting, special projects, and other analytical projects as assigned. The hybrid work schedule is Monday Friday, 8:30am 4:30pm. JOB DUTIES & RESPONSIBILITIES: Prepares financial statements including the calculation, write up and posting of all journal entries.Maintains high degree of working knowledge of applicable funding source regulations and requirements.Prepares annual budgets and periodic projections for assigned programs.Prepares documents and schedules for internal and external audits as requested.Performs other duties as assigned. EDUCATION & EXPERIENCE REQUIREMENTS:Bachelor of Science in Accounting or Finance.Minimum 5 years relevant experience. REQUIRMENTS & ABILITIES: Extensive knowledge of accounting processes, regulations, and procedures.Researches and analyzes technical issues and financial data.Recognizes impending andor significant issues and problem ...	0.0

• Loss: CosineSimilarityLoss with these parameters:

  {
      "loss_fct": "torch.nn.modules.loss.MSELoss",
      "cos_score_transformation": "torch.nn.modules.linear.Identity"
  }
  

Evaluation Dataset

Unnamed Dataset

• Size: 879 evaluation samples
• Columns: sentence1, sentence2, and score
• Approximate statistics based on the first 100 samples:

  	sentence1	sentence2	score
  type	string	string	float
  modality	text	text
  details	min: 321 tokens mean: 508.33 tokens max: 512 tokens	min: 63 tokens mean: 378.46 tokens max: 512 tokens	min: 0.0 mean: 0.31 max: 1.0

• Samples:

  sentence1	sentence2	score
  Career OverviewMeticulous Senior Software Test Analyst who undertakes complex assignments, meets rigid deadlines and delivers superior performance. Possess practical knowledge on analyzing Bank Payments. Applies strong technical and analytical skills to inform Senior Management, Clients and Technology of key issues in the application and help the clients by providing good recommendations. Operates with a strong sense of urgency and thrives in a fast paced setting. QualificationsJava, SQL, PL/SQL, HTMLApplications : HP Quality Centre 10, IBM Mainframe (AS400).Visual Studio 2015, VMware 12Pro, MSOffice13, Tableau, MS Visio, E-Draw MySQL, MS Access, Oracle SQL DeveloperOperating systems : Proficient on Windows 7/ 8.1 / 10, Linux (Ubuntu, Fedora)Certification : International Software Testing Qualification Board (ISTQB), Six Sigma, MS SQL, A+academic Project: - Store Management SystemStrong analytical skillsStructured query language (SQL) expertInformation securityProje...	Description What were looking for At AppFolio, we paddle as one. We ride and make waves together, with a relentless focus on building great products for the way our customers work and live today and tomorrow. AppFolio is a destination organization where careers are made and accelerated. Here, innovation is a team sport. We're looking for experienced engineers to help build AppFolio Investment Management. AppFolio Investment Management (https:www.appfolioinvestmentmanagement.com) product is a fast-growing internal startup of a successful, established SaaS company (https:www.appfolioinc.com). We are going after the $7 trillion and growing private equity market which largely still runs on spreadsheets and email. Starting with private equity real estate, we are helping private equity firms build and manage their businesses with purpose-built software that enables them to do everything from investor relations to fundraising to managing the elaborate capital stacks common in modern-day p...	1.0
  Professional SummarySeeking Challenging and Rewarding Assignments with a growth Oriented Organization My Role Worked on Hybrid driven framework in WebDriver and Page Object Model. Good knowledge of creating xpath to find dynamic objects. Good knowledge of writing test script using Selenium-WebDriver with TestNG. Experienced in developing test automation scenarios and scripts for Web applications. Experienced in developing Generic Scripts and Project Specific Scripts. Working experience of Apache POI APIs, TestNG, , Jenkins for continuous integration testing Basic knowledge of Selenium IDE. Good understanding and analysis of client requirements and experienced in creating suitable Automation scripts. Exposure to all stages of SDLC & STLC and good understanding of ATLC (Automation Testing Life Cycle).Analyze requirements and conduct requirement clarification session for team SkillsTest Management Tools :HP ALM 11, Caliber, HP-Quality Centre, CA Central Rally ,JiraDatabase/Language:Oracle...	About Grainger Grainger is a leading broad line distributor with operations primarily in North America, Japan and the United Kingdom. We achieve our purpose, We Keep the World Working, by serving more than 4.5 million customers with a wide range of products that keep their operations running and their people safe. Grainger also delivers services and solutions, such as technical support and inventory management, to save customers time and money. We're looking for passionate people who can move our company forward. As one of the 100 Best Companies to Work For, we have a welcoming workplace where you can build a career for yourself while fulfilling our purpose to keep the world working. We embrace new ways of thinking and recognize everyone is an individual. Find your way with Grainger today. Position Details The Engineering Business Analyst has the responsibility of being very deep in our technology project and product work and being a key team member who knows all aspects. The Engineeri...	1.0
  Career OverviewSeeking a job where I can effectively utilize my academic knowledge and learn new skills to continually enhance the development of my professional skills. QualificationsProficient or familiar with a vast array of programming languages, concepts and operating systems, including:C, Windows 98/2000/03/XP/VISTA/7/8/10,Adobe Photoshop, Visual StudioNetwork fundamentals,MATLAB, SQL Server 2008R2,2012.SSIS,SSAS,SSRSMultisim, simulink, ImageProcessing.SQL, T-SQL. SQL Server 2012/2008/2005 Enterprise Edition, SSIS, SSRS, PPS, MS PowerPoint, MS Project, MS Access 2003 ,Oracle, Business Objects ,SharePoint , PL/SQL, C#,VB.Net,ASP.NET, XML, Visual Studio 2008 & 2005,MS Visio 2007,Borland StarTeam, Build Forge, Visual SourceSafe Work Experience02/2017toPresentJr Data analystApex Systems–Gulfport,MS,Underwent internship program conducted by BSNL Telecommunications Vijayawada.Trained in designing PULSE DIGITAL CIRCUITS.Underwent internship program as Data Analyst at A4 Softech.Activiti...	Who we are:Founded in 2017, Gatik is the leader in autonomous middle mile logistics. We deliver goods safely and efficiently using medium duty trucks with a focus on short-haul, B2B logistics for Fortune 500 customers such as Walmart and Loblaw. Gatik enables our customers to optimize their hub-and-spoke operations, enhance service levels and product flow across multiple locations while reducing labor costs and meeting an unprecedented expectation for faster deliveries. About the role:We are seeking passionate Staff Software Engineers, who have strong fundamentals in software development practices and are experts in C++ language in production-oriented environment. The ideal candidate is a highly experienced C++ developer with a passion for enabling the world's first safe, reliable & efficient network of autonomous vehicles. You will partner with the research and software engineers to design, develop, test and validate AV features for our autonomous fleet. This role will be onsite 4 day...	0.0

• Loss: CosineSimilarityLoss with these parameters:

  {
      "loss_fct": "torch.nn.modules.loss.MSELoss",
      "cos_score_transformation": "torch.nn.modules.linear.Identity"
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 16
• learning_rate: 2e-05
• warmup_steps: 0.1
• fp16: True
• per_device_eval_batch_size: 16

All Hyperparameters

Click to expand

• per_device_train_batch_size: 16
• num_train_epochs: 3
• max_steps: -1
• learning_rate: 2e-05
• lr_scheduler_type: linear
• lr_scheduler_kwargs: None
• warmup_steps: 0.1
• optim: adamw_torch_fused
• optim_args: None
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• optim_target_modules: None
• gradient_accumulation_steps: 1
• average_tokens_across_devices: True
• max_grad_norm: 1.0
• label_smoothing_factor: 0.0
• bf16: False
• fp16: True
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• use_liger_kernel: False
• liger_kernel_config: None
• use_cache: False
• neftune_noise_alpha: None
• torch_empty_cache_steps: None
• auto_find_batch_size: False
• log_on_each_node: True
• logging_nan_inf_filter: True
• include_num_input_tokens_seen: no
• log_level: passive
• log_level_replica: warning
• disable_tqdm: False
• project: huggingface
• trackio_space_id: None
• trackio_bucket_id: None
• trackio_static_space_id: None
• per_device_eval_batch_size: 16
• prediction_loss_only: True
• eval_on_start: False
• eval_do_concat_batches: True
• eval_use_gather_object: False
• eval_accumulation_steps: None
• include_for_metrics: []
• batch_eval_metrics: False
• save_only_model: False
• save_on_each_node: False
• enable_jit_checkpoint: False
• push_to_hub: False
• hub_private_repo: None
• hub_model_id: None
• hub_strategy: every_save
• hub_always_push: False
• hub_revision: None
• load_best_model_at_end: False
• ignore_data_skip: False
• restore_callback_states_from_checkpoint: False
• full_determinism: False
• seed: 42
• data_seed: None
• use_cpu: False
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• dataloader_prefetch_factor: None
• remove_unused_columns: True
• label_names: None
• train_sampling_strategy: random
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• ddp_static_graph: None
• ddp_backend: None
• ddp_timeout: 1800
• fsdp: None
• fsdp_config: None
• deepspeed: None
• debug: []
• skip_memory_metrics: True
• do_predict: False
• resume_from_checkpoint: None
• warmup_ratio: None
• local_rank: -1
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

Epoch	Step	Training Loss	Validation Loss	resume-job-valid_spearman_cosine
-1	-1	-	-	0.0392
0.0850	50	0.2453	-	-
0.1701	100	0.2256	0.2308	0.1767
0.2551	150	0.1966	-	-
0.3401	200	0.1563	0.2767	0.2164
0.4252	250	0.1409	-	-
0.5102	300	0.1311	0.2539	0.3165
0.5952	350	0.1073	-	-
0.6803	400	0.1139	0.2544	0.3473
0.7653	450	0.1048	-	-
0.8503	500	0.1002	0.2847	0.3509

Training Time

• Training: 13.0 minutes

Framework Versions

• Python: 3.12.13
• Sentence Transformers: 5.6.0
• Transformers: 5.12.1
• PyTorch: 2.11.0+cu128
• Accelerate: 1.14.0
• Datasets: 5.0.0
• Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}