Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Paper • 1908.10084 • Published • 16
How to use ennygaebs/cv-job-matcher-mini with sentence-transformers:
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("ennygaebs/cv-job-matcher-mini")
sentences = [
"Summarytyee\nHighlightsMicrosoft Excel, Word, Outlook, Power Point, FileZilla, QuickCap\nEducationWestminster CollegeSalt Lake City,UTExpected inMay 2014––Bachelor of Science:Economics French-GPA:Economics French Men's Soccer team - devoted 20 hours and gained valuable leadership and team-building experience \n*Fourth Year Senior Senator: as a member of the Education Sub-Committee worked with undeclared students to help determine their majorSalt Lake City Community CollegeTaylorsville,UTExpected inJun 2012––Associates of Science:-GPA:Public Relations Officer: assisted with college activities and marketing\nExperienceAltice Usa-Data AnalystTyler,TX,09/2015-06/2016Loading daily, weekly, or monthly enrollment files into QuickCap and performing a reconciliation on members added / subtracted vs.the previous file.Performing a monthly reconciliation on enrollment files vs.capitation payments.Performing a monthly reconciliation of per member, per month utilization and costs by client.Creating canned and custom reports via Data Reporting Services with the assistance of the Director of Data Analytics for the purpose of analyzing all aspects of business performance.Cisco Systems, Inc.-Security AnalystMinneapolis-St. Paul,MN,09/2014-01/1Allocated billions in trades by end of the day Monitor an average of 200 trade breaks daily with a 60-70% settlement rate at end of day Traded confirmation and allocation to client sub accounts Ensure accuracy and timeliness of real time customer trade confirmations to clients Allocated, monitored, and settled across all global markets for equity and fixed income trades Manages exceptions relating to sub-allocated trades Created and analyzed report dashboards and metrics for various daily, weekly and monthly reporting Facilitation of the account opening and documentation process with Operations.Bay City School District-Site SupervisorBay City,MI,08/2010-01/2014Tutored Junior and High School students; grades improved 20% following tutoring.Planned and scheduled monthly activities for afterschool programs and boxing gym.Swift Refrigerated-Customer Service CoordinatorChicago,IL,05/2007-12/2010Scored 100% on productivity and awarded best worker for the month.Assisted in car reservations and developed great customer service.Managed international and domestic car reservation portfolios.\nSkillsclient, clients, customer service, documentation, equity, fixed income, leadership, team-building, Director, marketing, Microsoft Excel, Outlook, Power Point, Word, Public Relations, real time, reporting, tutoring",
"Our Client, an Innovative Company, has spent the past decade focused on the design and development of advanced technology for commercial applications. As they prepare for the next phase of their journey, they are in search of an accomplished and skilled Electrical Engineering Manager to join their team.\n\nIn the role of Electrical Manager Director, you will play a pivotal part in overseeing comprehensive electrical systems architecture. Your responsibilities will encompass providing expert technical guidance for product design elements, fostering collaboration with various teams, and seamlessly integrating components into a unified system. Reporting directly to the Electrical Engineering Director, you will be instrumental in devising engineering strategies, initiating new projects, and ensuring the effective utilization of technology and resources to fulfill customer demands.\n\nThis is an opportunity to work in a dynamic startup environment, where your contributions will make a tangible impact. Our Client values individuals who are eager to take on challenges, voice their ideas, and be accountable for their results.\n\nIf you have experience working in Electrical Architecture with specific experience in DFMEA, Lean Engineering Principles, Power Electronics, High Voltage Systems, ISO26262 Compliance, and ASPICE framework, we would like to hear from you.\n\nResponsibilities:\nShape complete electrical systems architecture, ensuring a robust vehicle network strategy.Develop and refine engineering strategies and processes.Provide technical direction and guidance for comprehensive product design, particularly focusing on electrical architecture.Identify emerging opportunities and spearhead new projects.Contribute to the company's core activities through a solid understanding of principles and applications.Offer leadership and accountability to ensure successful execution.\n\nRequirements:\nBachelor's degree in Engineering required; Master's degree preferred.A minimum of 10 years of experience in electrical system development and design, including electrical component development, validation, and launch.Strong analytical and decision-making skills.Experience in electrical engineering within an automotive context, with a minimum of 8 years of experience.Proven leadership abilities with excellent communication and interpersonal skills.Familiarity with problem-solving methodologies like DFMEA, six sigma design, and lean engineering.Experience with various automotive electrical systems.Understanding of ISO26262 and ASPICE processes.Awareness of cyber security risks and solutions.Capacity to develop innovative electrical architecture solutions.Occasional travel flexibility.\n\nLocation: Troy, Michigan (Onsite)Term: Full-time, PermanentRate: $130,000 - $150,000 - Negotiable on ExperienceBenefits: 15% Target Bonus Program, excellent PTO and Holiday calendar, 401K Matching, Strong Healthcare + More!\nIf you meet the above qualifications and are excited about the prospect of joining our team, please submit your resume and cover letter for consideration. We look forward to hearing from you!\nAt Human Capital Ventures, we are committed to promoting equality and diversity in all aspects of our business. We believe in creating supportive and inclusive environments where everyone can thrive, regardless of their race, ethnicity, gender, sexual orientation, religion, age, or ability. We strongly encourage applicants from diverse backgrounds to apply for our positions.",
"About the jobWe are seeking a Senior Full Stack Software Engineer to build and scale business-critical web products.\nThis is a unique opportunity to work alongside an experienced team that excels at building quality client products at scale. This position reports to a Development Team Lead.\nQualificationsEssential skills: Deep experience with Java Spring Boot (C# .NET experience may be considered). React skills are a plus.\nHelpful skills: AWS, Kubernetes, Docker, Argo CD, Atlas, and GitHub ActionsThe role also requires a voracious appetite to learn and apply new skills. You should be skilled at building web-based software or mobile apps, and excel at building software with different sets of tools and in different client environments.\nKey Responsibilities include:Design, build, scale, and enhance Software Products, Apps, and Platforms based on Client Needs and Business RequirementsCommunicate Technical Topics clearly, in language that can be easily understood by ClientsCollaborate with Designers, and Product Teams to propose solutions to meet the goals of Clients and their ProductsDefine, refine, and document Best Practices that enable excellent team performance\nWere looking for someone who:Has 5+ years of full-stack software development experienceHas experience building and scaling Software ProductsHas experience architecting and deploying Software Products to Cloud Providers like Google Cloud, Amazon Web Services, or Azure\nBenefitsRemoteUnlimited PTOSubsidized Medical, Dental, and Vision InsuranceShortLong Term DisabilityProfit SharingReferral BonusesCompany Retreats\nCompany DescriptionBellwood Labs is a dynamic Product Development Consultancy. We're a team of developers, designers, marketers, and entrepreneurs that companies turn to when they want to take a software product from conception to creation.\nOur MissionBellwood Labs seeks to be and be known as the most trusted partner to develop and advance software products.\nOur Core ValuesWe Embrace Your GoalsWe Own our CommitmentsWe Succeed through EmpathyWe Take the Next Step\nJoin our tight-knit team of sharp technologists to leverage your talents and grow your skills. We are looking forward to meeting with you!",
"Role - Business Analyst - Mobile Location - Louisville, KY (Onsite) \nResponsibilities:Evaluating business processes, anticipating requirements, uncovering areas for improvement, and developing and implementing solutions. Leading ongoing reviews of business processes and developing optimization strategies. Staying up-to-date on the latest process and IT advancements to automate and modernize systems. Conducting meetings and presentations to share ideas and findings. Performing requirements analysis. Documenting and communicating the results of your efforts. Effectively communicating your insights and plans to cross-functional team members and management. Gathering critical information from meetings with various stakeholders and producing useful reports. Working closely with clients, technicians, and managerial staff. Providing leadership, training, coaching, and guidance to junior staff. Allocating resources and maintaining cost efficiency. Ensuring solutions meet business needs and requirements. Performing user acceptance testing. Managing projects, developing project plans, and monitoring performance. Updating, implementing, and maintaining procedures. Prioritizing initiatives based on business needs and requirements. Serving as a liaison between stakeholders and users. Managing competing resources and priorities. Monitoring deliverables and ensuring timely completion of projects. \nRequirements: A bachelor's degree in ITComputer Science or related field or an MBA. 10+ years of experience in business analysis or a related field. Exceptional analytical and conceptual thinking skills. The ability to influence stakeholders and work closely with them to determine acceptable solutions. Advanced technical skills. Excellent documentation skills. Fundamental analytical and conceptual thinking skills. Experience creating detailed reports and giving presentations. Competency in Microsoft applications including Word, Excel, and Outlook. A track record of following through on commitments. Excellent planning, organizational, and time management skills. Experience leading and developing top-performing teams. A history of leading and supporting successful projects. "
]
embeddings = model.encode(sentences)
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [4, 4]This is a sentence-transformers model finetuned from sentence-transformers/all-MiniLM-L6-v2. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
SentenceTransformer(
(0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
"SummaryData Entry experienced and adept at inputing and maintaining databases. Certified in 10-key and skilled at creating effective organizational and filing systems. Types 60 WPM. Experience working in office setting with confidentiality as one of my top priorities.\nHighlightsMicrosoft Office proficiencyMeticulous attention to detailSelf-directedExcellent communication skillsStrong problem solverResourcefulPleasant demeanorCustomer service-orientedMulti-line phone proficiencyFiling and data archivingHIPAA complianceTime management\nEducationGED \nSprague High SchoolSalem,ORExpected in––High School Diploma:-GPA:Chemeketa Community CollegeSalem,ORExpected in––Associate of Arts:2 year Oregon transfer degree-GPA:Sept 2011 to present/96 credit hours with associates degree anticipated.\nExperienceWestern Paper Distributors-Receptionist/Data EntryAlbuquerque,NM,08/2011-11/2015Arranged appropriate travel, agendas, necessary contacts and flight information.Scheduled meetings and assisted with meeting materials and agendas.Handled and distributed all incoming and outgoing mail.Managed incoming and outgoing calls for office.Scheduled and confirmed appointments.Communicated with employees via phone, email and in person to obtain and give information.Successfully established effective systems for record retention by creating database for daily correspondence tracking. Data entry main part of daily job duties.Arlington County, Va-Human Services SpecialistArlington,VA,11/2008-08/2011Interviews applicants to determine need and eligibility and then makes a preliminary assessment of client's needs and explores alternative resources to link clients to.Questions applicant to verify information.Explains rules, regulations, procedures and responsibilities to applicants.Makes changes to client's information based on reported changes (eg, changes in household, income, or resources).Makes decisions for continued eligibility and issues benefits for state food stamp, medical, daycare, Domestic Violence program and other programs for clients of the Department of Human Services.Daily contact with applicants, outside community partners, community resources and providers.Telephone, in person, and email contact daily.Sometimes deal with hostile individuals.Fhi 360-Program AssistantDurham,NC,07/2008-11/2008Work closely with JOBS program participants.Regularly update attendance on Tracs, make new steps for activities, set-up daycare for JOBS clients and answer daycare questions.Conduct home visits, make follow-up phone calls, narrate information using Tracs system.Navigate all DHS screens to find information regarding client's case information, answer phone calls, emails, and file case information in client files.Work with clients on employment goals, Work experience sites, JOBS Plus sites, and others.Assist TANF case managers with case load.Montgomery County, Oh-Transition CounselorDayton,OH,02/2008-07/2008Work from a client centered practice framework- providing high quality personal support to assist them to address a range of barriers which may be preventing them from moving forward.Establish a positive working relationship with clients, which are founded on dignity and respect.Provide assessment of clients and develop clear and transparent solution focused action plans for transitional purposes.Provide relevant and timely information and advice to clients to enable them to make informed decisions and develop problem solving capacity for when they release from custody.Advocate with and for clients where appropriate in a way that build their capacity and confidence to advocate on their own behalf.Source appropriate services and provide supported referral to specialized services including drug.and alcohol, housing, food, counseling, clothing resources, parole and probation etc.Teach life skill classes around transitional services.Case manage individuals.Follow the expectations of the Department of Corrections.Arlington County, Va-Corrections Transition CoordinatorArlington,VA,03/2007-08/2007Transition Services include: Conducting classes for individuals 120 days from release, processing social security and birth certificate applications, finding suitable housing, clothing, food boxes, etc.Extensive communication with the public, outside resources, and other state and county agencies.Meeting with inmates to provide one on one service, interviewing and taking notes on their individual needs.Helping to find resources for them in the county they are paroling to.Answering kytes (in-facility communication), emails, and phones.Attending meetings, trainings, and workshops.Researching community resources, finding mentors, and services.Handing out food stamp packets, disability packets, DMV info, and many other items that individuals incarcerated may need.Handling phone conferences between outside resources and the inmates, and parole offices and the inmates.Setting up call-outs for appointments such as, Parole officers, community partners, transition fairs, housing, and mentors.Teaching classes and getting individuals into the institution for speaking engagements.Collaboration of agencies to remove barriers that prevent offenders from accessing services.Establish structured community referral system including having ongoing communication and collaboration among community corrections and other various organizations.Use faith-based services and Home For Good Program.Have over 250 community contacts for the transition program at Santiam and Mill Creek.Over 65% of time is spent communicating with outside community and partner organizations to help incarcerated individuals transition successfully into the community.Work closely with institution counselors, security staff, and management team.Security, assist with transition services for paroling inmates.Department Of Corrections-Corrections OfficerCity,STATE,07/2005-03/2007Provide positive reinforcement to inmates, patrol housing, and conduct bunk searches.Interact continuously with inmates; provide positive reinforcement when appropriate, and role model appropriate behavior using the Oregon Accountability Model.Prepare and write a variety of reports regarding inmate conduct and other institutional issues using a wide range of programs including DOC 400.Restrain violent inmates, may sight and fire weapons, patrol housing units keeping constant control of housing unit and inmate population.Conduct bunk searches and may come in contact with unsafe items.Enter and retrieve information using a computer, and answer housing unit telephones.Conduct inmate pat downs that include: inspecting inmates for contraband hidden in various areas.Distinguishing distant emergency whistles, listen for whispers and conversations at a distance, and react instantly and appropriately to emergencies.Supervise inmates in a variety of housing and work environments.Operates an institution vehicle to transport inmates.Always works as a team player keeping DOC procedures and policies in mind.DPSST trained.Department Of Human Services-Human Services SpecialistCity,STATE,11/2004-03/2005Manage caseload, determine ongoing client eligibility, and make referrals.My duties in this position where as follows: Assessing the needs of applicants, determining eligibility, issuing benefits for the Food Stamp and state medical programs, managing a caseload that varied from 150-200 clients at a time, kept up on all eligibility requirements including rules and regulations, made referrals for clients to outside local agencies that could possibly assist them, answered a mulit-line phone, responded to numerous emails per day from inside my agency and outside partners in the community, case managed and determined ongoing eligibility at review time, responded to a high volume of mail that came in every day, prepared and maintained proper narration on each client's case using computer program, typed up letters and memos that went out to clients, conducted face to face interviews to gather information that would help me determine eligibility, team work, and client/customer confidentiality.Explained food stamp and state medical program guidelines, policy and procedures to clients and potential clients.Monitored client's cases for updates, case status, and case reviews/re-determinations.I also received experience working the front reception desk and seeing a high number of people on a daily basis some who became irate or hostile, answered many questions regarding different programs available, handed out applications, helped clients and potential clients fill out applications and other material, referred clients to other outside resources in their community, answered a multi-line telephone and either transferred the calls to the appropriate person or helped the caller with questions surrounding their benefits or the program they were on, working the mailroom which including retrieving all incoming mail and distributing to workers and managers in office, being extremely organized and timely, processed applications and reapplications for the food stamp, medical, and TANF.",
'ROR Partners is a rapidly growing, client-driven digital marketing and data company. We offer proven marketing solutions to a variety of vertical industries on a nationwide basis.\nROR is seeking a Principal Data Engineer to serve as a key data architect and team leader on our data engineering team. The successful candidate will have demonstrated deep understanding and passion for designing and implementing robust ETL and ELT data pipelines. Position is remote and reports to the VP, Engineering. Salary is $170K to $195K and is determined by factors such as location, experience, and expertise. \nWhat you will doBuild, maintain, and administer our Snowflake data warehouse using Data Build Tool (dbt)Implement and maintain data pipelines between various operational systems and our data warehouse using Python, Airflow and integration platformsCreate and maintain documentation of data architectureCollaborate with internal and external stakeholders to ensure that data requirements are addressedMentor and lead other data engineering team members and participate in peer design and code reviewsShip production-quality features independentlyWork efficiently and productively in a remote-first work environmentCommunicate and collaborate effectively, both verbally and in writingLearn independently - keep up to date with developments in the field\nQualificationsWhat we are looking forHistory of professional experience shipping production quality code independentlyAbility and desire to lead and mentor a team of data engineersExpertise with SQL and cloud-based analytical data warehouses (Snowflake preferred)Expertise building end-to-end data pipelines using Airflow and dbt (data build tool) or comparable technologiesDeep understanding of ETL and ELT patterns and best practicesStrong data modeling skills and familiarity with the Kimball data warehousing methodologyExperience writing Python code for data processingDesire to continually keep up with advancements in data engineering practicesExperience conducting design and code reviewsStrong analytical skills and independent learning styleExperience with git and use of the command line requiredExperience with AWS and CloudFormation, or comparable cloud services and IaC tools preferredExperience with Docker and Docker Compose preferredSubject matter familiarity with digital marketing and digital activation is preferred\nEducationTrainingRequired: BS Degree in computer science or related STEM field\nExperience8+ years of experience in data science, software engineering or related technical fields.\nROR Partners is an Equal Opportunity Employer. ROR Partners policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law. ROR Partners also prohibits harassment of applicants and employees based on any of these protected categories.\nROR Partners will provide accommodations to applicants as needed.',
"Driven, empowering, transformative. Academic Partnerships creates collaborative, student centered partnerships with the universities we serve. At AP, we drive change through innovation in online education using the strengths, experience, and culture of our people. As a leader in online program management, we are focused on supporting scalable online program success for our university partners and the students they serve, their local communities, school systems, business, and the local labor market. Our OneAP, culture is built on the foundation of our mission - to increase access to high-quality, affordable, and workforce-relevant education.\nWe're seeking a driven, highly motivated Sr. Marketing Analyst to join our Business Transformation and Operations team (Btop). As Sr. Marketing Analyst, you will gain exposure to all aspects of marketing, both strategic and tactical, across all marketing channels. Through mentorship from senior members of the leadership team, you will help conduct analysis to shape APs key strategic initiatives. Working on a cross-functional project basis, you will be responsible for helping to structure problems, develop hypotheses, and deliver value-add strategic recommendations to drive overall business growth\nResponsibilities Include\nAssist in the development and execution of marketing strategies and campaignsAnalyze the performance of marketing campaigns to improve targeting and ROIDevelop reports highlighting opportunities for marketing campaignsPartner with external vendors (Google, Facebook, etc.) to implement marketing best practicesWork closely with cross-functional teams to gather and analyze data, identify key performance indicators (KPIs), and provide insights on performance trends, risks, and opportunitiesUtilize data-driven insights, ranging from customer performance to internal operations, to identify areas of improvement and develop actionable recommendationsForm a deep understanding of APs processes, systemstools, personnel, strategic direction, and broader market ecosystem (university partners, marketing channels, contact center operational dynamics)Work closely with Directors on the Business Transformation & Operations team (Transformation Strategy & Ops, Partner Strategy & Analytics, Revenue Strategy & Analytics, Operations & Analytics) in shaping the future of the organization through data-driven insights and strategic decision-makingHigh intensity, high impact projects with rewarding career development and growthA dynamic and fast-paced work environment that requires agility and adaptability to meet evolving business needsCollaboration with cross-functional teams and exposure to various stakeholders, including executive leadership\nRequirements Include\nBachelor's degree requiredAt least 5 years of experience in analytics areaProficient in SQL.Fluent in MS ExcelPython R preferredPrior experience in marketing analytics preferredDemonstrated knowledge of Web Analytics tools (Google Analytics, Adobe Analytics, etc.)Demonstrated knowledge of StatisticsAB Testing experienceGood communication and presentation skillsStrong analytical and problem-solving skillsCollaborative problem-solving mindset and the ability to work effectively in cross-functional teams, driving change through influenceDemonstrated ability to work through complex business problems and partner with internal clients using consultative approach\nAcademic Partnerships Offers The Following Comprehensive Benefits\nPTO accumulated from day one11 designated holidaysMedical four options (including PPO and HDP)DentalVisionLife & Disability (company paid)Flexible Spending Account & Health Savings Account (company contribution to HSA)Retirement plan with company matchMaternity Paternity Parental Leave (company paid)Volunteer Time Off\nSupplemental Benefits\nWellness programAlternative medicine optionsPet discountsAccident, Critical Illness and Hospital Indemnity\nPersonal And Professional Development\nContinuous Professional and Leadership Development ProgramsTuition Reimbursement for employees and their dependents\nAcademic Partnerships is an equal opportunity employer and supports a diverse and inclusive workforce.\n",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
sentence_0, sentence_1, and label| sentence_0 | sentence_1 | label | |
|---|---|---|---|
| type | string | string | float |
| details |
|
|
|
| sentence_0 | sentence_1 | label |
|---|---|---|
Professional BackgroundAnalyst versed in data analysis and reporting, user acceptance testing, as well as solving complex problems in high-pressure environments. Excels at cultivating, managing, and leveraging relationships |
Job Description |
0.0 |
SummaryHighly motivated Sales Associate with extensive customer service and sales experience. Outgoing sales professional with track record of driving increased sales, improving buying experience and elevating company profile with target market. |
NDI Engineering Company is seeking a Junior Electrical Engineer with 1 to 3 years of designing experience on Ship Hull, Mechanical and Electrical (HM&E), Power Plant Systems and controls engineering. Relevant experience related to electrical equipment, power, controls, PLC, electrical design or similar will be strongly considered. Requires experience using AutoCAD, or other drafting programs and SKM Power Tools. Candidate must have a BS Degree in Electrical Engineering from an accredited school. Candidate must be a U.S. Citizen and be able to obtain and maintain a U.S. Department of Defense Security Clearance. Location: Thorofare, NJ. |
0.0 |
SummaryCapable fund Accountant successful at managing multiple projects and consistently meeting deadlines under pressure. Extensive knowledge of accounting software and processes. Ability to work well with others in a difficult and constantly changing landscape. A true team player. |
Position: Junior AccountantDepartment: Finance & AdministrationReports to: ControllerFLSA Status: Exempt |
1.0 |
CosineSimilarityLoss with these parameters:{
"loss_fct": "torch.nn.modules.loss.MSELoss"
}
per_device_train_batch_size: 16per_device_eval_batch_size: 16num_train_epochs: 7multi_dataset_batch_sampler: round_robinoverwrite_output_dir: Falsedo_predict: Falseeval_strategy: noprediction_loss_only: Trueper_device_train_batch_size: 16per_device_eval_batch_size: 16per_gpu_train_batch_size: Noneper_gpu_eval_batch_size: Nonegradient_accumulation_steps: 1eval_accumulation_steps: Nonetorch_empty_cache_steps: Nonelearning_rate: 5e-05weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1num_train_epochs: 7max_steps: -1lr_scheduler_type: linearlr_scheduler_kwargs: {}warmup_ratio: 0.0warmup_steps: 0log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Truesave_safetensors: Truesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseno_cuda: Falseuse_cpu: Falseuse_mps_device: Falseseed: 42data_seed: Nonejit_mode_eval: Falseuse_ipex: Falsebf16: Falsefp16: Falsefp16_opt_level: O1half_precision_backend: autobf16_full_eval: Falsefp16_full_eval: Falsetf32: Nonelocal_rank: 0ddp_backend: Nonetpu_num_cores: Nonetpu_metrics_debug: Falsedebug: []dataloader_drop_last: Falsedataloader_num_workers: 0dataloader_prefetch_factor: Nonepast_index: -1disable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Falseignore_data_skip: Falsefsdp: []fsdp_min_num_params: 0fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}tp_size: 0fsdp_transformer_layer_cls_to_wrap: Noneaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}deepspeed: Nonelabel_smoothing_factor: 0.0optim: adamw_torchoptim_args: Noneadafactor: Falsegroup_by_length: Falselength_column_name: lengthddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Trueuse_legacy_prediction_loop: Falsepush_to_hub: Falseresume_from_checkpoint: Nonehub_model_id: Nonehub_strategy: every_savehub_private_repo: Nonehub_always_push: Falsegradient_checkpointing: Falsegradient_checkpointing_kwargs: Noneinclude_inputs_for_metrics: Falseinclude_for_metrics: []eval_do_concat_batches: Truefp16_backend: autopush_to_hub_model_id: Nonepush_to_hub_organization: Nonemp_parameters: auto_find_batch_size: Falsefull_determinism: Falsetorchdynamo: Noneray_scope: lastddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Noneinclude_tokens_per_second: Falseinclude_num_input_tokens_seen: Falseneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseeval_on_start: Falseuse_liger_kernel: Falseeval_use_gather_object: Falseaverage_tokens_across_devices: Falseprompts: Nonebatch_sampler: batch_samplermulti_dataset_batch_sampler: round_robin| Epoch | Step | Training Loss |
|---|---|---|
| 1.2788 | 500 | 0.1263 |
| 2.5575 | 1000 | 0.0864 |
| 3.8363 | 1500 | 0.0674 |
| 5.1151 | 2000 | 0.0566 |
| 6.3939 | 2500 | 0.0492 |
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
Base model
nreimers/MiniLM-L6-H384-uncased