Hugging Face's logo

dnth
/
ssf-retriever-modernbert-embed-base

Sentence Similarity
sentence-transformers
Safetensors
modernbert
feature-extraction
dense
Generated from Trainer
dataset_size:4180
loss:MultipleNegativesRankingLoss
text-embeddings-inference
Model card Files
xet
 Community
dnth commited on
Commit
c978679
·
verified ·
1 Parent(s): b2c0b68

Add new SentenceTransformer model

Browse files
Files changed (2) hide show
  1. README.md +188 -173
  2. model.safetensors +1 -1
README.md CHANGED
@@ -9,131 +9,148 @@ tags:
9
  - loss:MultipleNegativesRankingLoss
10
  base_model: nomic-ai/modernbert-embed-base
11
  widget:
12
- - source_sentence: The Claims Liaison Executive is responsible for collecting and
13
- documenting relevant information for claims. He/She identifies any issues with
14
- claims and follows up to ensure corrective actions are taken. He generates claims
15
- loss ratio reports for customers. He is also responsible for monitoring any requests
16
- and queries received in order to effectively service customers. The Claims Liaison
17
- Executive possesses excellent organisational skills with strong attention to detail.
18
- He is meticulous and service-oriented, ensuring that claims are serviced effectively
19
- and handled promptly for customers.
20
  sentences:
21
- - Rooms Division Manager job opening focused on overseeing front office and housekeeping
22
- operations, driving revenue growth, enhancing guest satisfaction, and leading
23
- strategic planning and performance initiatives in a hotel setting.
24
- - Insurance Risk Management Analyst required to assess and document relevant data
25
- for risk evaluations. This position focuses on identifying potential risks and
26
- implementing strategies to mitigate them. The analyst will generate risk assessment
27
- reports for stakeholders and manage inquiries related to risk management processes.
28
- Strong analytical skills and attention to detail are crucial, as the Insurance
29
- Risk Management Analyst must ensure that risks are evaluated comprehensively and
30
- addressed promptly for stakeholders.
31
- - Claims Processing Specialist needed to gather and record essential information
32
- for insurance claims. This role involves identifying claim discrepancies and ensuring
33
- timely corrective actions. The specialist will prepare loss ratio reports for
34
- clients and manage incoming requests and inquiries to provide excellent customer
35
- service. Strong organizational skills and attention to detail are essential, as
36
- the Claims Processing Specialist must be thorough and customer-focused in handling
37
- claims efficiently.
38
- - source_sentence: The Head of Data Analytics oversees all data analytical functions
39
- within the organisation, and is responsible for managing its use to support data
40
- needs and value-add to the organisation. He/She is accountable for developing
41
- organisational data analytics capability to support creation of solutions, derive
42
- insights to support business decision-making and guide development of strategies.
43
- He ensures the usability and presence of tools and processing systems to support
44
- the optimal usage of data analytics. The Head of Data Analytics is a logical and
45
- highly analytical thinker who is able to quickly comprehend and understand large
46
- amounts of data. He is familiar with a variety of data analytics tools and methodologies.
47
- He is strategic and able to draw connections between data, business solutions,
48
- commercial requirements and commercial value. He is able to work collaboratively
49
- with senior management from the business and is persuasive on the value of data.
50
  sentences:
51
- - Senior Data Analytics Manager responsible for leading data analytical initiatives,
52
- enhancing organizational data capabilities, and delivering actionable insights
53
- to drive strategic business decisions and optimize data usage across the company.
54
- - Job openings for Community Care Associates focused on elderly support, emphasizing
55
- quality interaction, engagement activities, and daily living assistance in various
56
- community settings, including senior care centers and nursing homes.
57
- - Junior Business Valuation Analyst tasked with conducting financial assessments
58
- and evaluations of business entities, focusing on market trends and financial
59
- performance metrics to provide insights for investment decisions and strategic
60
- planning in the financial services sector.
61
- - source_sentence: The Senior Engineer/Assistant Manager (Engineering Construction)
62
- leads discipline engineering support to projects on matters related to construction
63
- efficiency and installation of equipment, components and systems. He/She optimises
64
- project plans, leads constructability reviews, validates installation and assembly,
65
- and manages contractors. He leads mechanical completion activities and coordinates
66
- with stakeholders to ensure operational excellence and fulfilment of project requirements,
67
- while ensuring compliance with external regulations and organisational standards.
68
- He specialises in mechanical, electrical, control and instrumentation, civil,
69
- structural or geotechnical engineering disciplines. He manages a team of engineers
70
- and ensures efficient business operations. He possesses strong analytical, project
71
- management and problem-solving skills. He possesses leadership and stakeholder
72
- management skills. He works on-site, and is expected to travel occasionally to
73
- project locations
 
 
 
 
 
 
 
74
  sentences:
75
- - Job opening for a Load Control Manager focused on enhancing operational standards
76
- through collaboration with various departments and airlines, utilizing new technologies
77
- for load calculations and flight performance analysis. The role involves developing
78
- SOPs to ensure safety compliance, fostering team development, and maintaining
79
- stakeholder relationships while employing strategic thinking and strong analytical
80
- skills.
81
- - Junior Risk Analyst in Financial Services responsible for assessing risk factors
82
- in investment portfolios and developing mitigation strategies. Conducts thorough
83
- risk assessments, manages compliance with financial regulations, and collaborates
84
- with stakeholders to enhance risk management frameworks while ensuring sound financial
85
- practices.
86
- - Senior Project Engineer for Construction Management overseeing engineering support
87
- for project efficiency, installation processes, and contractor management. Responsible
88
- for optimising project execution, conducting constructability assessments, and
89
- ensuring compliance with industry regulations while leading a team of engineers.
90
- - source_sentence: The IT Business Solutions Project Specialist/Digital Services Project
91
- Specialist is responsible for providing consultancy and executing logistics IT
92
- business solutions including analysing and identifying customer needs, communicating
93
- and seeking endorsements for potential solutions, designing and implementing logistics
94
- system solutions for customers. He/She is also responsible for business account
95
- management. Analytical and systematic, he is required to explore solutions and
96
- identify ways to work closely with internal and external stakeholders on IT systems
97
- and IT solutions.
 
 
 
 
 
 
 
 
 
 
98
  sentences:
99
- - IT Project Specialist for Digital Solutions focusing on logistics, responsible
100
- for analyzing customer requirements, designing system solutions, and managing
101
- business accounts while collaborating with stakeholders.
102
- - Job opening for an Analyst specializing in Customer Insights and Analytics, focusing
103
- on gathering and analyzing customer research metrics from various data sources
104
- to inform business strategies. The role involves utilizing multiple customer measurement
105
- tools, social media analytics, and market research to organize data for insightful
106
- analysis. Responsibilities include performing data analysis with established techniques,
107
- generating insights for diverse customer segments, and preparing comprehensive
108
- reports based on analytical findings. Strong coordination and stakeholder management
109
- skills are essential, along with proficiency in analytics tools, research methodologies,
110
- and statistical models. Familiarity with machine learning, natural language processing,
111
- and advanced statistical modeling is preferred. Effective communication and creative
112
- problem-solving abilities are crucial, with a keen attention to detail.
113
- - Junior Risk Management Analyst in the financial sector, tasked with evaluating
114
- potential risks, developing mitigation strategies, and collaborating with teams
115
- to enhance compliance and regulatory standards in financial operations.
116
- - source_sentence: The Principal Engineer/Engineering Manager (Rolling Stock) leads
117
- cross-functional teams in maintenance work involving passenger trains. He/She
118
- also applies technical expertise to improve maintenance regime, provide advice
119
- on engineering studies and new engineering initiatives, as well as the engagement
120
- and management of external contractors. He is required to carry out his duties
121
- at various rail premises such as workshops, depots and plants. He possesses extensive
122
- knowledge of rolling stock and other rail systems, and has excellent problem solving
123
- and analytical skills. He also applies managerial skills to fulfil the responsibilities
124
- of operational activities and facilitates the implementation of organisational
125
- maintenance regimes and continuous improvement initiatives.
126
  sentences:
127
- - Equipment Engineer responsible for applying engineering principles in manufacturing
128
- to optimize equipment performance, oversee installations, and maintain machinery
129
- to reduce production delays while ensuring compliance with safety regulations.
130
- - Senior Engineering Manager for Passenger Train Maintenance overseeing cross-functional
131
- teams, enhancing maintenance strategies, and managing external contractors at
132
- rail facilities with expertise in rolling stock systems.
133
- - Junior Risk Analyst in the Financial Services sector responsible for assessing
134
- financial risks, developing risk management strategies, and collaborating with
135
- various departments to ensure compliance with regulations. Requires strong analytical
136
- skills and knowledge of financial markets.
 
 
 
 
 
 
 
 
 
 
137
  pipeline_tag: sentence-similarity
138
  library_name: sentence-transformers
139
  ---
@@ -188,9 +205,9 @@ from sentence_transformers import SentenceTransformer
188
  model = SentenceTransformer("dnth/ssf-retriever-modernbert-embed-base")
189
  # Run inference
190
  sentences = [
191
- 'The Principal Engineer/Engineering Manager (Rolling Stock) leads cross-functional teams in maintenance work involving passenger trains. He/She also applies technical expertise to improve maintenance regime, provide advice on engineering studies and new engineering initiatives, as well as the engagement and management of external contractors. He is required to carry out his duties at various rail premises such as workshops, depots and plants. He possesses extensive knowledge of rolling stock and other rail systems, and has excellent problem solving and analytical skills. He also applies managerial skills to fulfil the responsibilities of operational activities and facilitates the implementation of organisational maintenance regimes and continuous improvement initiatives.',
192
- 'Senior Engineering Manager for Passenger Train Maintenance overseeing cross-functional teams, enhancing maintenance strategies, and managing external contractors at rail facilities with expertise in rolling stock systems.',
193
- 'Junior Risk Analyst in the Financial Services sector responsible for assessing financial risks, developing risk management strategies, and collaborating with various departments to ensure compliance with regulations. Requires strong analytical skills and knowledge of financial markets.',
194
  ]
195
  embeddings = model.encode(sentences)
196
  print(embeddings.shape)
@@ -199,9 +216,9 @@ print(embeddings.shape)
199
  # Get the similarity scores for the embeddings
200
  similarities = model.similarity(embeddings, embeddings)
201
  print(similarities)
202
- # tensor([[ 1.0000, 0.8158, -0.0867],
203
- # [ 0.8158, 1.0000, -0.1099],
204
- # [-0.0867, -0.1099, 1.0000]])
205
  ```
206
 
207
  <!--
@@ -252,13 +269,13 @@ You can finetune this model on your own dataset.
252
  | | anchor | positive | negative |
253
  |:--------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
254
  | type | string | string | string |
255
- | details | <ul><li>min: 58 tokens</li><li>mean: 170.05 tokens</li><li>max: 355 tokens</li></ul> | <ul><li>min: 19 tokens</li><li>mean: 66.65 tokens</li><li>max: 204 tokens</li></ul> | <ul><li>min: 33 tokens</li><li>mean: 82.29 tokens</li><li>max: 193 tokens</li></ul> |
256
  * Samples:
257
- | anchor | positive | negative |
258
- |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
259
- | <code>The Cat A Certifying Technician performs simple scheduled line and base maintenance tasks within the limit specified in the authorisation certificate. He/She tests serviceability of aircraft line replacement units using test switches, built in test equipment (BITE) and other specialised test equipment. He informs remedial actions to rectify technical and service problems, and processes documentation in accordance with regulatory requirements. He is authorised to issue certificate of release to service (CRS) following maintenance within the limit of tasks specified in the authorisation certificate. He monitors compliance with airworthiness and legislative requirements, and oversees conformance to the organisation's standard operating procedures (SOPs), safety, health and quality systems. He implements continuous improvement initiatives and lean practices in the workplace. He works in a hangar or workshop and may be expected to work in shifts. He should posses a quality, safety and risk ...</code> | <code>Aircraft Maintenance Technician responsible for scheduled line and base maintenance tasks, testing serviceability of aircraft components using specialized equipment, and ensuring compliance with airworthiness regulations and organizational SOPs while implementing continuous improvement initiatives.</code> | <code>Junior Quality Assurance Inspector conducting routine inspections of manufacturing processes, assessing product compliance with safety and quality standards, and documenting findings according to regulatory guidelines. This role involves monitoring adherence to industry regulations and implementing quality improvement strategies in a factory setting. The inspector should have a keen eye for detail, be reliable, and work collaboratively to meet production targets.</code> |
260
- | <code>The Airside Duty Manager is responsible for collaborating with airport stakeholders to resolve operational airside issues. He/She manages contractors and issues stop-work orders to contractors who flout airside rules and policies. He also oversees operational systems to allocate stands and ensures the smooth running of these systems. In addition, he addresses internal or external safety and/or security audit issues and develops on-the-job training programmes and learning plans for his teams. The Airside Duty Manager possesses a sound knowledge of airport operations and airside safety management Standard Operating Procedures (SOPs). He is up-to-date on airport security and emergency plans. He possesses an Airside Driving Permit (ADP) to operate vehicles at the airside. Furthermore, he completes paperwork accurately and has good computer skills to manage Gate Management System (GMS), Long-Range Radar and Display System (LORADS) and other operational systems for managing stands allocation...</code> | <code>Airside Operations Manager overseeing collaboration with airport stakeholders to address airside operational challenges, managing contractors, and enforcing compliance with airside regulations. Responsible for the allocation of airport stands and the efficient operation of related systems. Conducts safety audits, develops training programs, and maintains knowledge of airport operations and safety procedures. Holds an Airside Driving Permit and proficient in utilizing Gate Management Systems and other operational tools while demonstrating strong leadership and communication skills.</code> | <code>Junior Airport Safety Coordinator responsible for monitoring safety compliance among airport staff and contractors. This role involves conducting safety inspections, reporting findings, and assisting in the development of safety training materials. The coordinator works closely with the airport management team to implement safety protocols and ensure adherence to industry regulations. Familiarity with safety management systems and strong organizational skills are essential, along with the ability to communicate effectively with various departments to promote a culture of safety at the airport.</code> |
261
- | <code>The Food Technologist develops and improves products through experimentation, performs tests on food ingredients and product prototypes, and ensures that correct methodologies are used to generate information for the required food quality and consistency standards. He/She holds a strategic role in the organisation, supporting the production function by providing food science expertise in designing processes to manufacture new food products with the required specifications on a commercial scale, and supporting the business development function in profiling products for marketing purposes and meeting regulatory requirements for sales and export. The Food Technologist may work in a food science laboratory and/or participate in cooking sessions in new product development. He should have good sensory skills to perform evaluations of flavours and to create new recipes and/or formulations for products. He should be able to work independently and possess analytical and problem-solving skills t...</code> | <code>Food product development specialist with expertise in enhancing recipes and conducting tests on ingredients, ensuring adherence to quality standards while supporting production and marketing strategies in a commercial environment.</code> | <code>Junior Quality Assurance Analyst responsible for monitoring compliance with health and safety regulations in a manufacturing setting, conducting routine inspections of production processes, and documenting findings to ensure products meet safety standards for consumer goods. The role requires attention to detail and the ability to collaborate with production teams to maintain quality control.</code> |
262
  * Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
263
  ```json
264
  {
@@ -274,16 +291,16 @@ You can finetune this model on your own dataset.
274
  * Size: 1,885 evaluation samples
275
  * Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
276
  * Approximate statistics based on the first 1000 samples:
277
- | | anchor | positive | negative |
278
- |:--------|:-------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
279
- | type | string | string | string |
280
- | details | <ul><li>min: 57 tokens</li><li>mean: 169.53 tokens</li><li>max: 347 tokens</li></ul> | <ul><li>min: 19 tokens</li><li>mean: 67.3 tokens</li><li>max: 194 tokens</li></ul> | <ul><li>min: 29 tokens</li><li>mean: 83.24 tokens</li><li>max: 220 tokens</li></ul> |
281
  * Samples:
282
- | anchor | positive | negative |
283
- |:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
284
- | <code>The Policy Officer assists in formulating, developing, implementing and evaluating policies. He/She collects on-the-ground information that will impact the formulation of the policies. He assists managers and directors in drafting of policy papers and supports the planning of public consultation activities. A proactive and responsible staff who is methodical in his approach, the Policy Officer works in schools, ministries and institutional settings.</code> | <code>The Policy Analyst collaborates in creating, executing, and assessing policies. They gather relevant data from various sources to inform policy development. They support senior management in writing policy documents and help organize community engagement initiatives. A detail-oriented and diligent team member, the Policy Analyst operates within educational institutions, government agencies, and organizational environments.</code> | <code>The Compliance Officer is responsible for monitoring and enforcing regulatory standards within the healthcare sector. They gather compliance data to ensure adherence to laws and regulations. They aid executives in preparing compliance reports and assist in coordinating training sessions for staff on regulatory requirements. A meticulous and dedicated individual, the Compliance Officer works in hospitals, clinics, and healthcare organizations.</code> |
285
- | <code>The Technician (Rolling Stock) works in a team to perform preventive and corrective maintenance of passenger trains. He/She assists in the preparation of maintenance work and supports the team in the conduct of fault analysis and testing to improve the reliability of passenger trains. He supervises the work of contractors and external stakeholders in ensuring adherence to safety requirements and operating standards. He may be deployed at various rail premises such as workshops, depots and/or maintenance plants to carry out his duties. He is technically inclined and adept, in the maintenance and/or repair of passenger train components. He is capable of communicating effectively within the team, able to multi-task and prioritises his assigned maintenance workload in supporting maintenance activities.</code> | <code>Technician position for passenger train maintenance, focusing on preventive and corrective tasks, fault analysis, and teamwork for improved train reliability.</code> | <code>Junior Technician in automotive repair responsible for routine inspections and maintenance of vehicles. This role involves assisting in diagnostic testing and troubleshooting to enhance vehicle performance. The technician collaborates with external vendors to ensure compliance with safety protocols and operational standards. Duties may include working in various automotive service centers and performing repairs on car components. Effective communication and multitasking skills are essential for handling the maintenance schedule and supporting repair activities.</code> |
286
- | <code>The Import Export Manager/ Freight Allocation Manager/ Freight Shipping Manager/ Freight Documentation Manager/ Freight Pricing Manager is responsible for managing and reviewing freight operational policies, standards and procedures in accordance to freight business and customers needs, including implementation of freight solutions. He/She is also responsible for managing freight business resources, including manpower, internal assets and external vendors. Resourceful and analytical, he/she is required to manage resources to obtain buy-in from internal and external stakeholders. He/She is also expected to lead a department, make business decisions independently and be accountable for the profit and loss of the department.</code> | <code>Import Export Coordinator responsible for overseeing and optimizing freight operations, ensuring compliance with policies and customer requirements, while implementing effective freight solutions. This role involves managing resources, including personnel and vendor relationships, and requires strong analytical skills to engage stakeholders effectively. The candidate will lead a team, make independent business decisions, and handle the department's financial performance.</code> | <code>Logistics Analyst tasked with evaluating and improving transportation efficiency, focusing on compliance with industry regulations and optimizing delivery processes. This role involves analyzing data related to supply chain operations, managing relationships with suppliers, and requires strong analytical capabilities to provide insights for operational improvements. The candidate will work collaboratively with internal teams to enhance logistics strategies and contribute to overall cost reduction initiatives.</code> |
287
  * Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
288
  ```json
289
  {
@@ -295,14 +312,18 @@ You can finetune this model on your own dataset.
295
  ### Training Hyperparameters
296
  #### Non-Default Hyperparameters
297
 
298
- - `eval_strategy`: steps
299
- - `per_device_train_batch_size`: 16
300
- - `gradient_accumulation_steps`: 2
301
- - `weight_decay`: 0.1
 
 
302
  - `lr_scheduler_type`: cosine
303
  - `warmup_ratio`: 0.1
304
- - `fp16`: True
 
305
  - `load_best_model_at_end`: True
 
306
  - `batch_sampler`: no_duplicates
307
 
308
  #### All Hyperparameters
@@ -310,22 +331,22 @@ You can finetune this model on your own dataset.
310
 
311
  - `overwrite_output_dir`: False
312
  - `do_predict`: False
313
- - `eval_strategy`: steps
314
  - `prediction_loss_only`: True
315
- - `per_device_train_batch_size`: 16
316
- - `per_device_eval_batch_size`: 8
317
  - `per_gpu_train_batch_size`: None
318
  - `per_gpu_eval_batch_size`: None
319
- - `gradient_accumulation_steps`: 2
320
  - `eval_accumulation_steps`: None
321
  - `torch_empty_cache_steps`: None
322
- - `learning_rate`: 5e-05
323
- - `weight_decay`: 0.1
324
  - `adam_beta1`: 0.9
325
  - `adam_beta2`: 0.999
326
  - `adam_epsilon`: 1e-08
327
  - `max_grad_norm`: 1.0
328
- - `num_train_epochs`: 3
329
  - `max_steps`: -1
330
  - `lr_scheduler_type`: cosine
331
  - `lr_scheduler_kwargs`: {}
@@ -346,13 +367,13 @@ You can finetune this model on your own dataset.
346
  - `data_seed`: None
347
  - `jit_mode_eval`: False
348
  - `use_ipex`: False
349
- - `bf16`: False
350
- - `fp16`: True
351
  - `fp16_opt_level`: O1
352
  - `half_precision_backend`: auto
353
  - `bf16_full_eval`: False
354
  - `fp16_full_eval`: False
355
- - `tf32`: None
356
  - `local_rank`: 0
357
  - `ddp_backend`: None
358
  - `tpu_num_cores`: None
@@ -374,7 +395,7 @@ You can finetune this model on your own dataset.
374
  - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
375
  - `deepspeed`: None
376
  - `label_smoothing_factor`: 0.0
377
- - `optim`: adamw_torch
378
  - `optim_args`: None
379
  - `adafactor`: False
380
  - `group_by_length`: False
@@ -429,22 +450,16 @@ You can finetune this model on your own dataset.
429
  </details>
430
 
431
  ### Training Logs
432
- | Epoch | Step | Training Loss | Validation Loss |
433
- |:----------:|:-------:|:-------------:|:---------------:|
434
- | 0.2119 | 50 | 0.0515 | 0.0039 |
435
- | 0.4237 | 100 | 0.0086 | 0.0034 |
436
- | 0.6356 | 150 | 0.0109 | 0.0026 |
437
- | 0.8475 | 200 | 0.0033 | 0.0018 |
438
- | 1.0593 | 250 | 0.0035 | 0.0024 |
439
- | 1.2712 | 300 | 0.0028 | 0.0014 |
440
- | **1.4831** | **350** | **0.0025** | **0.0013** |
441
- | 1.6949 | 400 | 0.0017 | 0.0013 |
442
- | 1.9068 | 450 | 0.002 | 0.0019 |
443
- | 2.1186 | 500 | 0.0016 | 0.0018 |
444
- | 2.3305 | 550 | 0.0034 | 0.0019 |
445
- | 2.5424 | 600 | 0.0004 | 0.0018 |
446
- | 2.7542 | 650 | 0.002 | 0.0018 |
447
- | 2.9661 | 700 | 0.0018 | 0.0019 |
448
 
449
  * The bold row denotes the saved checkpoint.
450
 
 
9
  - loss:MultipleNegativesRankingLoss
10
  base_model: nomic-ai/modernbert-embed-base
11
  widget:
12
+ - source_sentence: The Order Management Executive/Quote Desk Executive/Order Fulfilment
13
+ Officer/Inside Sales Officer is responsible for preparing customer proposals and/or
14
+ tender documents and fulfilling orders, from identifying customer needs, developing
15
+ proposals, processing orders to shipment and delivery of orders to the customers.
16
+ He/She is also responsible for managing customers and coordinating with colleagues
17
+ during the entire process. Resourceful and analytical, he is required to analyse
18
+ customer needs and convince customers to adopt proposals.
 
19
  sentences:
20
+ - Job opening for a Learning and Operations Manager to oversee learning products
21
+ and services, manage operational processes, and ensure effective execution. Responsibilities
22
+ include setting the learning calendar, resource management, vendor coordination,
23
+ and personnel development. Focus on performance monitoring, profitability analysis,
24
+ and stakeholder relationship management. Strong communication skills and a collaborative
25
+ approach are essential for fostering a positive team environment.
26
+ - Junior Risk Management Analyst tasked with assessing financial risks and developing
27
+ mitigation strategies, conducting market analysis, and collaborating with various
28
+ departments to enhance risk management processes.
29
+ - Order Processing Specialist responsible for creating customer proposals, managing
30
+ order fulfillment, and ensuring timely delivery while collaborating with team
31
+ members to meet client needs.
32
+ - source_sentence: The Assistant Engineer/Senior Technician (Operations and Maintenance)
33
+ is responsible for supporting the planning of corrective, preventive and predictive
34
+ maintenance activities that ensure equipment and systems are fully functional
35
+ and in optimal operating condition. He/She follows corporate guidelines and best
36
+ practices, ensuring work activities are carried out safely and enhancing the organisations
37
+ compliance with regulatory and statutory policies, procedures and regulations.
38
+ He follows emergency response plans and adheres to workplace safety and health
39
+ (WSH) requirements. He is a good team player and is able to engage and interact
40
+ with internal and external stakeholders. He possesses good analytical and problem-solving
41
+ skills. He is also expected to work on-site, on a rotating or day-shift, and/or
42
+ may be employed oncall basis.
 
 
 
 
 
 
43
  sentences:
44
+ - Assistant Engineer for Maintenance Planning and Operations, focusing on preventive,
45
+ corrective, and predictive maintenance to ensure optimal equipment functionality
46
+ while adhering to safety regulations and corporate guidelines.
47
+ - Job opening for an Investment Performance Analyst focusing on delivering precise
48
+ portfolio analysis reports. The role involves tracking performance metrics for
49
+ investment portfolios, calculating returns, and analyzing statistics to assess
50
+ the organization’s investment outcomes. Responsibilities include ensuring accuracy
51
+ in calculations, compliance with regulations, and adherence to investment management
52
+ agreements. Ideal candidates should have a passion for numbers and strong analytical
53
+ skills to draw meaningful insights from portfolio data.
54
+ - Junior Risk Management Analyst responsible for evaluating and mitigating financial
55
+ risks within the organization. This role requires the analysis of market trends
56
+ and regulatory compliance, supporting the development of risk assessment strategies.
57
+ The candidate should demonstrate strong analytical skills and the ability to collaborate
58
+ with various departments to enhance the company's risk profile. Must be available
59
+ for on-call support and possess knowledge of financial regulations and compliance
60
+ standards.
61
+ - source_sentence: The Laboratory Assistant supports day-to-day laboratory operations
62
+ by assisting with basic calibration and simple troubleshooting of laboratory equipment,
63
+ preparation of stock solutions and reagents, and sample labelling, in strict accordance
64
+ with laboratory Standard Operating Procedures (SOPs) and under close supervision.
65
+ He/She complies with Workplace Safety and Health (WSH) and Environmental Management
66
+ System (EMS) requirements by applying risk control measures for the safe execution
67
+ of work activities, and performs good housekeeping in the workplace. The Laboratory
68
+ Assistant assists in conducting routine product and in-process sample analyses,
69
+ and inspects samples for contamination, foreign matter or defects, to ensure product
70
+ quality meets required specifications. He also contributes to organisational development
71
+ by supporting continuous improvement projects. The Laboratory Assistant usually
72
+ works in a team, on either a day or rotating shift, in the laboratory. He is meticulous,
73
+ a good team player and interacts effectively with others.
74
  sentences:
75
+ - Nursery Manager responsible for daily operations including plant propagation,
76
+ care, inventory control, and sales management. Leads a team of nursery staff,
77
+ assigns tasks, monitors performance, and communicates updates to management on
78
+ production and safety compliance. Requires strong organizational and communication
79
+ skills for effective delegation and feedback collection, with a focus on outdoor
80
+ work across various nursery locations.
81
+ - Junior Quality Control Inspector tasked with overseeing the inspection of finished
82
+ products, ensuring compliance with quality standards and specifications. Responsible
83
+ for conducting thorough examinations for defects and foreign materials in the
84
+ production line, while adhering to industry regulations and safety protocols.
85
+ Engages in the preparation of quality reports and assists in the development of
86
+ quality improvement strategies. Works independently with minimal supervision,
87
+ primarily during standard business hours, and requires strong analytical skills
88
+ and attention to detail.
89
+ - Laboratory Technician responsible for daily lab operations, including equipment
90
+ calibration, preparation of reagents, and sample labeling, following strict SOPs
91
+ and under supervision. Adheres to safety and environmental protocols while implementing
92
+ risk control measures and maintaining a clean workspace. Conducts routine analyses
93
+ and inspects samples for quality assurance, contributing to improvement initiatives.
94
+ Works collaboratively in a team environment, available for day or rotating shifts,
95
+ with a focus on detail and effective communication.
96
+ - source_sentence: The Assistant Relationship Manager - Retail Banking/Personal Banking
97
+ Executive supports the acquisition and management of customer accounts and facilitates
98
+ the collection of information for delivery of advice to customers based on their
99
+ needs and objectives. He/She responds to requests for information in a timely
100
+ fashion. He handles after-sales support in servicing customer needs, such as processing
101
+ of documents and handling any additional queries that may arise. The Assistant
102
+ Relationship Manager - Retail Banking/Personal Banking Executive is pleasant and
103
+ personable in nature to build rapport with his team and other relevant individuals.
104
+ His duties require him to be meticulous with details and a team player. He is
105
+ also self-motivated to excel in delivering quality services. He is articulate
106
+ and able to communicate well with others but also values listening to learn from
107
+ others.
108
  sentences:
109
+ - Assistant Relationship Manager for Retail Banking, focusing on customer account
110
+ acquisition and management, providing timely information and advice tailored to
111
+ client needs, ensuring excellent after-sales support, and fostering strong relationships
112
+ within the team and with clients.
113
+ - Senior Quality Assurance Specialist overseeing quality systems and standards to
114
+ fulfill business objectives, identifying risk areas, and ensuring effective risk
115
+ control plans for successful launches. Responsible for developing management systems
116
+ that meet quality requirements and leading cross-functional teams in continuous
117
+ improvement initiatives while mentoring team leaders for organizational growth.
118
+ - Junior Risk Management Analyst in Financial Services responsible for evaluating
119
+ potential risks associated with investment portfolios, preparing detailed risk
120
+ assessment reports, and collaborating with senior analysts to develop mitigation
121
+ strategies. The role requires strong analytical skills, attention to detail, and
122
+ the ability to communicate complex information clearly to stakeholders while maintaining
123
+ a proactive approach to risk management.
124
+ - source_sentence: The Trade Manager/Assistant Trade Manager devises and implements
125
+ commercial strategies to maximise revenue. He/She is accountable for overseeing
126
+ capacity allocation, optimising pricing strategies and driving yield maximisation.
127
+ He monitors performance against the budgets of all profit and loss items and identifies
128
+ variations in financial performances of trade to initiate corrective actions as
129
+ necessary. He develops strategies, trading plans and enhances relationships with
130
+ existing and new trade partners. He has strong commercial awareness and thrives
131
+ in environments of varied stakeholders, which requires the dissemination of insights
132
+ to key decision makers.
 
 
 
133
  sentences:
134
+ - Job opening for a Business Development Manager - Brokers focused on crafting strategies
135
+ to enhance sales and revenue. The role involves identifying new business opportunities
136
+ and fostering relationships with clients, industry partners, and underwriting
137
+ teams, while upholding high customer service standards. The ideal candidate should
138
+ demonstrate strong business acumen, leadership, communication, and stakeholder
139
+ management abilities.
140
+ - Trade Manager responsible for developing and executing commercial strategies to
141
+ enhance revenue generation. Accountable for managing capacity allocation, optimizing
142
+ pricing models, and maximizing yield. Monitors financial performance against budgetary
143
+ targets and addresses discrepancies in trade profitability. Creates trading strategies
144
+ and strengthens partnerships with both existing and potential trade partners.
145
+ Possesses a keen commercial insight and excels in diverse stakeholder environments,
146
+ facilitating the sharing of critical insights with decision makers.
147
+ - Junior Financial Analyst tasked with conducting comprehensive risk assessments
148
+ and preparing detailed reports on financial performance. Responsible for evaluating
149
+ investment opportunities and identifying potential financial risks within the
150
+ healthcare sector. Assists in the development of risk management strategies and
151
+ collaborates with various departments to ensure compliance with regulatory standards.
152
+ Requires strong analytical skills and the ability to communicate complex financial
153
+ information to stakeholders effectively.
154
  pipeline_tag: sentence-similarity
155
  library_name: sentence-transformers
156
  ---
 
205
  model = SentenceTransformer("dnth/ssf-retriever-modernbert-embed-base")
206
  # Run inference
207
  sentences = [
208
+ 'The Trade Manager/Assistant Trade Manager devises and implements commercial strategies to maximise revenue. He/She is accountable for overseeing capacity allocation, optimising pricing strategies and driving yield maximisation. He monitors performance against the budgets of all profit and loss items and identifies variations in financial performances of trade to initiate corrective actions as necessary. He develops strategies, trading plans and enhances relationships with existing and new trade partners. He has strong commercial awareness and thrives in environments of varied stakeholders, which requires the dissemination of insights to key decision makers.',
209
+ 'Trade Manager responsible for developing and executing commercial strategies to enhance revenue generation. Accountable for managing capacity allocation, optimizing pricing models, and maximizing yield. Monitors financial performance against budgetary targets and addresses discrepancies in trade profitability. Creates trading strategies and strengthens partnerships with both existing and potential trade partners. Possesses a keen commercial insight and excels in diverse stakeholder environments, facilitating the sharing of critical insights with decision makers.',
210
+ 'Junior Financial Analyst tasked with conducting comprehensive risk assessments and preparing detailed reports on financial performance. Responsible for evaluating investment opportunities and identifying potential financial risks within the healthcare sector. Assists in the development of risk management strategies and collaborates with various departments to ensure compliance with regulatory standards. Requires strong analytical skills and the ability to communicate complex financial information to stakeholders effectively.',
211
  ]
212
  embeddings = model.encode(sentences)
213
  print(embeddings.shape)
 
216
  # Get the similarity scores for the embeddings
217
  similarities = model.similarity(embeddings, embeddings)
218
  print(similarities)
219
+ # tensor([[1.0000, 0.8794, 0.0992],
220
+ # [0.8794, 1.0000, 0.1376],
221
+ # [0.0992, 0.1376, 1.0000]])
222
  ```
223
 
224
  <!--
 
269
  | | anchor | positive | negative |
270
  |:--------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
271
  | type | string | string | string |
272
+ | details | <ul><li>min: 57 tokens</li><li>mean: 166.92 tokens</li><li>max: 403 tokens</li></ul> | <ul><li>min: 22 tokens</li><li>mean: 68.31 tokens</li><li>max: 218 tokens</li></ul> | <ul><li>min: 33 tokens</li><li>mean: 83.02 tokens</li><li>max: 206 tokens</li></ul> |
273
  * Samples:
274
+ | anchor | positive | negative |
275
+ |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
276
+ | <code>The Battery Energy Storage Systems (BESS) Electrochemistry Research and Development (R&D) Engineer focuses on the research and development of innovative solutions that improve the performance of BESS and its components. He/She defines research objectives and parameters, designs and executes experiments, and analyses data to identify ways to improve the performance of battery in BESS, while developing innovative technologies in energy management and integration. He processes technical understanding of BESS and cross-functional expertise to works across the various area of battery management systems to successfully manage BESS R&D projects from end-to-end. <br><br>The BESS Electrochemistry R&D Engineer possess critical thinking, creativity and data literacy skills to solve complex problems, with strong collaboration skills to work across teams.</code> | <code>Battery Energy Storage Systems (BESS) Research and Development Engineer specializing in innovative solutions for enhancing BESS performance, defining research goals, conducting experiments, and analyzing data to advance battery technology and energy management integration.</code> | <code>Junior Risk Management Analyst responsible for assessing financial risks within a corporate environment, focusing on evaluating potential threats and implementing strategies to mitigate them. This role involves analyzing data, preparing reports on risk exposure, and collaborating with various departments to ensure compliance with regulations and policies.</code> |
277
+ | <code>Sound Designers curate the right mix of music, sound effects and soundscapes to create the desired impact for a production based on the artistic vision. They develop a sound cue list which describes the changing sounds throughout the entire show. They are responsible for creating and producing the planned sounds, and deciding on the best possible positioning of speakers. <br>They provide the designs for all pre-recorded music, sound effects and the reinforcement of live voices, musical instruments and sound elements for the production. They are proficient with audio and engine tools, as well as sound technologies, and have deep knowledge and a strong understanding of various music styles and genres. They are also responsible for monitoring costs of sound production and managing the sound team’s schedule.</code> | <code>Job openings for Sound Designers who specialize in creating impactful audio experiences by curating music, sound effects, and soundscapes in alignment with artistic visions. Responsibilities include developing sound cue lists, producing planned sounds, positioning speakers, and designing pre-recorded music and sound effects. Proficiency in audio tools and sound technologies, along with knowledge of diverse music genres, is essential. Candidates should also manage production costs and coordinate the sound team’s schedule.</code> | <code>Junior Audio Engineers are tasked with managing the technical aspects of sound production for live events and recordings. They set up and operate sound equipment, ensuring optimal sound quality and clarity during performances. Responsibilities include troubleshooting audio issues, mixing live sound, and assisting in the design of soundscapes. Candidates should have experience with audio mixing software and hardware, as well as knowledge of various audio formats. They will also coordinate with the production team to meet sound requirements and maintain equipment inventory.</code> |
278
+ | <code>The Service Operations Manager/Duty Operations Manager manages and coordinates the overall operations of a cluster of) train stations in a given zone. He/She supervises the station operations teams to ensure organisational requirements for rail services and safety requirements are fulfilled, and service excellence, and regulatory service standards are adhered to. He is responsible for the achievement of rail service and station operations performance standards, and recommends and implements continuous improvement initiatives to enhance overall rail services. He coordinates improvement initiatives for station facilities and the implementation of security measures with internal and external stakeholders. He also supervises coordinated response and recovery efforts during rail incidents and/or accidents. He possesses strong leadership and people management skills. He also has the ability to implement and synchronise organisational operating procedures and requirements across the different...</code> | <code>Service Operations Manager overseeing train station performance and safety standards, ensuring service excellence and compliance with regulatory requirements, while leading improvement initiatives and coordinating operations teams.</code> | <code>Junior Operations Coordinator for a healthcare facility managing day-to-day administrative tasks in a medical center. Responsible for supervising support staff to ensure compliance with healthcare regulations and patient service standards. Implements operational procedures and coordinates facility maintenance while assisting in emergency response plans during medical incidents. Strong communication and organizational skills are essential for this role.</code> |
279
  * Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
280
  ```json
281
  {
 
291
  * Size: 1,885 evaluation samples
292
  * Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
293
  * Approximate statistics based on the first 1000 samples:
294
+ | | anchor | positive | negative |
295
+ |:--------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
296
+ | type | string | string | string |
297
+ | details | <ul><li>min: 58 tokens</li><li>mean: 170.17 tokens</li><li>max: 403 tokens</li></ul> | <ul><li>min: 20 tokens</li><li>mean: 67.58 tokens</li><li>max: 193 tokens</li></ul> | <ul><li>min: 30 tokens</li><li>mean: 83.14 tokens</li><li>max: 241 tokens</li></ul> |
298
  * Samples:
299
+ | anchor | positive | negative |
300
+ |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
301
+ | <code>The Merchandising Manager/Category Manager/House Brand Manager oversees the implementation of merchandising strategies as well as the development of the private label or house brand products. He/she is also responsible for developing strategic partnerships, managing product assortment, driving product development and budget management. He works in a dynamic environment where he is expected to regularly review market and industry trends to drive appeal of merchandises to target customers. He is an energetic, creative, collaborative and highly adaptable team leader. He possesses the ability to build strong relationships with partners and is well-informed of consumer, market and industry trends.</code> | <code>Merchandising Manager responsible for executing merchandising strategies and managing the development of private label products, while driving partnerships, product assortment, and budget management in a fast-paced environment. Must stay updated on market trends to enhance product appeal and demonstrate strong leadership and relationship-building skills.</code> | <code>Junior Risk Management Analyst tasked with executing risk assessment strategies and managing compliance for various financial products. This role requires monitoring industry regulations to ensure adherence and support in developing risk mitigation plans. The candidate should be detail-oriented, capable of working in a team, and knowledgeable about market dynamics and regulatory trends.</code> |
302
+ | <code>The Associate Director (Civil and Structural Engineering)/Principal Civil and Structural Engineer spearheads the overall planning, development and execution of projects to meet project requirements. He/She provides expert guidance for creative and innovative design solutions and reviews final design submittals. He also reviews the feasibility of the assessment solutions and manages the expectations of internal and external stakeholders. He drives the tendering processes and leads business negotiations. He oversees the talent recruitment and development processes of the organisation and is responsible for the department's financial positions. He may be required to perform the responsibilities of a Qualified Person in accordance with the Building Control Act. He is a subject matter expert in civil and structural engineering. He possesses high level of technical and engineering competence, as well as social and leadership skills that allow him to manage internal and external stakeholders ...</code> | <code>search for Associate Director in Civil and Structural Engineering with expertise in project planning, innovative design solutions, stakeholder management, and team leadership</code> | <code>The Junior Risk Management Analyst is responsible for identifying and analyzing potential risks within the financial services sector. This role involves conducting risk assessments, monitoring compliance with regulations, and preparing reports for management review. The analyst collaborates with various departments to implement risk mitigation strategies and ensures that all processes align with industry standards. Strong analytical and communication skills are essential, along with a foundational understanding of risk management principles. The candidate should be detail-oriented and able to thrive in a dynamic, regulatory environment.</code> |
303
+ | <code>A Senior Occupational Therapist is responsible for providing client care, treatment and client education in collaboration with various healthcare teams. S/He performs detailed assessments and interventions for clients and may train new or junior occupational therapists in these activities. S/He has advanced expertise and knowledge in her/his specialty area. S/He is expected to monitor the caseloads of team members and provide supervision as needed. S/He may work in various settings such as public and private institutions, acute and community hospitals, rehabilitation centres, voluntary welfare organisations, schools, long-term care facilities and clients homes and work environments. S/He may also work as part of collaborative, interdisciplinary teams which may include teachers, doctors, audiologists, psychologists, social workers, physiotherapists and speech therapists. S/He should have initiative and be sensitive to the needs of her/his clients. S/He should possess management, leaders...</code> | <code>Job opening for an experienced Occupational Therapist focused on client treatment, education, and collaboration with healthcare teams; responsible for conducting assessments, providing interventions, and mentoring junior therapists while managing caseloads in various healthcare settings.</code> | <code>A Junior Risk Management Analyst is tasked with evaluating potential risks and developing strategies to mitigate them within the financial services sector. This role involves conducting risk assessments, preparing reports, and collaborating with senior analysts. The analyst must possess strong analytical skills and be able to communicate effectively with stakeholders. The position requires familiarity with regulatory compliance and may involve working with cross-functional teams in a corporate environment.</code> |
304
  * Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
305
  ```json
306
  {
 
312
  ### Training Hyperparameters
313
  #### Non-Default Hyperparameters
314
 
315
+ - `eval_strategy`: epoch
316
+ - `per_device_train_batch_size`: 32
317
+ - `per_device_eval_batch_size`: 16
318
+ - `gradient_accumulation_steps`: 16
319
+ - `learning_rate`: 2e-05
320
+ - `num_train_epochs`: 4
321
  - `lr_scheduler_type`: cosine
322
  - `warmup_ratio`: 0.1
323
+ - `bf16`: True
324
+ - `tf32`: True
325
  - `load_best_model_at_end`: True
326
+ - `optim`: adamw_torch_fused
327
  - `batch_sampler`: no_duplicates
328
 
329
  #### All Hyperparameters
 
331
 
332
  - `overwrite_output_dir`: False
333
  - `do_predict`: False
334
+ - `eval_strategy`: epoch
335
  - `prediction_loss_only`: True
336
+ - `per_device_train_batch_size`: 32
337
+ - `per_device_eval_batch_size`: 16
338
  - `per_gpu_train_batch_size`: None
339
  - `per_gpu_eval_batch_size`: None
340
+ - `gradient_accumulation_steps`: 16
341
  - `eval_accumulation_steps`: None
342
  - `torch_empty_cache_steps`: None
343
+ - `learning_rate`: 2e-05
344
+ - `weight_decay`: 0.0
345
  - `adam_beta1`: 0.9
346
  - `adam_beta2`: 0.999
347
  - `adam_epsilon`: 1e-08
348
  - `max_grad_norm`: 1.0
349
+ - `num_train_epochs`: 4
350
  - `max_steps`: -1
351
  - `lr_scheduler_type`: cosine
352
  - `lr_scheduler_kwargs`: {}
 
367
  - `data_seed`: None
368
  - `jit_mode_eval`: False
369
  - `use_ipex`: False
370
+ - `bf16`: True
371
+ - `fp16`: False
372
  - `fp16_opt_level`: O1
373
  - `half_precision_backend`: auto
374
  - `bf16_full_eval`: False
375
  - `fp16_full_eval`: False
376
+ - `tf32`: True
377
  - `local_rank`: 0
378
  - `ddp_backend`: None
379
  - `tpu_num_cores`: None
 
395
  - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
396
  - `deepspeed`: None
397
  - `label_smoothing_factor`: 0.0
398
+ - `optim`: adamw_torch_fused
399
  - `optim_args`: None
400
  - `adafactor`: False
401
  - `group_by_length`: False
 
450
  </details>
451
 
452
  ### Training Logs
453
+ | Epoch | Step | Training Loss | Validation Loss |
454
+ |:-------:|:------:|:-------------:|:---------------:|
455
+ | 0.6780 | 10 | 0.2113 | - |
456
+ | 1.0 | 15 | - | 0.0085 |
457
+ | 1.3390 | 20 | 0.0169 | - |
458
+ | 2.0 | 30 | 0.0089 | 0.0055 |
459
+ | 2.6780 | 40 | 0.009 | - |
460
+ | 3.0 | 45 | - | 0.0045 |
461
+ | 3.3390 | 50 | 0.0079 | - |
462
+ | **4.0** | **60** | **0.0071** | **0.0044** |
 
 
 
 
 
 
463
 
464
  * The bold row denotes the saved checkpoint.
465
 
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b6bfbbc39bd30dbe91a832bd4ddbc3101bab5c2ae3f3262a25656ca4c02274c8
3
  size 596070136
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c0ec2852099be9da41ce0c3809032a42e01b90b336dd3cc48799d75e644d366
3
  size 596070136