OloriBern/hotpotqa-mixer-2000

CrossEncoder based on BAAI/bge-reranker-v2-m3

This is a Cross Encoder model finetuned from BAAI/bge-reranker-v2-m3 using the sentence-transformers library. It computes scores for pairs of texts, which can be used for text reranking and semantic search.

Model Details

Model Description

• Model Type: Cross Encoder
• Base model: BAAI/bge-reranker-v2-m3
• Maximum Sequence Length: 1024 tokens
• Number of Output Labels: 1 label

Model Sources

• Documentation: Sentence Transformers Documentation
• Documentation: Cross Encoder Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Cross Encoders on Hugging Face

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import CrossEncoder

# Download from the 🤗 Hub
model = CrossEncoder("cross_encoder_model_id")
# Get scores for pairs of texts
pairs = [
    ['Which American director is older, Lee Daniels or Barry Sonnenfeld?', 'Barry Sonnenfeld. Barry Sonnenfeld (born April 1, 1953) is an American filmmaker and television director.  He worked as cinematographer for the Coen brothers, then later he directed films such as "The Addams Family" and its sequel, "Addams Family Values" along with the "Men in Black" trilogy, and the critically acclaimed "Get Shorty".  Sonnenfeld has also had four collaborations with Will Smith.</s>Logan Lucky. Logan Lucky is a 2017 American heist comedy film directed by Steven Soderbergh, based on an original script written by unknown newcomer Rebecca Blunt.  Soderbergh came out of retirement to direct the film and to distribute it independently through his own company Fingerprint Releasing.  The film features an ensemble cast consisting of Channing Tatum, Adam Driver, Riley Keough, Daniel Craig, Seth MacFarlane, Katie Holmes, Hilary Swank, Katherine Waterston and Sebastian Stan, and follows the unlucky Logan family who plan to rob the Charlotte Motor Speedway, and try to avoid getting caught by the FBI.</s>Lee Daniels. Lee Louis Daniels (born December 24, 1959) is an American producer and director.  He produced "Monster\'s Ball" and directed "Precious", which received six Academy Award nominations, including Best Director; it won two of the awards.'],
    ['Poitevin and Moscow Water Dog, are breeds of what?', "Poitevin (dog). The Poitevin, known as the Chien de Haut-Poitou until 1957, is a breed of dog used in hunting as a scenthound, from the province of Poitou.  This predominantly pack hound was created in the 17th century specifically to hunt wolves.</s>Moscow Water Dog. The Moscow Water Dog, also known as the Moscow Diver, Moscow Retriever or Moskovsky Vodolaz, is a little-known dog breed derived from the Newfoundland, Caucasian Shepherd Dog and East European Shepherd.  It is now extinct, but was used in the development of the  Black Russian Terrier.  The Moscow Water Dog was produced only by the Red Star Kennels, the state operated organization chartered to provide working dogs for the armed services.</s>Ryukyu Inu. The Ryukyu Ken (琉球犬 lit.  Ryuukyuu Dog) is a medium-sized breed of dog that originates from Okinawa, Japan.  It is Okinawa's only pedigree dog breed.  It is a rare dog and is slowly declining in numbers.  There were as few as 400 Ryukyu Inu as of 2015.  Unlike dogs such as the Kai Ken, the Ryukyu is not protected by the Nihon Ken Hozonkai."],
    ['Are Max Green and John Cooper both American?', 'Russell Crowe. Russell Ira Crowe (born 7 April 1964) is an actor, film producer and musician.  Although a New Zealand citizen, he has lived most of his life in Australia.  He came to international attention for his role as the Roman General Maximus Decimus Meridius in the 2000 historical epic film "Gladiator", directed by Ridley Scott, for which Crowe won an Academy Award for Best Actor, a Broadcast Film Critics Association Award for Best Actor, an Empire Award for Best Actor and a London Film Critics Circle Award for Best Actor and 10 further nominations for best actor.</s>John Cooper (musician). John Landrum Cooper (born April 7, 1975), professionally credited as John L. Cooper, is an American musician, singer and songwriter.  He has been the lead vocalist, bassist and co-founder of the Grammy-nominated American Christian rock band Skillet since 1996.</s>American Sniper. American Sniper is a 2014 American biographical war drama film directed by Clint Eastwood and written by Jason Hall.  It is loosely based on the memoir "American Sniper: The Autobiography of the Most Lethal Sniper in U.S. Military History" (2012) by Chris Kyle, with Scott McEwen and Jim DeFelice.  The film follows the life of Kyle, who became the deadliest marksman in U.S. military history with 255 kills from four tours in the Iraq War, 160 of which were officially confirmed by the Department of Defense.  While Kyle was celebrated for his military successes, his tours of duty took a heavy toll on his personal and family life.  The film was produced by Eastwood, Robert Lorenz, Andrew Lazar, Bradley Cooper, and Peter Morgan.  It stars Cooper as Kyle and Sienna Miller as his wife Taya, with Luke Grimes, Jake McDorman, Cory Hardrict, Kevin Lacz, Navid Negahban, and Keir O\'Donnell in supporting roles.'],
    ['What is the name of the musician that appeared on Days of out lives and all my children?', 'Eddie Rabbitt. Edward Thomas Rabbitt (November 27, 1941 – May 7, 1998) was an American singer and songwriter.  His career began as a songwriter in the late 1960s, springboarding to a recording career after composing hits such as "Kentucky Rain" for Elvis Presley in 1970 and "Pure Love" for Ronnie Milsap in 1974.  Later in the 1970s, Rabbitt helped to develop the crossover-influenced sound of country music prevalent in the 1980s with such hits as "Suspicions" and "Every Which Way but Loose."  His duets "Both to Each Other (Friends and Lovers)" and "You and I", with Juice Newton and Crystal Gayle respectively, later appeared on the soap operas "Days of Our Lives" and "All My Children".</s>Mariah Carey. Mariah Carey (born March 27, 1969 or 1970) is an American singer, songwriter, record producer, and actress.  In 1990, she rose to fame with the release of "Vision of Love" from her eponymous debut album.  The album produced four chart-topping singles in the US and began what would become a string of commercially successful albums which solidified the singer as Columbia Records\' highest selling act.  Carey and Boyz II Men spent a record sixteen weeks atop the "Billboard" Hot 100 in 1995–1996 with "One Sweet Day," which remains the longest-running number-one song in US chart history.  Following a contentious divorce from Sony Music head Tommy Mottola, Carey adopted a new image and traversed towards hip hop with the release of "Butterfly" (1997).  In 1998, she was honored as the world\'s best-selling recording artist of the 1990s at the World Music Awards and subsequently named the best-selling female artist of the millennium in 2000.</s>Drinkin\' My Baby (Off My Mind). "Drinkin\' My Baby (Off My Mind)" is a song co-written and recorded by American country music artist Eddie Rabbitt.  It was released in February 1976 as the first single from the album "Rocky Mountain Music".  "Drinkin\' My Baby (Off My Mind)" was Eddie Rabbitt\'s fourth country hit and the first of fifteen solo number one country hits.  The single stayed at number one a single week and spent a total twelve weeks on the country chart.  It was written by Rabbitt and Even Stevens.'],
    ['The current WBO Asia Pacific Super Middleweight Champion made his debut film appearance in a movie directed by who?', "Vijender Singh. Vijender Singh Beniwal (born 29 October 1985), better known as Vijender Singh is an Indian professional boxer and the current WBO Asia Pacific Super Middleweight Champion and WBO Oriental Super Middleweight Champion from Kaluwas, Bhiwani district in Haryana.  He was educated in his village, after which he received a bachelor's degree from a local college in Bhiwani.  He practised boxing at the Bhiwani Boxing Club where coach Jagdish Singh recognised his talent and encouraged him to take up boxing.  He was coached by the Indian Boxing Coach Jagdish Singh.</s>Million Dollar Arm. Million Dollar Arm is a 2014 American biographical sports drama film directed by Craig Gillespie and produced by Walt Disney Pictures from a screenplay written by Thomas McCarthy.  The film is based on the true story of baseball pitchers Rinku Singh and Dinesh Patel who were discovered by sports agent J. B. Bernstein after winning a reality show competition.</s>Dan Henderson. Daniel Jeffery Henderson (born August 24, 1970) is an American former mixed martial artist and Olympic wrestler, who last competed as a middleweight in the Ultimate Fighting Championship.  He was the last Strikeforce Light Heavyweight Champion and was the last Welterweight (80 kg ) and Middleweight (95 kg ) champion of Pride Fighting Championships.  Additionally, Henderson was the Brazil Open '97 Tournament Champion, the UFC 17 Middleweight Tournament Champion, the Rings: King of Kings 1999 Tournament Champion and the Pride Weltwerweight Grand Prix Tournament Champion.  During his career, Henderson also challenged for the UFC Middleweight Championship (2x), the UFC Light Heavyweight Championship and the Strikeforce Middleweight Championship.  He was the first mixed martial artist to concurrently hold two titles in two different weight classes in a major MMA promotion.  At the time of his retirement after UFC 204, he was the oldest fighter on the UFC roster.  Known to be one of the greatest mixed martial artists of all time having defeated a total of seventeen MMA world champions across four major MMA promotions (UFC, PRIDE FC, Strikeforce, and RINGS)."],
]
scores = model.predict(pairs)
print(scores.shape)
# (5,)

# Or rank different texts based on similarity to a single text
ranks = model.rank(
    'Which American director is older, Lee Daniels or Barry Sonnenfeld?',
    [
        'Barry Sonnenfeld. Barry Sonnenfeld (born April 1, 1953) is an American filmmaker and television director.  He worked as cinematographer for the Coen brothers, then later he directed films such as "The Addams Family" and its sequel, "Addams Family Values" along with the "Men in Black" trilogy, and the critically acclaimed "Get Shorty".  Sonnenfeld has also had four collaborations with Will Smith.</s>Logan Lucky. Logan Lucky is a 2017 American heist comedy film directed by Steven Soderbergh, based on an original script written by unknown newcomer Rebecca Blunt.  Soderbergh came out of retirement to direct the film and to distribute it independently through his own company Fingerprint Releasing.  The film features an ensemble cast consisting of Channing Tatum, Adam Driver, Riley Keough, Daniel Craig, Seth MacFarlane, Katie Holmes, Hilary Swank, Katherine Waterston and Sebastian Stan, and follows the unlucky Logan family who plan to rob the Charlotte Motor Speedway, and try to avoid getting caught by the FBI.</s>Lee Daniels. Lee Louis Daniels (born December 24, 1959) is an American producer and director.  He produced "Monster\'s Ball" and directed "Precious", which received six Academy Award nominations, including Best Director; it won two of the awards.',
        "Poitevin (dog). The Poitevin, known as the Chien de Haut-Poitou until 1957, is a breed of dog used in hunting as a scenthound, from the province of Poitou.  This predominantly pack hound was created in the 17th century specifically to hunt wolves.</s>Moscow Water Dog. The Moscow Water Dog, also known as the Moscow Diver, Moscow Retriever or Moskovsky Vodolaz, is a little-known dog breed derived from the Newfoundland, Caucasian Shepherd Dog and East European Shepherd.  It is now extinct, but was used in the development of the  Black Russian Terrier.  The Moscow Water Dog was produced only by the Red Star Kennels, the state operated organization chartered to provide working dogs for the armed services.</s>Ryukyu Inu. The Ryukyu Ken (琉球犬 lit.  Ryuukyuu Dog) is a medium-sized breed of dog that originates from Okinawa, Japan.  It is Okinawa's only pedigree dog breed.  It is a rare dog and is slowly declining in numbers.  There were as few as 400 Ryukyu Inu as of 2015.  Unlike dogs such as the Kai Ken, the Ryukyu is not protected by the Nihon Ken Hozonkai.",
        'Russell Crowe. Russell Ira Crowe (born 7 April 1964) is an actor, film producer and musician.  Although a New Zealand citizen, he has lived most of his life in Australia.  He came to international attention for his role as the Roman General Maximus Decimus Meridius in the 2000 historical epic film "Gladiator", directed by Ridley Scott, for which Crowe won an Academy Award for Best Actor, a Broadcast Film Critics Association Award for Best Actor, an Empire Award for Best Actor and a London Film Critics Circle Award for Best Actor and 10 further nominations for best actor.</s>John Cooper (musician). John Landrum Cooper (born April 7, 1975), professionally credited as John L. Cooper, is an American musician, singer and songwriter.  He has been the lead vocalist, bassist and co-founder of the Grammy-nominated American Christian rock band Skillet since 1996.</s>American Sniper. American Sniper is a 2014 American biographical war drama film directed by Clint Eastwood and written by Jason Hall.  It is loosely based on the memoir "American Sniper: The Autobiography of the Most Lethal Sniper in U.S. Military History" (2012) by Chris Kyle, with Scott McEwen and Jim DeFelice.  The film follows the life of Kyle, who became the deadliest marksman in U.S. military history with 255 kills from four tours in the Iraq War, 160 of which were officially confirmed by the Department of Defense.  While Kyle was celebrated for his military successes, his tours of duty took a heavy toll on his personal and family life.  The film was produced by Eastwood, Robert Lorenz, Andrew Lazar, Bradley Cooper, and Peter Morgan.  It stars Cooper as Kyle and Sienna Miller as his wife Taya, with Luke Grimes, Jake McDorman, Cory Hardrict, Kevin Lacz, Navid Negahban, and Keir O\'Donnell in supporting roles.',
        'Eddie Rabbitt. Edward Thomas Rabbitt (November 27, 1941 – May 7, 1998) was an American singer and songwriter.  His career began as a songwriter in the late 1960s, springboarding to a recording career after composing hits such as "Kentucky Rain" for Elvis Presley in 1970 and "Pure Love" for Ronnie Milsap in 1974.  Later in the 1970s, Rabbitt helped to develop the crossover-influenced sound of country music prevalent in the 1980s with such hits as "Suspicions" and "Every Which Way but Loose."  His duets "Both to Each Other (Friends and Lovers)" and "You and I", with Juice Newton and Crystal Gayle respectively, later appeared on the soap operas "Days of Our Lives" and "All My Children".</s>Mariah Carey. Mariah Carey (born March 27, 1969 or 1970) is an American singer, songwriter, record producer, and actress.  In 1990, she rose to fame with the release of "Vision of Love" from her eponymous debut album.  The album produced four chart-topping singles in the US and began what would become a string of commercially successful albums which solidified the singer as Columbia Records\' highest selling act.  Carey and Boyz II Men spent a record sixteen weeks atop the "Billboard" Hot 100 in 1995–1996 with "One Sweet Day," which remains the longest-running number-one song in US chart history.  Following a contentious divorce from Sony Music head Tommy Mottola, Carey adopted a new image and traversed towards hip hop with the release of "Butterfly" (1997).  In 1998, she was honored as the world\'s best-selling recording artist of the 1990s at the World Music Awards and subsequently named the best-selling female artist of the millennium in 2000.</s>Drinkin\' My Baby (Off My Mind). "Drinkin\' My Baby (Off My Mind)" is a song co-written and recorded by American country music artist Eddie Rabbitt.  It was released in February 1976 as the first single from the album "Rocky Mountain Music".  "Drinkin\' My Baby (Off My Mind)" was Eddie Rabbitt\'s fourth country hit and the first of fifteen solo number one country hits.  The single stayed at number one a single week and spent a total twelve weeks on the country chart.  It was written by Rabbitt and Even Stevens.',
        "Vijender Singh. Vijender Singh Beniwal (born 29 October 1985), better known as Vijender Singh is an Indian professional boxer and the current WBO Asia Pacific Super Middleweight Champion and WBO Oriental Super Middleweight Champion from Kaluwas, Bhiwani district in Haryana.  He was educated in his village, after which he received a bachelor's degree from a local college in Bhiwani.  He practised boxing at the Bhiwani Boxing Club where coach Jagdish Singh recognised his talent and encouraged him to take up boxing.  He was coached by the Indian Boxing Coach Jagdish Singh.</s>Million Dollar Arm. Million Dollar Arm is a 2014 American biographical sports drama film directed by Craig Gillespie and produced by Walt Disney Pictures from a screenplay written by Thomas McCarthy.  The film is based on the true story of baseball pitchers Rinku Singh and Dinesh Patel who were discovered by sports agent J. B. Bernstein after winning a reality show competition.</s>Dan Henderson. Daniel Jeffery Henderson (born August 24, 1970) is an American former mixed martial artist and Olympic wrestler, who last competed as a middleweight in the Ultimate Fighting Championship.  He was the last Strikeforce Light Heavyweight Champion and was the last Welterweight (80 kg ) and Middleweight (95 kg ) champion of Pride Fighting Championships.  Additionally, Henderson was the Brazil Open '97 Tournament Champion, the UFC 17 Middleweight Tournament Champion, the Rings: King of Kings 1999 Tournament Champion and the Pride Weltwerweight Grand Prix Tournament Champion.  During his career, Henderson also challenged for the UFC Middleweight Championship (2x), the UFC Light Heavyweight Championship and the Strikeforce Middleweight Championship.  He was the first mixed martial artist to concurrently hold two titles in two different weight classes in a major MMA promotion.  At the time of his retirement after UFC 204, he was the oldest fighter on the UFC roster.  Known to be one of the greatest mixed martial artists of all time having defeated a total of seventeen MMA world champions across four major MMA promotions (UFC, PRIDE FC, Strikeforce, and RINGS).",
    ]
)
# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]

Evaluation

Metrics

Cross Encoder Correlation

• Datasets: validation and train_subset
• Evaluated with CECorrelationEvaluator

Metric	validation	train_subset
pearson	0.9416	0.8467
spearman	0.9228	0.8645

Training Details

Training Dataset

Unnamed Dataset

• Size: 6,000 training samples
• Columns: sentence_0, sentence_1, and label
• Approximate statistics based on the first 1000 samples:

  	sentence_0	sentence_1	label
  type	string	string	float
  details	min: 22 characters mean: 101.02 characters max: 486 characters	min: 473 characters mean: 1734.37 characters max: 4615 characters	min: 0.0 mean: 0.5 max: 1.0

• Samples:

  sentence_0	sentence_1	label
  Which American director is older, Lee Daniels or Barry Sonnenfeld?	Barry Sonnenfeld. Barry Sonnenfeld (born April 1, 1953) is an American filmmaker and television director. He worked as cinematographer for the Coen brothers, then later he directed films such as "The Addams Family" and its sequel, "Addams Family Values" along with the "Men in Black" trilogy, and the critically acclaimed "Get Shorty". Sonnenfeld has also had four collaborations with Will Smith.Logan Lucky. Logan Lucky is a 2017 American heist comedy film directed by Steven Soderbergh, based on an original script written by unknown newcomer Rebecca Blunt. Soderbergh came out of retirement to direct the film and to distribute it independently through his own company Fingerprint Releasing. The film features an ensemble cast consisting of Channing Tatum, Adam Driver, Riley Keough, Daniel Craig, Seth MacFarlane, Katie Holmes, Hilary Swank, Katherine Waterston and Sebastian Stan, and follows the unlucky Logan family who plan to rob the Charlotte Motor Speedway, and try to avoid gettin...	1.0
  Poitevin and Moscow Water Dog, are breeds of what?	Poitevin (dog). The Poitevin, known as the Chien de Haut-Poitou until 1957, is a breed of dog used in hunting as a scenthound, from the province of Poitou. This predominantly pack hound was created in the 17th century specifically to hunt wolves.Moscow Water Dog. The Moscow Water Dog, also known as the Moscow Diver, Moscow Retriever or Moskovsky Vodolaz, is a little-known dog breed derived from the Newfoundland, Caucasian Shepherd Dog and East European Shepherd. It is now extinct, but was used in the development of the Black Russian Terrier. The Moscow Water Dog was produced only by the Red Star Kennels, the state operated organization chartered to provide working dogs for the armed services.Ryukyu Inu. The Ryukyu Ken (琉球犬 lit. Ryuukyuu Dog) is a medium-sized breed of dog that originates from Okinawa, Japan. It is Okinawa's only pedigree dog breed. It is a rare dog and is slowly declining in numbers. There were as few as 400 Ryukyu Inu as of 2015. Unlike dogs such as t...	1.0
  Are Max Green and John Cooper both American?	Russell Crowe. Russell Ira Crowe (born 7 April 1964) is an actor, film producer and musician. Although a New Zealand citizen, he has lived most of his life in Australia. He came to international attention for his role as the Roman General Maximus Decimus Meridius in the 2000 historical epic film "Gladiator", directed by Ridley Scott, for which Crowe won an Academy Award for Best Actor, a Broadcast Film Critics Association Award for Best Actor, an Empire Award for Best Actor and a London Film Critics Circle Award for Best Actor and 10 further nominations for best actor.John Cooper (musician). John Landrum Cooper (born April 7, 1975), professionally credited as John L. Cooper, is an American musician, singer and songwriter. He has been the lead vocalist, bassist and co-founder of the Grammy-nominated American Christian rock band Skillet since 1996.American Sniper. American Sniper is a 2014 American biographical war drama film directed by Clint Eastwood and written by Jason Hal...	0.5

• Loss: BinaryCrossEntropyLoss with these parameters:

  {
      "activation_fn": "torch.nn.modules.linear.Identity",
      "pos_weight": null
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 2
• per_device_eval_batch_size: 2

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: steps
• prediction_loss_only: True
• per_device_train_batch_size: 2
• per_device_eval_batch_size: 2
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1
• num_train_epochs: 3
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.0
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: False
• hub_always_push: False
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• dispatch_batches: None
• split_batches: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• eval_use_gather_object: False
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

Epoch	Step	Training Loss	validation_spearman	train_subset_spearman
0.0333	100	-	0.9213	0.8790
0.0667	200	-	0.9229	0.8640
0.1	300	-	0.9192	0.8632
0.1333	400	-	0.9228	0.8698
0.1667	500	0.5092	0.9228	0.8645

Framework Versions

• Python: 3.11.13
• Sentence Transformers: 5.2.0
• Transformers: 4.44.2
• PyTorch: 2.9.1+cu128
• Accelerate: 1.12.0
• Datasets: 4.0.0
• Tokenizers: 0.19.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}