Upload mixer model for hotpotqa (trained on 2000 queries)

Browse files

Files changed (4) hide show

README.md +58 -33
config.json +1 -1
eval/CrossEncoderCorrelationEvaluator_validation_results.csv +2 -0
model.safetensors +2 -2

README.md CHANGED Viewed

@@ -4,7 +4,7 @@ tags:
 - cross-encoder
 - reranker
 - generated_from_trainer
-- dataset_size:6000
 - loss:BinaryCrossEntropyLoss
 base_model: BAAI/bge-reranker-v2-m3
 pipeline_tag: text-ranking
@@ -23,10 +23,10 @@ model-index:
       type: validation
     metrics:
     - type: pearson
-      value: 0.895297089370197
       name: Pearson
     - type: spearman
-      value: 0.9270628111527542
       name: Spearman
   - task:
       type: cross-encoder-correlation
@@ -36,10 +36,10 @@ model-index:
       type: train_subset
     metrics:
     - type: pearson
-      value: 0.8760053788943281
       name: Pearson
     - type: spearman
-      value: 0.8966294358444651
       name: Spearman
 ---
@@ -83,11 +83,11 @@ from sentence_transformers import CrossEncoder
 model = CrossEncoder("cross_encoder_model_id")
 # Get scores for pairs of texts
 pairs = [
-    ['What profession does Muhammad Iqbal and Allen Ginsberg have in common?', 'Mike Einziger. Michael Aaron "Mike" Einziger (born June 21, 1976) is an American musician, best known as the guitarist and co-songwriter of the rock band Incubus.  Einziger is widely known as an innovator and enthusiast of the use of pedalboard guitar effects during live concerts, and was voted #41 in Total Guitar\'s top 100 guitarists of all time in 2002.  In an interview with Gibson Guitars, writer Steven Rosen states "[Einziger] hasn’t played the guitar so much as he has manipulated it, submitted it to his own needs.  Einziger fashions a sonic tapestry that draws heavily from the Zappa/Vai/Hendrix school of rock."  Mike is also an active composer, writing his first full-scale orchestral concert entitled "End.> vacuum", as well as "Forced Curvature of Reflective Surfaces"; an experimental composition that was featured at the "West Coast, Left Coast" Festival at Walt Disney Concert Hall.  He co-wrote and played acoustic guitar on Avicii\'s 2013 worldwide hit "Wake Me Up".  Alongside this, Einziger also recently co-wrote and played guitar on David Guetta\'s Lovers on the Sun.</s>Alfred Hitchcock filmography. Alfred Hitchcock (1899–1980) was an English director and filmmaker.  Popularly known as the "Master of Suspense" for his use of innovative film techniques in thrillers, Hitchcock started his career in the British film industry as a title designer and art director for a number of silent films during the early 1920s.  His directorial debut was the 1925 release "The Pleasure Garden".  Hitchcock followed this with "", his first commercial and critical success.  It featured many of the thematic elements his films would be known for such as an innocent man on the run.  It also featured the first of his famous cameo appearances.  Two years later he directed "Blackmail" (1929) which was his first sound film.  In 1935 Hitchcock directed "The 39 Steps".  Three years later he directed "The Lady Vanishes" starring Margaret Lockwood, and Michael Redgrave.</s>Allen Ginsberg. Irwin Allen Ginsberg ( ; June 3, 1926 – April 5, 1997) was an American poet.  He is considered to be one of the leading figures of both the Beat Generation during the 1950s and the counterculture that soon followed.  He vigorously opposed militarism, economic materialism and sexual repression and was known as embodying various aspects of this counterculture, such as his views on drugs, hostility to bureaucracy and openness to Eastern religions.  He was one of many influential American writers of his time known as the Beat Generation, which included famous writers such as Jack Kerouac and William S. Burroughs.'],
-    ['At what race did this driver surpass the driver who rivals Nelson Piquet in most Grand Prix victories?', 'Alain Prost. Alain Marie Pascal Prost, OBE, Chevalier de la Légion d\'honneur (born 24 February 1955) is a French former racing driver.  A four-time Formula One Drivers\' Champion, only Sebastian Vettel (four championships), Juan Manuel Fangio (five championships), and Michael Schumacher (seven championships) have equalled or surpassed his number of titles.  From 1987 until 2001 Prost held the record for most Grand Prix victories and is considered as one of the greatest F1 drivers ever.  Schumacher surpassed Prost\'s total of 51 victories at the 2001 Belgian Grand Prix.  In 1999, Prost received the "World Sports Awards of the Century" in the motor sport category.</s>Nimrod Racing Automobiles. Nimrod Racing Automobiles (sometimes referred to as Aston Martin Nimrod) was a partnership founded in 1981 between racing driver and car dealer Robin Hamilton and chairman of Aston Martin Lagonda, Victor Gauntlett.  The project was intended to build sports prototypes for the World Endurance Championship and IMSA GT Championship using Aston Martin V8 engines.  Although Aston Martin did not own the project, they offered their support for the chance to see success for their name in motorsports without the heavy cost of running their own team.</s>1983 European Grand Prix. The 1983 European Grand Prix was a Formula One motor race held at Brands Hatch on 25 September 1983.  The race, contested over 76 laps, was the fourteenth race of the 1983 Formula One season and was won by Nelson Piquet, driving a Brabham-BMW.  Piquet\'s Drivers\' Championship rival Alain Prost was second in a factory Renault, while Nigel Mansell was third in a Lotus-Renault.  With the win, Piquet moved within two points of Prost at the top of the championship with one race remaining.'],
-    ['What is the average weekly attendance at the church founded by the author of The Purpose Driven Life ?', 'Sisters of Christian Charity. The Sisters of Christian Charity (S.C.C.), officially called Sisters of Christian Charity, Daughters of the Blessed Virgin Mary of the Immaculate Conception, is a Roman Catholic papal congregation of consecrated Religious Sisters.  They were founded in Paderborn, Germany, on 21 August 1849 by Blessed Pauline von Mallinckrodt (b. 3 June 1817, at Minden, Westphalia; d. 30 April 1881), sister of the highly regarded German politician Hermann von Mallinckrodt.  Their original mission was for the care of the blind.  Today, their main mission is teaching in Catholic schools and healthcare.  Unlike some Religious Sisters, Sisters of Christian Charity are required to wear a traditional religious habit.</s>Marshall McLuhan Catholic Secondary School. Marshall McLuhan Catholic Secondary School (Marshall McLuhan, MMCSS, Marshall McLuhan CSS, or McLuhan) is a coeducational, non-semestered, Catholic high school in midtown Toronto, Ontario, Canada managed by the Toronto Catholic District School Board.  It was named after Marshall McLuhan, a Canadian educator, philosopher, and scholar—a professor of English literature, a literary critic, a rhetorician, a communication theorist, and a committed Roman Catholic.  The school was formally founded in September 1998 to replace De La Salle College Oaklands campus in the same area.  The school site was once owned by the Toronto Hunt Club while the building was built by the Canadian Forces as the Canadian Forces College and was used until 1994.  Its motto is ""Faith is our medium"".</s>Rick Warren. Richard Duane "Rick" Warren (born January 28, 1954) is an American evangelical Christian pastor and author.  He is the founder and senior pastor of Saddleback Church, an evangelical megachurch in Lake Forest, California, that is the eighth-largest church in the United States (including multi-site churches).  He is also a bestselling author of many Christian books, including his guide to church ministry and evangelism, "The Purpose Driven Church", which has spawned a series of conferences on Christian ministry and evangelism.  He is perhaps best known for the subsequent book "The Purpose Driven Life" which has sold more than 30 million copies, making Warren a "New York Times bestselling author.'],
-    ['Glenn Frey, Bernie Leadon, and which other person, who is the founding member of the Eagles, sings in "Peaceful Easy Feeling?"', 'Peaceful Easy Feeling. "Peaceful Easy Feeling" is a song written by Jack Tempchin and recorded by the Eagles.  It was the third single from the band\'s 1972 debut album "Eagles".  The single reached No. 22 on the charts and is one of the band\'s most popular songs.  Glenn Frey sings the lead vocal, with Bernie Leadon providing the main harmony vocal (starting in the beginning of the second verse) and Randy Meisner completing this three-part harmony.</s>Randy Meisner. Randy Herman Meisner (born March 8, 1946) is an American former musician, singer and songwriter best known as a founding member of the Eagles and Poco.  Throughout his professional musical career, Meisner\'s main role was that of bassist and backing high-harmony vocalist as both a group member and session musician.  He is best known for the Eagles hit song "Take It to the Limit", which he co-wrote and sang.</s>Daryl Hall. Daryl Franklin Hohl (born October 11, 1946), known professionally as Daryl Hall, is an American rock, R&B, and soul singer; keyboardist, guitarist, songwriter, and producer, best known as the co-founder and lead vocalist of Hall & Oates (with guitarist and songwriter John Oates).'],
-    ['What was founded first, Playboy or Goldmine?', 'Goldmine (magazine). Goldmine, established in September 1974, by founder Brian Bukantis out of Fraser Michigan is an American magazine that focuses on the collectors\' market for records, tapes, CDs, and music-related memorabilia.  Each issue features news articles, interviews, discographies, histories, current reviews on recording stars of the past and present.  Discographies are featured, listing all known releases.  Coverage includes Rock, Blues, Country, Folk and Classical.  Other features include classified ads, trends, and a show calendar.  At one point its chief competitor was DISCoveries (with more of an emphasis on 1950s oldies) which later was purchased by the same owner before folding into it as a single publication.</s>Playboy. Playboy is an American men\'s lifestyle and entertainment magazine.  It was founded in Chicago in 1953, by Hugh Hefner and his associates, and funded in part by a $1,000 loan from Hefner\'s mother.  Notable for its centerfolds of nude and semi-nude models (Playmates), "Playboy" played an important role in the sexual revolution and remains one of the world\'s best-known brands, having grown into Playboy Enterprises, Inc., with a presence in nearly every medium.  In addition to the flagship magazine in the United States, special nation-specific versions of "Playboy" are published worldwide.</s>Paris Hilton. Paris Whitney Hilton (born February 17, 1981) is an American businesswoman, socialite, television and media personality, model, actress, singer, and DJ.  She is the great-granddaughter of Conrad Hilton, the founder of Hilton Hotels.  Born in New York City and raised there and in Beverly Hills, California, Hilton began her modeling career as a teenager when she signed with New York-based modelling development agency Trump Model Management.  Her lifestyle and rumored short-lived relationships made her a feature of entertainment news and tabloid magazines, and Hilton was proclaimed "New York\'s leading It girl" in 2001.  In 2003, a sex tape with Hilton and her then-boyfriend Rick Salomon, later released as "1 Night in Paris", was leaked to the public.  Released only three weeks before the premiere of the reality television series "The Simple Life", in which she starred alongside her long-time friend Nicole Richie, the sex tape became a media sensation.'],
 ]
 scores = model.predict(pairs)
 print(scores.shape)
@@ -95,13 +95,13 @@ print(scores.shape)
 # Or rank different texts based on similarity to a single text
 ranks = model.rank(
-    'What profession does Muhammad Iqbal and Allen Ginsberg have in common?',
     [
-        'Mike Einziger. Michael Aaron "Mike" Einziger (born June 21, 1976) is an American musician, best known as the guitarist and co-songwriter of the rock band Incubus.  Einziger is widely known as an innovator and enthusiast of the use of pedalboard guitar effects during live concerts, and was voted #41 in Total Guitar\'s top 100 guitarists of all time in 2002.  In an interview with Gibson Guitars, writer Steven Rosen states "[Einziger] hasn’t played the guitar so much as he has manipulated it, submitted it to his own needs.  Einziger fashions a sonic tapestry that draws heavily from the Zappa/Vai/Hendrix school of rock."  Mike is also an active composer, writing his first full-scale orchestral concert entitled "End.> vacuum", as well as "Forced Curvature of Reflective Surfaces"; an experimental composition that was featured at the "West Coast, Left Coast" Festival at Walt Disney Concert Hall.  He co-wrote and played acoustic guitar on Avicii\'s 2013 worldwide hit "Wake Me Up".  Alongside this, Einziger also recently co-wrote and played guitar on David Guetta\'s Lovers on the Sun.</s>Alfred Hitchcock filmography. Alfred Hitchcock (1899–1980) was an English director and filmmaker.  Popularly known as the "Master of Suspense" for his use of innovative film techniques in thrillers, Hitchcock started his career in the British film industry as a title designer and art director for a number of silent films during the early 1920s.  His directorial debut was the 1925 release "The Pleasure Garden".  Hitchcock followed this with "", his first commercial and critical success.  It featured many of the thematic elements his films would be known for such as an innocent man on the run.  It also featured the first of his famous cameo appearances.  Two years later he directed "Blackmail" (1929) which was his first sound film.  In 1935 Hitchcock directed "The 39 Steps".  Three years later he directed "The Lady Vanishes" starring Margaret Lockwood, and Michael Redgrave.</s>Allen Ginsberg. Irwin Allen Ginsberg ( ; June 3, 1926 – April 5, 1997) was an American poet.  He is considered to be one of the leading figures of both the Beat Generation during the 1950s and the counterculture that soon followed.  He vigorously opposed militarism, economic materialism and sexual repression and was known as embodying various aspects of this counterculture, such as his views on drugs, hostility to bureaucracy and openness to Eastern religions.  He was one of many influential American writers of his time known as the Beat Generation, which included famous writers such as Jack Kerouac and William S. Burroughs.',
-        'Alain Prost. Alain Marie Pascal Prost, OBE, Chevalier de la Légion d\'honneur (born 24 February 1955) is a French former racing driver.  A four-time Formula One Drivers\' Champion, only Sebastian Vettel (four championships), Juan Manuel Fangio (five championships), and Michael Schumacher (seven championships) have equalled or surpassed his number of titles.  From 1987 until 2001 Prost held the record for most Grand Prix victories and is considered as one of the greatest F1 drivers ever.  Schumacher surpassed Prost\'s total of 51 victories at the 2001 Belgian Grand Prix.  In 1999, Prost received the "World Sports Awards of the Century" in the motor sport category.</s>Nimrod Racing Automobiles. Nimrod Racing Automobiles (sometimes referred to as Aston Martin Nimrod) was a partnership founded in 1981 between racing driver and car dealer Robin Hamilton and chairman of Aston Martin Lagonda, Victor Gauntlett.  The project was intended to build sports prototypes for the World Endurance Championship and IMSA GT Championship using Aston Martin V8 engines.  Although Aston Martin did not own the project, they offered their support for the chance to see success for their name in motorsports without the heavy cost of running their own team.</s>1983 European Grand Prix. The 1983 European Grand Prix was a Formula One motor race held at Brands Hatch on 25 September 1983.  The race, contested over 76 laps, was the fourteenth race of the 1983 Formula One season and was won by Nelson Piquet, driving a Brabham-BMW.  Piquet\'s Drivers\' Championship rival Alain Prost was second in a factory Renault, while Nigel Mansell was third in a Lotus-Renault.  With the win, Piquet moved within two points of Prost at the top of the championship with one race remaining.',
-        'Sisters of Christian Charity. The Sisters of Christian Charity (S.C.C.), officially called Sisters of Christian Charity, Daughters of the Blessed Virgin Mary of the Immaculate Conception, is a Roman Catholic papal congregation of consecrated Religious Sisters.  They were founded in Paderborn, Germany, on 21 August 1849 by Blessed Pauline von Mallinckrodt (b. 3 June 1817, at Minden, Westphalia; d. 30 April 1881), sister of the highly regarded German politician Hermann von Mallinckrodt.  Their original mission was for the care of the blind.  Today, their main mission is teaching in Catholic schools and healthcare.  Unlike some Religious Sisters, Sisters of Christian Charity are required to wear a traditional religious habit.</s>Marshall McLuhan Catholic Secondary School. Marshall McLuhan Catholic Secondary School (Marshall McLuhan, MMCSS, Marshall McLuhan CSS, or McLuhan) is a coeducational, non-semestered, Catholic high school in midtown Toronto, Ontario, Canada managed by the Toronto Catholic District School Board.  It was named after Marshall McLuhan, a Canadian educator, philosopher, and scholar—a professor of English literature, a literary critic, a rhetorician, a communication theorist, and a committed Roman Catholic.  The school was formally founded in September 1998 to replace De La Salle College Oaklands campus in the same area.  The school site was once owned by the Toronto Hunt Club while the building was built by the Canadian Forces as the Canadian Forces College and was used until 1994.  Its motto is ""Faith is our medium"".</s>Rick Warren. Richard Duane "Rick" Warren (born January 28, 1954) is an American evangelical Christian pastor and author.  He is the founder and senior pastor of Saddleback Church, an evangelical megachurch in Lake Forest, California, that is the eighth-largest church in the United States (including multi-site churches).  He is also a bestselling author of many Christian books, including his guide to church ministry and evangelism, "The Purpose Driven Church", which has spawned a series of conferences on Christian ministry and evangelism.  He is perhaps best known for the subsequent book "The Purpose Driven Life" which has sold more than 30 million copies, making Warren a "New York Times bestselling author.',
-        'Peaceful Easy Feeling. "Peaceful Easy Feeling" is a song written by Jack Tempchin and recorded by the Eagles.  It was the third single from the band\'s 1972 debut album "Eagles".  The single reached No. 22 on the charts and is one of the band\'s most popular songs.  Glenn Frey sings the lead vocal, with Bernie Leadon providing the main harmony vocal (starting in the beginning of the second verse) and Randy Meisner completing this three-part harmony.</s>Randy Meisner. Randy Herman Meisner (born March 8, 1946) is an American former musician, singer and songwriter best known as a founding member of the Eagles and Poco.  Throughout his professional musical career, Meisner\'s main role was that of bassist and backing high-harmony vocalist as both a group member and session musician.  He is best known for the Eagles hit song "Take It to the Limit", which he co-wrote and sang.</s>Daryl Hall. Daryl Franklin Hohl (born October 11, 1946), known professionally as Daryl Hall, is an American rock, R&B, and soul singer; keyboardist, guitarist, songwriter, and producer, best known as the co-founder and lead vocalist of Hall & Oates (with guitarist and songwriter John Oates).',
-        'Goldmine (magazine). Goldmine, established in September 1974, by founder Brian Bukantis out of Fraser Michigan is an American magazine that focuses on the collectors\' market for records, tapes, CDs, and music-related memorabilia.  Each issue features news articles, interviews, discographies, histories, current reviews on recording stars of the past and present.  Discographies are featured, listing all known releases.  Coverage includes Rock, Blues, Country, Folk and Classical.  Other features include classified ads, trends, and a show calendar.  At one point its chief competitor was DISCoveries (with more of an emphasis on 1950s oldies) which later was purchased by the same owner before folding into it as a single publication.</s>Playboy. Playboy is an American men\'s lifestyle and entertainment magazine.  It was founded in Chicago in 1953, by Hugh Hefner and his associates, and funded in part by a $1,000 loan from Hefner\'s mother.  Notable for its centerfolds of nude and semi-nude models (Playmates), "Playboy" played an important role in the sexual revolution and remains one of the world\'s best-known brands, having grown into Playboy Enterprises, Inc., with a presence in nearly every medium.  In addition to the flagship magazine in the United States, special nation-specific versions of "Playboy" are published worldwide.</s>Paris Hilton. Paris Whitney Hilton (born February 17, 1981) is an American businesswoman, socialite, television and media personality, model, actress, singer, and DJ.  She is the great-granddaughter of Conrad Hilton, the founder of Hilton Hotels.  Born in New York City and raised there and in Beverly Hills, California, Hilton began her modeling career as a teenager when she signed with New York-based modelling development agency Trump Model Management.  Her lifestyle and rumored short-lived relationships made her a feature of entertainment news and tabloid magazines, and Hilton was proclaimed "New York\'s leading It girl" in 2001.  In 2003, a sex tape with Hilton and her then-boyfriend Rick Salomon, later released as "1 Night in Paris", was leaked to the public.  Released only three weeks before the premiere of the reality television series "The Simple Life", in which she starred alongside her long-time friend Nicole Richie, the sex tape became a media sensation.',
     ]
 )
 # [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]
@@ -142,8 +142,8 @@ You can finetune this model on your own dataset.
 | Metric       | validation | train_subset |
 |:-------------|:-----------|:-------------|
-| pearson      | 0.8953     | 0.876        |
-| **spearman** | **0.9271** | **0.8966**   |
 <!--
 ## Bias, Risks and Limitations
@@ -163,19 +163,19 @@ You can finetune this model on your own dataset.
 #### Unnamed Dataset
-* Size: 6,000 training samples
 * Columns: <code>sentence_0</code>, <code>sentence_1</code>, and <code>label</code>
 * Approximate statistics based on the first 1000 samples:
-  |         | sentence_0                                                                                       | sentence_1                                                                                          | label                                                          |
-  |:--------|:-------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------|:---------------------------------------------------------------|
-  | type    | string                                                                                           | string                                                                                              | float                                                          |
-  | details | <ul><li>min: 22 characters</li><li>mean: 104.26 characters</li><li>max: 415 characters</li></ul> | <ul><li>min: 506 characters</li><li>mean: 1755.72 characters</li><li>max: 5880 characters</li></ul> | <ul><li>min: 0.0</li><li>mean: 0.47</li><li>max: 1.0</li></ul> |
 * Samples:
-  | sentence_0                                                                                                          | sentence_1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               | label            |
-  |:--------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
-  | <code>What profession does Muhammad Iqbal and Allen Ginsberg have in common?</code>                                 | <code>Mike Einziger. Michael Aaron "Mike" Einziger (born June 21, 1976) is an American musician, best known as the guitarist and co-songwriter of the rock band Incubus.  Einziger is widely known as an innovator and enthusiast of the use of pedalboard guitar effects during live concerts, and was voted #41 in Total Guitar's top 100 guitarists of all time in 2002.  In an interview with Gibson Guitars, writer Steven Rosen states "[Einziger] hasn’t played the guitar so much as he has manipulated it, submitted it to his own needs.  Einziger fashions a sonic tapestry that draws heavily from the Zappa/Vai/Hendrix school of rock."  Mike is also an active composer, writing his first full-scale orchestral concert entitled "End.> vacuum", as well as "Forced Curvature of Reflective Surfaces"; an experimental composition that was featured at the "West Coast, Left Coast" Festival at Walt Disney Concert Hall.  He co-wrote and played acoustic guitar on Avicii's 2013 worldwide hit "Wake Me Up".  Alongside thi...</code> | <code>0.5</code> |
-  | <code>At what race did this driver surpass the driver who rivals Nelson Piquet in most Grand Prix victories?</code> | <code>Alain Prost. Alain Marie Pascal Prost, OBE, Chevalier de la Légion d'honneur (born 24 February 1955) is a French former racing driver.  A four-time Formula One Drivers' Champion, only Sebastian Vettel (four championships), Juan Manuel Fangio (five championships), and Michael Schumacher (seven championships) have equalled or surpassed his number of titles.  From 1987 until 2001 Prost held the record for most Grand Prix victories and is considered as one of the greatest F1 drivers ever.  Schumacher surpassed Prost's total of 51 victories at the 2001 Belgian Grand Prix.  In 1999, Prost received the "World Sports Awards of the Century" in the motor sport category.</s>Nimrod Racing Automobiles. Nimrod Racing Automobiles (sometimes referred to as Aston Martin Nimrod) was a partnership founded in 1981 between racing driver and car dealer Robin Hamilton and chairman of Aston Martin Lagonda, Victor Gauntlett.  The project was intended to build sports prototypes for the World Endurance Champions...</code> | <code>1.0</code> |
-  | <code>What is the average weekly attendance at the church founded by the author of The Purpose Driven Life ?</code> | <code>Sisters of Christian Charity. The Sisters of Christian Charity (S.C.C.), officially called Sisters of Christian Charity, Daughters of the Blessed Virgin Mary of the Immaculate Conception, is a Roman Catholic papal congregation of consecrated Religious Sisters.  They were founded in Paderborn, Germany, on 21 August 1849 by Blessed Pauline von Mallinckrodt (b. 3 June 1817, at Minden, Westphalia; d. 30 April 1881), sister of the highly regarded German politician Hermann von Mallinckrodt.  Their original mission was for the care of the blind.  Today, their main mission is teaching in Catholic schools and healthcare.  Unlike some Religious Sisters, Sisters of Christian Charity are required to wear a traditional religious habit.</s>Marshall McLuhan Catholic Secondary School. Marshall McLuhan Catholic Secondary School (Marshall McLuhan, MMCSS, Marshall McLuhan CSS, or McLuhan) is a coeducational, non-semestered, Catholic high school in midtown Toronto, Ontario, Canada managed by the Toronto C...</code> | <code>0.5</code> |
 * Loss: [<code>BinaryCrossEntropyLoss</code>](https://sbert.net/docs/package_reference/cross_encoder/losses.html#binarycrossentropyloss) with these parameters:
   ```json
   {
@@ -314,11 +314,36 @@ You can finetune this model on your own dataset.
 ### Training Logs
 | Epoch  | Step | Training Loss | validation_spearman | train_subset_spearman |
 |:------:|:----:|:-------------:|:-------------------:|:---------------------:|
-| 0.0333 | 100  | -             | 0.9291              | 0.8634                |
-| 0.0667 | 200  | -             | 0.9306              | 0.8898                |
-| 0.1    | 300  | -             | 0.9259              | 0.8874                |
-| 0.1333 | 400  | -             | 0.9084              | 0.8679                |
-| 0.1667 | 500  | 0.5222        | 0.9271              | 0.8966                |
 ### Framework Versions

 - cross-encoder
 - reranker
 - generated_from_trainer
+- dataset_size:18000
 - loss:BinaryCrossEntropyLoss
 base_model: BAAI/bge-reranker-v2-m3
 pipeline_tag: text-ranking
       type: validation
     metrics:
     - type: pearson
+      value: 0.935050993254005
       name: Pearson
     - type: spearman
+      value: 0.9270154507155018
       name: Spearman
   - task:
       type: cross-encoder-correlation
       type: train_subset
     metrics:
     - type: pearson
+      value: 0.8837618842773148
       name: Pearson
     - type: spearman
+      value: 0.877862662684244
       name: Spearman
 ---
 model = CrossEncoder("cross_encoder_model_id")
 # Get scores for pairs of texts
 pairs = [
+    ['The 1958 film Hello London saw the film debut of an actor that died in what year?', 'Mysteries of London. Mysteries of London is a 1915 British silent crime film directed by A. E. Coleby and starring Wingold Lawrence and Flora Morris.  The film may have taken its inspiration from the Victorian penny dreadful "The Mysteries of London".</s>London Has Fallen. London Has Fallen is a 2016 American action thriller film directed by Babak Najafi and written by Creighton Rothenberger, Katrin Benedikt, Chad St. John and Christian Gudegast.  It is a sequel to Antoine Fuqua\'s 2013 film "Olympus Has Fallen" and stars Gerard Butler, Aaron Eckhart and Morgan Freeman, with Alon Moni Aboutboul, Angela Bassett, Robert Forster, Jackie Earle Haley, Melissa Leo, Radha Mitchell, Sean O\'Bryan, Waleed Zuaiter and Charlotte Riley in supporting roles.  It is the second installment in the "Has Fallen" film series.</s>Edward Snyder (cinematographer). Edward Snyder, also known as Edward J. Snyder (1895 – July 10, 1982) was an American cameraman, cinematographer (director of photography), and visual effects/special effects artist.  Born in New York City in 1895, Snyder would break into the film industry as the Director of Photography on the 1926 silent film, "The Fighting Marine", which featured the only screen performance by boxing heavyweight champion, Gene Tunney.  He would be one of the plethora of talented cameramen to work on the Howard Hughes\' 1930 aerial classic, "Hell\'s Angels", along with such other notable cameramen and future directors of photography, Paul Ivano, Henry Cronjager and Ernest Laszlo.  But it was as special effects artist that he would have his greatest success, working on such classic films as Otto Preminger\'s "Laura"; George Cukor\'s "Winged Victory"; "The Keys of the Kingdom", starring Gregory Peck; Elia Kazan\'s A Tree Grows in Brooklyn; Anna and the King of Siam, starring Irene Dunne and Rex Harrison; and 1948\'s Deep Waters, for which he was nominated for an Academy Award (losing to the special effects team of Portrait of Jennie).  Snyder died in 1982.</s>Will Ferrell. John William Ferrell ( ; born July 16, 1967) is an American actor, comedian, producer, and writer.  He first established himself in the mid-1990s as a cast member on the NBC sketch comedy show "Saturday Night Live", and has subsequently starred in comedy films such as "" (2004), "" (2006), "Step Brothers" (2008), "The Other Guys" (2010) and "" (2013), all but one of which he co-wrote with his comedy partner Adam McKay.  The two also founded the comedy website Funny or Die in 2007.  Other films roles include "Elf", "Old School" (both 2003), "Blades of Glory" (2007), and the animated films "Megamind" (2010) and "The Lego Movie" (2014).</s>John Hurt. Sir John Vincent Hurt, {\'1\': ", \'2\': ", \'3\': ", \'4\': "} (22 January 1940 – 25 January 2017) was an English actor whose screen and stage career spanned more than 50 years.  Hurt was regarded as one of Britain\'s finest actors; director David Lynch described him as "simply the greatest actor in the world".</s>George Raft. George Raft (born George Ranft; September 26, 1901 – November 24, 1980) was an American film actor and dancer identified with portrayals of gangsters in crime melodramas of the 1930s and 1940s.  A stylish leading man in dozens of movies, today Raft is mostly known for his gangster roles in the original "Scarface" (1932), "Each Dawn I Die" (1939), and Billy Wilder\'s 1959 comedy "Some Like it Hot", as a dancer in "Bolero" (1934), and a truck driver in "They Drive by Night" (1940).</s>Sherlock Holmes (2010 film). Sir Arthur Conan Doyle\'s Sherlock Holmes, also known simply as Sherlock Holmes, is a British-American 2010 steampunk mystery film directed by Rachel Lee Goldenberg and produced by independent American film studio The Asylum.  It features the Sherlock Holmes characters created by Sir Arthur Conan Doyle, though it follows an original plot.  The film details an unrecorded case in which eccentric detective Holmes and his companion Dr. Watson investigate a series of unusual monster attacks and a plot to destroy London.  Gareth David-Lloyd plays Dr. John Watson and Ben Syder, making his film debut, plays Sherlock Holmes.'],
+    ['What show with music by Alan Menken and the role of Morris Delancey was made by Disney?', 'Kenny McCormick. Kenneth "Kenny" McCormick is a main character in the animated adult television series "South Park", along with his friends Stan Marsh, Kyle Broflovski, and Eric Cartman.  His oft-muffled and indiscernible speech—the result of his parka hood covering his mouth—is provided by co-creator Matt Stone.  He debuted on television when "South Park" first aired on August 13, 1997, after having first appeared in "The Spirit of Christmas" shorts created by Stone and long-time collaborator Trey Parker in 1992 ("Jesus vs. Frosty") and 1995 ("Jesus vs. Santa").</s>Happy Working Song. "Happy Working Song" is a song written by composer Alan Menken and lyricist Stephen Schwartz for Walt Disney Pictures\' musical film "Enchanted" (2007).  Recorded by American actress Amy Adams in her starring role as Giselle, the uptempo pop song both parodies and pays homage to a variety of songs from several Disney animated feature films, particularly "Whistle While You Work" from "Snow White and the Seven Dwarfs" (1937).  Produced by Menken, Schwartz and Danny Troob, the song appears on the film\'s soundtrack "Enchanted: Original Soundtrack."</s>Newsies (musical). Newsies The Musical is a Disney Theatrical Productions stage musical based on the 1992 musical film "Newsies", which in turn was inspired by the real-life Newsboys Strike of 1899 in New York City.  The show has music by Alan Menken, lyrics by Jack Feldman, and a book by Harvey Fierstein.  The musical premiered at the Paper Mill Playhouse in 2011 and made its Broadway debut in 2012.</s>The Little Mermaid: Ariel\'s Beginning. The Little Mermaid: Ariel\'s Beginning (also known as The Little Mermaid III) is a 2008 animated fantasy feature film produced by Walt Disney Pictures and DisneyToon Studios, and the direct-to-video prequel to Disney\'s 1989 film "The Little Mermaid".  Directed by Peggy Holmes, the film\'s story is set before the events of the 1989 film and the , where all music has been banned from the underwater kingdom of Atlantica by King Triton, and his youngest daughter Ariel attempts to challenge this law.  The film features the voices of Jodi Benson, Samuel E. Wright, Sally Field, and Jim Cummings.  Walt Disney Studios Home Entertainment released the film on August 26, 2008.  The animated by Toon City Animation, Inc., to Walt Disney Animation Australia by 2008, unit director Pieter Lommerse, workbook supervisor Stephen Lumley, clean-up director David Hardy, inbetween director Miles Jenkinson, effects director Marvin Petilla, supervising color stylist Jenny North and Aaron Stannard.  The film contradicts certain events of the television series, implying that it is an independent installment of Disney\'s "The Little Mermaid" franchise.</s>Disney\'s Aladdin: A Musical Spectacular. Disney\'s Aladdin: A Musical Spectacular was a Broadway-style show based on Disney\'s 1992 animated film "Aladdin" with music by Alan Menken and lyrics by Howard Ashman, Tim Rice and Alan Menken.</s>Lilo &amp; Stitch. Lilo & Stitch is a 2002 American animated science fiction comedy-drama film produced by Walt Disney Feature Animation and released by Walt Disney Pictures.  The 42nd Disney animated feature film, "Lilo & Stitch" was written and directed by Dean DeBlois and Chris Sanders, the latter also starring as Stitch, and features the voices of Daveigh Chase, Tia Carrere, David Ogden Stiers, Kevin McDonald, Ving Rhames, Jason Scott Lee, and Kevin Michael Richardson.  It was the second of three Disney animated features produced primarily at the Florida animation studio located at Disney\'s Hollywood Studios (then known as Disney-MGM Studios during production) in Walt Disney World near Orlando, Florida.</s>List of Jessica Jones characters. "Jessica Jones" is an American web television series created for Netflix by Melissa Rosenberg, based on the Marvel Comics character of the same name.  It is set in the Marvel Cinematic Universe (MCU), sharing continuity with the films of the franchise, and is the second in a series of shows that will lead up to a Defenders crossover miniseries.  The series stars Krysten Ritter as Jessica Jones, with Rachael Taylor, Eka Darville, and Carrie-Anne Moss also starring.  They were joined by Mike Colter, Wil Traval, Erin Moriarty, and David Tennant for the first season, and Leah Gibson and J.R. Ramirez for the second season.  In addition to original characters, several characters from other Marvel Cinematic Universe television series and/or based on various Marvel properties also appear throughout the series.'],
+    ['Who directed the film Leslie I. Carey worked on in 1947?', 'Shehnai (1947 film). Shehnai is a 1947 Indian Bollywood film directed by P.L. Santoshi, starring Kishore Kumar, Indumati, Radhakrishan, V.H. Desai and Rehana.  It was the fifth highest grossing Indian film of 1947.  Santoshi went on make the classic, "Barsaat Ki Raat" (1960) starring Madhubala and Bharat Bhushan.</s>Doctor Morelle. Doctor Morelle is a 1949 British mystery film directed by Godfrey Grayson and starring Valentine Dyall, Peter Drury and Hugh Griffith.  It is also known by two alternative titles: Dr. Morelle: The Case of the Missing Heiress or simply The Case of the Missing Heiress.  It was made by Hammer Films, based on the popular long running BBC radio series written by Ernest Dudley and starring Cecil Parker.  Dudley also wrote many novels and short stories featuring the character of Morelle.</s>The Nice Guys. The Nice Guys is a 2016 American neo-noir action comedy film directed by Shane Black and written by Black and Anthony Bagarozzi.  The film stars Russell Crowe, Ryan Gosling, Angourie Rice, Matt Bomer, Margaret Qualley, Keith David and Kim Basinger.  Set in Los Angeles, 1977, the film focuses on a private eye (Gosling) and a tough enforcer (Crowe) who team up to investigate the disappearance of a teenage girl.</s>A Double Life (1947 film). A Double Life is a 1947 film noir which tells the story of an actor whose mind becomes affected by the character he portrays.  The movie starred Ronald Colman and Signe Hasso.  It was directed by George Cukor and written for the screen by Ruth Gordon and Garson Kanin.  Ronald Colman won the Academy Award for Best Actor for his performance in this film.</s>Sam Neill. Nigel John Dermot Neill {\'1\': ", \'2\': ", \'3\': ", \'4\': "} (born 14 September 1947), known professionally as Sam Neill, is a New Zealand actor who first achieved leading roles in films such as "" and "Dead Calm" and on television in "Reilly, Ace of Spies".  He won a broad international audience in 1993 for his roles as Alisdair Stewart in "The Piano" and Dr. Alan Grant in "Jurassic Park", a role he reprised in 2001\'s "Jurassic Park III".  Neill also had notable roles in "Merlin", "The Hunt for Red October", "Peaky Blinders", and "The Tudors".  In 2016, he starred in "Hunt for the Wilderpeople" alongside Julian Dennison, to great acclaim.</s>Oscar and Lucinda (film). Oscar and Lucinda is a 1997 British-Australian-American romantic drama film directed by Gillian Armstrong and starring Cate Blanchett, Ralph Fiennes, Ciarán Hinds and Tom Wilkinson.  It is based on the 1988 Booker Prize-winning novel "Oscar and Lucinda" by Peter Carey.  In March 1998, the film was nominated at the Academy Awards for the Best Costume Design.</s>Till the End of Time (film). Till the End of Time is a 1946 drama film directed by Edward Dmytryk and starring Dorothy McGuire, Guy Madison, Robert Mitchum, and Bill Williams.  Released the same year as but preceding the better known "The Best Years of Our Lives", it covers much the same topic: the adjustment of World War II veterans to civilian life.  It was based on the novel "They Dream of Home" by Niven Busch.  Unlike the soldier, sailor and airman of "The Best Years of Our Lives", the male leads in this film are all U.S. Marines.'],
+    ['What actress born February 25,1966 starred in The Smell of Success?', 'Téa Leoni. Elizabeth Téa Pantaleoni ( ; born February 25, 1966), better known by her stage name Téa Leoni, is an American actress and producer.</s>Yumiko Nogawa. Yumiko Nogawa (野川由美子 , Nogawa Yumiko ) (born August 30, 1944) is a Japanese actress born in Kyoto, Japan.  She has starred in several movies, notably "Gate of Flesh" (1964), a Japanese erotic film, part of a trilogy of films she made with director Seijun Suzuki.  Including "Story of a Prostitute" (1965) and "Carmen from Kawachi" (1966), these films are known as Nogawa\'s "Flesh Trilogy".  Nogawa has appeared in numerous films in Japan, including director Nagisa Oshima\'s "The Pleasures of the Flesh" (1965) and "Zatoichi and the Fugitives" (1968), the eighteenth film in the "Zatoichi" series.  She has also appeared in television series on Nippon Television, TV Tokyo, Fuji TV, and NHK.</s>The Weight of Water (film). The Weight of Water is a 2000 French-American mystery thriller film based on Anita Shreve\'s 1997 novel of the same name.  Directed by Kathryn Bigelow, the film stars Elizabeth Hurley, Catherine McCormack, Sean Penn, and Sarah Polley.  The film was shot in Nova Scotia.  Although it premiered at the 2000 Toronto International Film Festival, it was not released in the United States until November 1, 2002.</s>Maggie Moore. Maggie Moore (10 April 1851 - March 15, 1926) was an American-Australian actress born as Margaret Virginia Sullivan.  She met and married producer J. C. Williamson in the U.S. and became popular as an actress in their production of "Struck Oil", which premiered in 1873 and was revived many times.  Soon after their marriage, they took the play on a tour of Australia.  It was such a success that they stayed there, where he founded the most successful theatrical company in Australia, and she became a leading actress.</s>Noriko Tatsumi. Noriko Tatsumi (辰巳典子 , Tatsumi Noriko , born October 12, 1947 in Osaka, Japan) is a Japanese actress known primarily for her appearances in "pink films" of the 1960s.  During the "First Wave" of "pink film", Tatsumi became known as the first "Queen" of Japanese softcore sex movies, a title which she held from 1967 through 1970.  She most often appeared in the films of the World Eiga and Nihon Cinema studios, and is best known for her work with director Kōji Seki, especially "Whore" (1967) and "Erotic Culture Shock" (1969).  She also appeared in director and Seijun Suzuki script-writer, Atsushi Yamatoya\'s influential 1967 cult film, "Inflatable Sex Doll of the Wastelands".</s>Britney Spears. Britney Jean Spears (born December 2, 1981) is an American singer, dancer, and actress.  Born in McComb, Mississippi, and raised in Kentwood, Louisiana, she performed acting roles in stage productions and television shows as a child before signing with Jive Records in 1997.  Spears\'s first and second studio albums, "...Baby One More Time" (1999) and "Oops! ... I Did It Again" (2000), became international successes, with the former becoming the best-selling album by a teenage solo artist.  Title tracks "...Baby One More Time" and "Oops! ... I Did It Again" broke international sales records.  In 2001, Spears released her self-titled third studio album, "Britney", and played the starring role in the film "Crossroads" (2002).  She assumed creative control of her fourth studio album, "In the Zone" (2003), which yielded the worldwide success of the single "Toxic".</s>Saif Ali Khan. Saif Ali Khan (] ; born Sajid Ali Khan on 16 August 1970) is an Indian film actor and producer.  The son of actress Sharmila Tagore and the late cricketer Mansoor Ali Khan Pataudi, Khan made his acting debut in Yash Chopra\'s unsuccessful drama "Parampara" (1993), but achieved success with his roles in the romantic drama "Yeh Dillagi" and the action film "Main Khiladi Tu Anari" (both 1994).  Khan\'s career prospect declined through much of the 1990s, and his biggest commercial success of the decade came with the ensemble drama "Hum Saath-Saath Hain" (1999).  He rose to prominence with roles in two ensemble comedy-dramas"Dil Chahta Hai" (2001) and "Kal Ho Naa Ho" (2003).'],
+    ['Complicit by Joe Sutton premièred at The Old Vic Theater in which year?', 'Evidently... John Cooper Clarke. Evidently... John Cooper Clarke is a 2012 television documentary about the life of the Salford performance poet John Cooper Clarke.  It was directed by John Ross and produced by Scotty Clark and was first aired on BBC Four in May 2012 as part of BBC Four and BBC 6 Music\'s "Punk Britannia" season.  It features testimonies from Alex Turner, Bill Bailey, Pete Shelley, Paul Farley, Steve Coogan, Mark Radcliffe, Craig Charles, Plan B, Kate Nash, Miranda Sawyer and Paul Morley; and poems by Clarke including "Things Are Gonna Get Worse", "Evidently Chickentown", "Twat" and "Beasley Street".</s>Junetta Jones. Junetta Jones (born March 12, 1936) was an American operatic soprano.  A Baltimore native, she was a graduate of [[Frederick Douglass Senior High School (Baltimore, Maryland)|Frederick Douglass Senior High School.  After spending a year at Morgan State College(now University), she was awarded a three-year scholarship to the [[Peabody Conservatory]] where she earned a diploma in 1961 and studied singing with [[Joseph Laderoute]].  She then pursued further studies at the [[New England Conservatory]] where she earned a [[Master of Music]] in 1963 and was a pupil of [[Gladys Miller]].  She studied at the [[Tanglewood Music Center]] in the summer of 1961.  In 1963 she won the [[Metropolitan Opera National Council Auditions]].  She made her debut at the [[Metropolitan Opera]] on [[Halloween]] of 1963 as the Celestial Voice in [[Giuseppe Verdi]]\'s "[[Don Carlos]]" with [[Richard Tucker]] in the title role.  She sang two seasons at the Met, with other roles including the 1st Genie in "[[The Magic Flute]]", the Page in "[[Rigoletto]]", and Barbarina in "[[The Marriage of Figaro]]".  From 1965-1969 she performed with major opera houses in Europe.  She worked for 20 years on the advisory committee for art and culture for the city of Baltimore.</s>Nico Tatarowicz. Nico Tatarowicz (born 23 April 1974) is a British actor and writer, known for The Armstrong and Miller Show (2007), Very Important People (2012), Crackanory (2013), Murder in Successville (2015-2017) .</s>The Crucible (1996 film). The Crucible is a 1996 American historical drama film written by Arthur Miller adapting his play of the same title, inspired by the Salem witchcraft trials.  It was directed by Nicholas Hytner and stars Daniel Day-Lewis as John Proctor, Winona Ryder as Abigail Williams, Paul Scofield as Judge Thomas Danforth, Bruce Davison as Reverend Parris, and Joan Allen as Elizabeth Proctor.  Much of the filming took place on Choate Island in Essex, Massachusetts.</s>Joseph Cotten. Joseph Cheshire Cotten, Jr. (May 15, 1905 – February 6, 1994) was an American film, stage, radio and television actor.  Cotten achieved prominence on Broadway, starring in the original stage productions of "The Philadelphia Story" and "Sabrina Fair".  He first gained worldwide fame in three Orson Welles films: "Citizen Kane" (1941), "The Magnificent Ambersons" (1942), and "Journey into Fear" (1943), for which Cotten was also credited with the screenplay.  He went on to become one of the leading Hollywood actors of the 1940s, appearing in films such as "Shadow of a Doubt" (1943), "Love Letters" (1945), "Duel in the Sun" (1946), "Portrait of Jennie" (1948), "The Third Man" (1949) and "Niagara" (1953).  One of his final films was Michael Cimino\'s "Heaven\'s Gate" (1980).</s>Complicit (play). Complicit is a play by American playwright Joe Sutton premièred at The Old Vic Theater in London on 7 January 2009.</s>Killer Joe (film). Killer Joe is a 2011 American Southern Gothic black comedy crime film directed by William Friedkin.  The screenplay by Tracy Letts is based on his 1993 play of the same name.  The film stars Matthew McConaughey in the title role, Emile Hirsch, Juno Temple, Gina Gershon, and Thomas Haden Church.  Friedkin and Letts had similarly collaborated on the 2006 film "Bug".'],
 ]
 scores = model.predict(pairs)
 print(scores.shape)
 # Or rank different texts based on similarity to a single text
 ranks = model.rank(
+    'The 1958 film Hello London saw the film debut of an actor that died in what year?',
     [
+        'Mysteries of London. Mysteries of London is a 1915 British silent crime film directed by A. E. Coleby and starring Wingold Lawrence and Flora Morris.  The film may have taken its inspiration from the Victorian penny dreadful "The Mysteries of London".</s>London Has Fallen. London Has Fallen is a 2016 American action thriller film directed by Babak Najafi and written by Creighton Rothenberger, Katrin Benedikt, Chad St. John and Christian Gudegast.  It is a sequel to Antoine Fuqua\'s 2013 film "Olympus Has Fallen" and stars Gerard Butler, Aaron Eckhart and Morgan Freeman, with Alon Moni Aboutboul, Angela Bassett, Robert Forster, Jackie Earle Haley, Melissa Leo, Radha Mitchell, Sean O\'Bryan, Waleed Zuaiter and Charlotte Riley in supporting roles.  It is the second installment in the "Has Fallen" film series.</s>Edward Snyder (cinematographer). Edward Snyder, also known as Edward J. Snyder (1895 – July 10, 1982) was an American cameraman, cinematographer (director of photography), and visual effects/special effects artist.  Born in New York City in 1895, Snyder would break into the film industry as the Director of Photography on the 1926 silent film, "The Fighting Marine", which featured the only screen performance by boxing heavyweight champion, Gene Tunney.  He would be one of the plethora of talented cameramen to work on the Howard Hughes\' 1930 aerial classic, "Hell\'s Angels", along with such other notable cameramen and future directors of photography, Paul Ivano, Henry Cronjager and Ernest Laszlo.  But it was as special effects artist that he would have his greatest success, working on such classic films as Otto Preminger\'s "Laura"; George Cukor\'s "Winged Victory"; "The Keys of the Kingdom", starring Gregory Peck; Elia Kazan\'s A Tree Grows in Brooklyn; Anna and the King of Siam, starring Irene Dunne and Rex Harrison; and 1948\'s Deep Waters, for which he was nominated for an Academy Award (losing to the special effects team of Portrait of Jennie).  Snyder died in 1982.</s>Will Ferrell. John William Ferrell ( ; born July 16, 1967) is an American actor, comedian, producer, and writer.  He first established himself in the mid-1990s as a cast member on the NBC sketch comedy show "Saturday Night Live", and has subsequently starred in comedy films such as "" (2004), "" (2006), "Step Brothers" (2008), "The Other Guys" (2010) and "" (2013), all but one of which he co-wrote with his comedy partner Adam McKay.  The two also founded the comedy website Funny or Die in 2007.  Other films roles include "Elf", "Old School" (both 2003), "Blades of Glory" (2007), and the animated films "Megamind" (2010) and "The Lego Movie" (2014).</s>John Hurt. Sir John Vincent Hurt, {\'1\': ", \'2\': ", \'3\': ", \'4\': "} (22 January 1940 – 25 January 2017) was an English actor whose screen and stage career spanned more than 50 years.  Hurt was regarded as one of Britain\'s finest actors; director David Lynch described him as "simply the greatest actor in the world".</s>George Raft. George Raft (born George Ranft; September 26, 1901 – November 24, 1980) was an American film actor and dancer identified with portrayals of gangsters in crime melodramas of the 1930s and 1940s.  A stylish leading man in dozens of movies, today Raft is mostly known for his gangster roles in the original "Scarface" (1932), "Each Dawn I Die" (1939), and Billy Wilder\'s 1959 comedy "Some Like it Hot", as a dancer in "Bolero" (1934), and a truck driver in "They Drive by Night" (1940).</s>Sherlock Holmes (2010 film). Sir Arthur Conan Doyle\'s Sherlock Holmes, also known simply as Sherlock Holmes, is a British-American 2010 steampunk mystery film directed by Rachel Lee Goldenberg and produced by independent American film studio The Asylum.  It features the Sherlock Holmes characters created by Sir Arthur Conan Doyle, though it follows an original plot.  The film details an unrecorded case in which eccentric detective Holmes and his companion Dr. Watson investigate a series of unusual monster attacks and a plot to destroy London.  Gareth David-Lloyd plays Dr. John Watson and Ben Syder, making his film debut, plays Sherlock Holmes.',
+        'Kenny McCormick. Kenneth "Kenny" McCormick is a main character in the animated adult television series "South Park", along with his friends Stan Marsh, Kyle Broflovski, and Eric Cartman.  His oft-muffled and indiscernible speech—the result of his parka hood covering his mouth—is provided by co-creator Matt Stone.  He debuted on television when "South Park" first aired on August 13, 1997, after having first appeared in "The Spirit of Christmas" shorts created by Stone and long-time collaborator Trey Parker in 1992 ("Jesus vs. Frosty") and 1995 ("Jesus vs. Santa").</s>Happy Working Song. "Happy Working Song" is a song written by composer Alan Menken and lyricist Stephen Schwartz for Walt Disney Pictures\' musical film "Enchanted" (2007).  Recorded by American actress Amy Adams in her starring role as Giselle, the uptempo pop song both parodies and pays homage to a variety of songs from several Disney animated feature films, particularly "Whistle While You Work" from "Snow White and the Seven Dwarfs" (1937).  Produced by Menken, Schwartz and Danny Troob, the song appears on the film\'s soundtrack "Enchanted: Original Soundtrack."</s>Newsies (musical). Newsies The Musical is a Disney Theatrical Productions stage musical based on the 1992 musical film "Newsies", which in turn was inspired by the real-life Newsboys Strike of 1899 in New York City.  The show has music by Alan Menken, lyrics by Jack Feldman, and a book by Harvey Fierstein.  The musical premiered at the Paper Mill Playhouse in 2011 and made its Broadway debut in 2012.</s>The Little Mermaid: Ariel\'s Beginning. The Little Mermaid: Ariel\'s Beginning (also known as The Little Mermaid III) is a 2008 animated fantasy feature film produced by Walt Disney Pictures and DisneyToon Studios, and the direct-to-video prequel to Disney\'s 1989 film "The Little Mermaid".  Directed by Peggy Holmes, the film\'s story is set before the events of the 1989 film and the , where all music has been banned from the underwater kingdom of Atlantica by King Triton, and his youngest daughter Ariel attempts to challenge this law.  The film features the voices of Jodi Benson, Samuel E. Wright, Sally Field, and Jim Cummings.  Walt Disney Studios Home Entertainment released the film on August 26, 2008.  The animated by Toon City Animation, Inc., to Walt Disney Animation Australia by 2008, unit director Pieter Lommerse, workbook supervisor Stephen Lumley, clean-up director David Hardy, inbetween director Miles Jenkinson, effects director Marvin Petilla, supervising color stylist Jenny North and Aaron Stannard.  The film contradicts certain events of the television series, implying that it is an independent installment of Disney\'s "The Little Mermaid" franchise.</s>Disney\'s Aladdin: A Musical Spectacular. Disney\'s Aladdin: A Musical Spectacular was a Broadway-style show based on Disney\'s 1992 animated film "Aladdin" with music by Alan Menken and lyrics by Howard Ashman, Tim Rice and Alan Menken.</s>Lilo &amp; Stitch. Lilo & Stitch is a 2002 American animated science fiction comedy-drama film produced by Walt Disney Feature Animation and released by Walt Disney Pictures.  The 42nd Disney animated feature film, "Lilo & Stitch" was written and directed by Dean DeBlois and Chris Sanders, the latter also starring as Stitch, and features the voices of Daveigh Chase, Tia Carrere, David Ogden Stiers, Kevin McDonald, Ving Rhames, Jason Scott Lee, and Kevin Michael Richardson.  It was the second of three Disney animated features produced primarily at the Florida animation studio located at Disney\'s Hollywood Studios (then known as Disney-MGM Studios during production) in Walt Disney World near Orlando, Florida.</s>List of Jessica Jones characters. "Jessica Jones" is an American web television series created for Netflix by Melissa Rosenberg, based on the Marvel Comics character of the same name.  It is set in the Marvel Cinematic Universe (MCU), sharing continuity with the films of the franchise, and is the second in a series of shows that will lead up to a Defenders crossover miniseries.  The series stars Krysten Ritter as Jessica Jones, with Rachael Taylor, Eka Darville, and Carrie-Anne Moss also starring.  They were joined by Mike Colter, Wil Traval, Erin Moriarty, and David Tennant for the first season, and Leah Gibson and J.R. Ramirez for the second season.  In addition to original characters, several characters from other Marvel Cinematic Universe television series and/or based on various Marvel properties also appear throughout the series.',
+        'Shehnai (1947 film). Shehnai is a 1947 Indian Bollywood film directed by P.L. Santoshi, starring Kishore Kumar, Indumati, Radhakrishan, V.H. Desai and Rehana.  It was the fifth highest grossing Indian film of 1947.  Santoshi went on make the classic, "Barsaat Ki Raat" (1960) starring Madhubala and Bharat Bhushan.</s>Doctor Morelle. Doctor Morelle is a 1949 British mystery film directed by Godfrey Grayson and starring Valentine Dyall, Peter Drury and Hugh Griffith.  It is also known by two alternative titles: Dr. Morelle: The Case of the Missing Heiress or simply The Case of the Missing Heiress.  It was made by Hammer Films, based on the popular long running BBC radio series written by Ernest Dudley and starring Cecil Parker.  Dudley also wrote many novels and short stories featuring the character of Morelle.</s>The Nice Guys. The Nice Guys is a 2016 American neo-noir action comedy film directed by Shane Black and written by Black and Anthony Bagarozzi.  The film stars Russell Crowe, Ryan Gosling, Angourie Rice, Matt Bomer, Margaret Qualley, Keith David and Kim Basinger.  Set in Los Angeles, 1977, the film focuses on a private eye (Gosling) and a tough enforcer (Crowe) who team up to investigate the disappearance of a teenage girl.</s>A Double Life (1947 film). A Double Life is a 1947 film noir which tells the story of an actor whose mind becomes affected by the character he portrays.  The movie starred Ronald Colman and Signe Hasso.  It was directed by George Cukor and written for the screen by Ruth Gordon and Garson Kanin.  Ronald Colman won the Academy Award for Best Actor for his performance in this film.</s>Sam Neill. Nigel John Dermot Neill {\'1\': ", \'2\': ", \'3\': ", \'4\': "} (born 14 September 1947), known professionally as Sam Neill, is a New Zealand actor who first achieved leading roles in films such as "" and "Dead Calm" and on television in "Reilly, Ace of Spies".  He won a broad international audience in 1993 for his roles as Alisdair Stewart in "The Piano" and Dr. Alan Grant in "Jurassic Park", a role he reprised in 2001\'s "Jurassic Park III".  Neill also had notable roles in "Merlin", "The Hunt for Red October", "Peaky Blinders", and "The Tudors".  In 2016, he starred in "Hunt for the Wilderpeople" alongside Julian Dennison, to great acclaim.</s>Oscar and Lucinda (film). Oscar and Lucinda is a 1997 British-Australian-American romantic drama film directed by Gillian Armstrong and starring Cate Blanchett, Ralph Fiennes, Ciarán Hinds and Tom Wilkinson.  It is based on the 1988 Booker Prize-winning novel "Oscar and Lucinda" by Peter Carey.  In March 1998, the film was nominated at the Academy Awards for the Best Costume Design.</s>Till the End of Time (film). Till the End of Time is a 1946 drama film directed by Edward Dmytryk and starring Dorothy McGuire, Guy Madison, Robert Mitchum, and Bill Williams.  Released the same year as but preceding the better known "The Best Years of Our Lives", it covers much the same topic: the adjustment of World War II veterans to civilian life.  It was based on the novel "They Dream of Home" by Niven Busch.  Unlike the soldier, sailor and airman of "The Best Years of Our Lives", the male leads in this film are all U.S. Marines.',
+        'Téa Leoni. Elizabeth Téa Pantaleoni ( ; born February 25, 1966), better known by her stage name Téa Leoni, is an American actress and producer.</s>Yumiko Nogawa. Yumiko Nogawa (野川由美子 , Nogawa Yumiko ) (born August 30, 1944) is a Japanese actress born in Kyoto, Japan.  She has starred in several movies, notably "Gate of Flesh" (1964), a Japanese erotic film, part of a trilogy of films she made with director Seijun Suzuki.  Including "Story of a Prostitute" (1965) and "Carmen from Kawachi" (1966), these films are known as Nogawa\'s "Flesh Trilogy".  Nogawa has appeared in numerous films in Japan, including director Nagisa Oshima\'s "The Pleasures of the Flesh" (1965) and "Zatoichi and the Fugitives" (1968), the eighteenth film in the "Zatoichi" series.  She has also appeared in television series on Nippon Television, TV Tokyo, Fuji TV, and NHK.</s>The Weight of Water (film). The Weight of Water is a 2000 French-American mystery thriller film based on Anita Shreve\'s 1997 novel of the same name.  Directed by Kathryn Bigelow, the film stars Elizabeth Hurley, Catherine McCormack, Sean Penn, and Sarah Polley.  The film was shot in Nova Scotia.  Although it premiered at the 2000 Toronto International Film Festival, it was not released in the United States until November 1, 2002.</s>Maggie Moore. Maggie Moore (10 April 1851 - March 15, 1926) was an American-Australian actress born as Margaret Virginia Sullivan.  She met and married producer J. C. Williamson in the U.S. and became popular as an actress in their production of "Struck Oil", which premiered in 1873 and was revived many times.  Soon after their marriage, they took the play on a tour of Australia.  It was such a success that they stayed there, where he founded the most successful theatrical company in Australia, and she became a leading actress.</s>Noriko Tatsumi. Noriko Tatsumi (辰巳典子 , Tatsumi Noriko , born October 12, 1947 in Osaka, Japan) is a Japanese actress known primarily for her appearances in "pink films" of the 1960s.  During the "First Wave" of "pink film", Tatsumi became known as the first "Queen" of Japanese softcore sex movies, a title which she held from 1967 through 1970.  She most often appeared in the films of the World Eiga and Nihon Cinema studios, and is best known for her work with director Kōji Seki, especially "Whore" (1967) and "Erotic Culture Shock" (1969).  She also appeared in director and Seijun Suzuki script-writer, Atsushi Yamatoya\'s influential 1967 cult film, "Inflatable Sex Doll of the Wastelands".</s>Britney Spears. Britney Jean Spears (born December 2, 1981) is an American singer, dancer, and actress.  Born in McComb, Mississippi, and raised in Kentwood, Louisiana, she performed acting roles in stage productions and television shows as a child before signing with Jive Records in 1997.  Spears\'s first and second studio albums, "...Baby One More Time" (1999) and "Oops! ... I Did It Again" (2000), became international successes, with the former becoming the best-selling album by a teenage solo artist.  Title tracks "...Baby One More Time" and "Oops! ... I Did It Again" broke international sales records.  In 2001, Spears released her self-titled third studio album, "Britney", and played the starring role in the film "Crossroads" (2002).  She assumed creative control of her fourth studio album, "In the Zone" (2003), which yielded the worldwide success of the single "Toxic".</s>Saif Ali Khan. Saif Ali Khan (] ; born Sajid Ali Khan on 16 August 1970) is an Indian film actor and producer.  The son of actress Sharmila Tagore and the late cricketer Mansoor Ali Khan Pataudi, Khan made his acting debut in Yash Chopra\'s unsuccessful drama "Parampara" (1993), but achieved success with his roles in the romantic drama "Yeh Dillagi" and the action film "Main Khiladi Tu Anari" (both 1994).  Khan\'s career prospect declined through much of the 1990s, and his biggest commercial success of the decade came with the ensemble drama "Hum Saath-Saath Hain" (1999).  He rose to prominence with roles in two ensemble comedy-dramas"Dil Chahta Hai" (2001) and "Kal Ho Naa Ho" (2003).',
+        'Evidently... John Cooper Clarke. Evidently... John Cooper Clarke is a 2012 television documentary about the life of the Salford performance poet John Cooper Clarke.  It was directed by John Ross and produced by Scotty Clark and was first aired on BBC Four in May 2012 as part of BBC Four and BBC 6 Music\'s "Punk Britannia" season.  It features testimonies from Alex Turner, Bill Bailey, Pete Shelley, Paul Farley, Steve Coogan, Mark Radcliffe, Craig Charles, Plan B, Kate Nash, Miranda Sawyer and Paul Morley; and poems by Clarke including "Things Are Gonna Get Worse", "Evidently Chickentown", "Twat" and "Beasley Street".</s>Junetta Jones. Junetta Jones (born March 12, 1936) was an American operatic soprano.  A Baltimore native, she was a graduate of [[Frederick Douglass Senior High School (Baltimore, Maryland)|Frederick Douglass Senior High School.  After spending a year at Morgan State College(now University), she was awarded a three-year scholarship to the [[Peabody Conservatory]] where she earned a diploma in 1961 and studied singing with [[Joseph Laderoute]].  She then pursued further studies at the [[New England Conservatory]] where she earned a [[Master of Music]] in 1963 and was a pupil of [[Gladys Miller]].  She studied at the [[Tanglewood Music Center]] in the summer of 1961.  In 1963 she won the [[Metropolitan Opera National Council Auditions]].  She made her debut at the [[Metropolitan Opera]] on [[Halloween]] of 1963 as the Celestial Voice in [[Giuseppe Verdi]]\'s "[[Don Carlos]]" with [[Richard Tucker]] in the title role.  She sang two seasons at the Met, with other roles including the 1st Genie in "[[The Magic Flute]]", the Page in "[[Rigoletto]]", and Barbarina in "[[The Marriage of Figaro]]".  From 1965-1969 she performed with major opera houses in Europe.  She worked for 20 years on the advisory committee for art and culture for the city of Baltimore.</s>Nico Tatarowicz. Nico Tatarowicz (born 23 April 1974) is a British actor and writer, known for The Armstrong and Miller Show (2007), Very Important People (2012), Crackanory (2013), Murder in Successville (2015-2017) .</s>The Crucible (1996 film). The Crucible is a 1996 American historical drama film written by Arthur Miller adapting his play of the same title, inspired by the Salem witchcraft trials.  It was directed by Nicholas Hytner and stars Daniel Day-Lewis as John Proctor, Winona Ryder as Abigail Williams, Paul Scofield as Judge Thomas Danforth, Bruce Davison as Reverend Parris, and Joan Allen as Elizabeth Proctor.  Much of the filming took place on Choate Island in Essex, Massachusetts.</s>Joseph Cotten. Joseph Cheshire Cotten, Jr. (May 15, 1905 – February 6, 1994) was an American film, stage, radio and television actor.  Cotten achieved prominence on Broadway, starring in the original stage productions of "The Philadelphia Story" and "Sabrina Fair".  He first gained worldwide fame in three Orson Welles films: "Citizen Kane" (1941), "The Magnificent Ambersons" (1942), and "Journey into Fear" (1943), for which Cotten was also credited with the screenplay.  He went on to become one of the leading Hollywood actors of the 1940s, appearing in films such as "Shadow of a Doubt" (1943), "Love Letters" (1945), "Duel in the Sun" (1946), "Portrait of Jennie" (1948), "The Third Man" (1949) and "Niagara" (1953).  One of his final films was Michael Cimino\'s "Heaven\'s Gate" (1980).</s>Complicit (play). Complicit is a play by American playwright Joe Sutton premièred at The Old Vic Theater in London on 7 January 2009.</s>Killer Joe (film). Killer Joe is a 2011 American Southern Gothic black comedy crime film directed by William Friedkin.  The screenplay by Tracy Letts is based on his 1993 play of the same name.  The film stars Matthew McConaughey in the title role, Emile Hirsch, Juno Temple, Gina Gershon, and Thomas Haden Church.  Friedkin and Letts had similarly collaborated on the 2006 film "Bug".',
     ]
 )
 # [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]
 | Metric       | validation | train_subset |
 |:-------------|:-----------|:-------------|
+| pearson      | 0.9351     | 0.8838       |
+| **spearman** | **0.927**  | **0.8779**   |
 <!--
 ## Bias, Risks and Limitations
 #### Unnamed Dataset
+* Size: 18,000 training samples
 * Columns: <code>sentence_0</code>, <code>sentence_1</code>, and <code>label</code>
 * Approximate statistics based on the first 1000 samples:
+  |         | sentence_0                                                                                       | sentence_1                                                                                           | label                                                          |
+  |:--------|:-------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------|:---------------------------------------------------------------|
+  | type    | string                                                                                           | string                                                                                               | float                                                          |
+  | details | <ul><li>min: 22 characters</li><li>mean: 104.17 characters</li><li>max: 498 characters</li></ul> | <ul><li>min: 1820 characters</li><li>mean: 4337.28 characters</li><li>max: 8472 characters</li></ul> | <ul><li>min: 0.0</li><li>mean: 0.52</li><li>max: 1.0</li></ul> |
 * Samples:
+  | sentence_0                                                                                           | sentence_1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               | label            |
+  |:-----------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
+  | <code>The 1958 film Hello London saw the film debut of an actor that died in what year?</code>       | <code>Mysteries of London. Mysteries of London is a 1915 British silent crime film directed by A. E. Coleby and starring Wingold Lawrence and Flora Morris.  The film may have taken its inspiration from the Victorian penny dreadful "The Mysteries of London".</s>London Has Fallen. London Has Fallen is a 2016 American action thriller film directed by Babak Najafi and written by Creighton Rothenberger, Katrin Benedikt, Chad St. John and Christian Gudegast.  It is a sequel to Antoine Fuqua's 2013 film "Olympus Has Fallen" and stars Gerard Butler, Aaron Eckhart and Morgan Freeman, with Alon Moni Aboutboul, Angela Bassett, Robert Forster, Jackie Earle Haley, Melissa Leo, Radha Mitchell, Sean O'Bryan, Waleed Zuaiter and Charlotte Riley in supporting roles.  It is the second installment in the "Has Fallen" film series.</s>Edward Snyder (cinematographer). Edward Snyder, also known as Edward J. Snyder (1895 – July 10, 1982) was an American cameraman, cinematographer (director of photography), and visua...</code> | <code>0.0</code> |
+  | <code>What show with music by Alan Menken and the role of Morris Delancey was made by Disney?</code> | <code>Kenny McCormick. Kenneth "Kenny" McCormick is a main character in the animated adult television series "South Park", along with his friends Stan Marsh, Kyle Broflovski, and Eric Cartman.  His oft-muffled and indiscernible speech—the result of his parka hood covering his mouth—is provided by co-creator Matt Stone.  He debuted on television when "South Park" first aired on August 13, 1997, after having first appeared in "The Spirit of Christmas" shorts created by Stone and long-time collaborator Trey Parker in 1992 ("Jesus vs. Frosty") and 1995 ("Jesus vs. Santa").</s>Happy Working Song. "Happy Working Song" is a song written by composer Alan Menken and lyricist Stephen Schwartz for Walt Disney Pictures' musical film "Enchanted" (2007).  Recorded by American actress Amy Adams in her starring role as Giselle, the uptempo pop song both parodies and pays homage to a variety of songs from several Disney animated feature films, particularly "Whistle While You Work" from "Snow White and the Se...</code> | <code>0.5</code> |
+  | <code>Who directed the film Leslie I. Carey worked on in 1947?</code>                                | <code>Shehnai (1947 film). Shehnai is a 1947 Indian Bollywood film directed by P.L. Santoshi, starring Kishore Kumar, Indumati, Radhakrishan, V.H. Desai and Rehana.  It was the fifth highest grossing Indian film of 1947.  Santoshi went on make the classic, "Barsaat Ki Raat" (1960) starring Madhubala and Bharat Bhushan.</s>Doctor Morelle. Doctor Morelle is a 1949 British mystery film directed by Godfrey Grayson and starring Valentine Dyall, Peter Drury and Hugh Griffith.  It is also known by two alternative titles: Dr. Morelle: The Case of the Missing Heiress or simply The Case of the Missing Heiress.  It was made by Hammer Films, based on the popular long running BBC radio series written by Ernest Dudley and starring Cecil Parker.  Dudley also wrote many novels and short stories featuring the character of Morelle.</s>The Nice Guys. The Nice Guys is a 2016 American neo-noir action comedy film directed by Shane Black and written by Black and Anthony Bagarozzi.  The film stars Russell Crowe, Ry...</code> | <code>0.5</code> |
 * Loss: [<code>BinaryCrossEntropyLoss</code>](https://sbert.net/docs/package_reference/cross_encoder/losses.html#binarycrossentropyloss) with these parameters:
   ```json
   {
 ### Training Logs
 | Epoch  | Step | Training Loss | validation_spearman | train_subset_spearman |
 |:------:|:----:|:-------------:|:-------------------:|:---------------------:|
+| 0.0556 | 250  | -             | 0.8629              | 0.7889                |
+| 0.1111 | 500  | 0.5203        | 0.8946              | 0.8145                |
+| 0.1667 | 750  | -             | 0.8969              | 0.8186                |
+| 0.2222 | 1000 | 0.4568        | 0.8986              | 0.8270                |
+| 0.2778 | 1250 | -             | 0.9081              | 0.8322                |
+| 0.3333 | 1500 | 0.4572        | 0.9058              | 0.8353                |
+| 0.3889 | 1750 | -             | 0.9100              | 0.8435                |
+| 0.4444 | 2000 | 0.4448        | 0.9131              | 0.8448                |
+| 0.5    | 2250 | -             | 0.9126              | 0.8495                |
+| 0.5556 | 2500 | 0.4471        | 0.9132              | 0.8545                |
+| 0.6111 | 2750 | -             | 0.9144              | 0.8571                |
+| 0.6667 | 3000 | 0.4218        | 0.9179              | 0.8599                |
+| 0.7222 | 3250 | -             | 0.9178              | 0.8599                |
+| 0.7778 | 3500 | 0.4315        | 0.9197              | 0.8625                |
+| 0.8333 | 3750 | -             | 0.9205              | 0.8641                |
+| 0.8889 | 4000 | 0.4086        | 0.9184              | 0.8676                |
+| 0.9444 | 4250 | -             | 0.9207              | 0.8695                |
+| 1.0    | 4500 | 0.4332        | 0.9213              | 0.8684                |
+| 1.0556 | 4750 | -             | 0.9215              | 0.8715                |
+| 1.1111 | 5000 | 0.4271        | 0.9221              | 0.8722                |
+| 1.1667 | 5250 | -             | 0.9235              | 0.8717                |
+| 1.2222 | 5500 | 0.4171        | 0.9219              | 0.8716                |
+| 1.2778 | 5750 | -             | 0.9236              | 0.8733                |
+| 1.3333 | 6000 | 0.4073        | 0.9220              | 0.8751                |
+| 1.3889 | 6250 | -             | 0.9215              | 0.8749                |
+| 1.4444 | 6500 | 0.4129        | 0.9244              | 0.8753                |
+| 1.5    | 6750 | -             | 0.9236              | 0.8776                |
+| 1.5556 | 7000 | 0.4291        | 0.9242              | 0.8772                |
+| 1.6111 | 7250 | -             | 0.9255              | 0.8776                |
+| 1.6667 | 7500 | 0.4149        | 0.9270              | 0.8779                |
 ### Framework Versions

config.json CHANGED Viewed

@@ -30,7 +30,7 @@
     "activation_fn": "torch.nn.modules.activation.Sigmoid",
     "version": "5.2.2"
   },
-  "torch_dtype": "float32",
   "transformers_version": "4.44.2",
   "type_vocab_size": 1,
   "use_cache": true,

     "activation_fn": "torch.nn.modules.activation.Sigmoid",
     "version": "5.2.2"
   },
+  "torch_dtype": "bfloat16",
   "transformers_version": "4.44.2",
   "type_vocab_size": 1,
   "use_cache": true,

eval/CrossEncoderCorrelationEvaluator_validation_results.csv ADDED Viewed

	@@ -0,0 +1,2 @@


1	+ epoch,steps,Pearson_Correlation,Spearman_Correlation
2	+ 1.0,4500,0.9349670680974811,0.921315642128342

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4b26ed99ee4ca0a2544360bfb3db3d4729003bb0fcc1c6a44ac8376577ea4159
-size 2271071852

 version https://git-lfs.github.com/spec/v1
+oid sha256:6ba7823d7e88fe812e230506d04110082737d7308c5918c9936b05161a5ecd51
+size 1135560090