diff --git "a/README.md" "b/README.md" --- "a/README.md" +++ "b/README.md" @@ -1,160 +1,130 @@ --- +language: +- en tags: - sentence-transformers - sentence-similarity - feature-extraction - dense - generated_from_trainer -- dataset_size:296658 +- dataset_size:3876398 - loss:CachedMultipleNegativesRankingLoss +- loss:CoSENTLoss base_model: jhu-clsp/ettin-encoder-17m widget: -- source_sentence: billy joel just the way you are meaning +- source_sentence: what important natural resources in west africa did the songhai + empire control sentences: - - Isle of Man TT The International Isle of Man TT (Tourist Trophy) Race is an annual - motorcycle sport event run on the Isle of Man in May or June of most years since - its inaugural race in 1907.[3] - - You Make It Feel Like Christmas (song) "You Make It Feel Like Christmas" is a - song recorded by American singer Gwen Stefani for her 2017 holiday album of the - same name. It features guest vocals from Blake Shelton and was released on September - 22, 2017 as the album's lead single through Interscope. The track was written - by Stefani, Justin Tranter, Shelton and Michael Busbee, while production was handled - by Busbee and Eric Valentine. It has been used in Starbucks' "Togetherness" commercial - to promote its Christmas campaign. - - Just the Way You Are (Billy Joel song) Joel shared that the melody and chord progression - for this song came to him while he was dreaming.[3] In an interview on the Howard - Stern Radio Show on November 16, 2010, Joel revealed that the inspiration for - writing the name of the song and how it sounds in the chorus was directly taken - from the last line in the Frankie Valli and the Four Seasons song "Rag Doll"; - which incidentally was also a larger inspiration for Joel's later song, "Uptown - Girl".[4] The song, which Joel had written for his first wife (and also his business - manager at the time) Elizabeth Weber, was not liked by either Joel or his band, - and Joel had originally decided against making the track a part of The Stranger, - but at the request of both Linda Ronstadt and Phoebe Snow (both were recording - in other studios in the same building at the time), he agreed to put the song - on the final mix.[5] However, the album's producer, Phil Ramone, later contradicted - Joel's claim, stating in an interview that they could not afford to exclude the - song because Joel did not have that much material to choose from for the album.[6] -- source_sentence: who is the coach of the houston cougars basketball + - Timur In 1398, Timur invaded northern India, attacking the Delhi Sultanate ruled + by Sultan Nasir-ud-Din Mahmud Shah Tughluq of the Tughlaq Dynasty. He was opposed + by Ahirs and faced some reversals from the Jats, but the Sultanate at Delhi did + nothing to stop him.[59][60] After crossing the Indus river on 30 September 1398, + he sacked Tulamba and massacred its inhabitants.[61] Then he advanced and captured + Multan by October.[62] + - Timur In 1398, Timur invaded northern India, attacking the Delhi Sultanate ruled + by Sultan Nasir-ud-Din Mahmud Shah Tughluq of the Tughlaq Dynasty. He was opposed + by Ahirs and faced some reversals from the Jats, but the Sultanate at Delhi did + nothing to stop him.[59][60] After crossing the Indus river on 30 September 1398, + he sacked Tulamba and massacred its inhabitants.[61] Then he advanced and captured + Multan by October.[62] + - Timur In 1398, Timur invaded northern India, attacking the Delhi Sultanate ruled + by Sultan Nasir-ud-Din Mahmud Shah Tughluq of the Tughlaq Dynasty. He was opposed + by Ahirs and faced some reversals from the Jats, but the Sultanate at Delhi did + nothing to stop him.[59][60] After crossing the Indus river on 30 September 1398, + he sacked Tulamba and massacred its inhabitants.[61] Then he advanced and captured + Multan by October.[62] + - Indus Valley Civilisation Suggested contributory causes for the localisation of + the IVC include changes in the course of the river,[148] and climate change that + is also signalled for the neighbouring areas of the Middle East.[149][150] As + of 2016[update] many scholars believe that drought and a decline in trade with + Egypt and Mesopotamia caused the collapse of the Indus Civilisation.[151] + - History of West Africa In 1591, Morocco invaded the Songhai Empire under Ahmad + al-Mansur of the Saadi Dynasty to secure the goldfields of the Sahel. At the Battle + of Tondibi, the Songhai army was defeated. The Moroccans captured Djenne, Gao, + and Timbuktu, but they were unable to secure the whole region. Askiya Nuhu and + the Songhay army regrouped at Dendi in the heart of Songhai territory where a + spirited guerrilla resistance sapped the resources of the Moroccans, who were + dependent upon constant resupply from Morocco. Songhai split into several states + during the 17th century. + - Ancient Egypt The pharaoh was the absolute monarch of the country and, at least + in theory, wielded complete control of the land and its resources. The king was + the supreme military commander and head of the government, who relied on a bureaucracy + of officials to manage his affairs. In charge of the administration was his second + in command, the vizier, who acted as the king's representative and coordinated + land surveys, the treasury, building projects, the legal system, and the archives.[88] + At a regional level, the country was divided into as many as 42 administrative + regions called nomes each governed by a nomarch, who was accountable to the vizier + for his jurisdiction. The temples formed the backbone of the economy. Not only + were they houses of worship, but were also responsible for collecting and storing + the nation's wealth in a system of granaries and treasuries administered by overseers, + who redistributed grain and goods.[89] +- source_sentence: A group of friends and I went to a corn maize. It was a dark night + and the corn maize was said to be haunted. A scary man jumped out and scared us. + We ended up lost in the maize for two hours. We made it out and were glad we experienced + the maze together. sentences: - - World population In demographics, the world population is the total number of - humans currently living, and was estimated to have reached 7.6 billion as of December - 2017.[1] Estimates of the total number of humans who have ever lived range from - 106 to 108 billion as of 2007.[2][3][4] Though the population is currently growing - quite rapidly, future changes are influenced by difficult-to-predict factors such - as economic development, cultural changes, migration, and natural disasters. Various - mathematical models show that by 2100 the global population could be either rising - or falling depending on how these factors affect birth and death rates. - - Mantle (geology) The top of the mantle is defined by a sudden increase in seismic - velocity, which was first noted by Andrija Mohorovičić in 1909; this boundary - is now referred to as the Mohorovičić discontinuity or "Moho".[24][27] The uppermost - mantle plus overlying crust are relatively rigid and form the lithosphere, an - irregular layer with a maximum thickness of perhaps 200 km (120 mi). Below the - lithosphere the upper mantle becomes notably more plastic. In some regions below - the lithosphere, the seismic shear velocity is reduced; this so-called low-velocity - zone (LVZ) extends down to a depth of several hundred km. Inge Lehmann discovered - a seismic discontinuity at about 220 km (140 mi) depth;[28] although this discontinuity - has been found in other studies, it is not known whether the discontinuity is - ubiquitous. The transition zone is an area of great complexity; it physically - separates the upper and lower mantle.[26] Very little is known about the lower - mantle apart from that it appears to be relatively seismically homogeneous. The - D" layer at the core–mantle boundary separates the mantle from the core.[15][24] - In 2015, research using gravitational data from GRACE satellites and the long - wavelength nonhydrostatic geoid indicated viscosity[29] increases by a factor - of ten to 150 about 1,000 kilometres (620 mi) below earth's surface; separate - research also indicates sinking tectonic plates stall at this depth, leading Robert - van der Hilst to speculate "In term's of structure and dynamics, 1,000 kilometers - could be more important" (than the currently accepted 660 km depth upper—lower - division).[30] The lower mantle also contains some discontinueous zones, called - "thermochemical piles" which have been interpreted as either thermally differentiated, - upwellings bringing warmer material towards the surface, or as chemically differentiated - material.[31] A principal source of the heat that drives plate tectonics is the - radioactive decay of uranium, thorium, and potassium in Earth’s crust and mantle.[32] - - Kelvin Sampson Kelvin Dale Sampson (born October 5, 1955) is an American basketball - coach who is currently the head coach of the Houston Cougars men's basketball - team. He was the head coach at Montana Tech from 1981 to 1985, Washington State - University from 1987 to 1994, the University of Oklahoma from 1994 to 2006, and - Indiana University 2006 to 2008. He has also been an assistant coach for NBA teams - including the Milwaukee Bucks and Houston Rockets. -- source_sentence: where was the final scene of grease filmed + - 'hypothesis: The median income for a household in the city was $26,969, and the + median income for a family was $31,997.' + - 'hypothesis: There is one objects is Daniel carrying.' + - 'hypothesis: We calmed down in order to solve the maize ends after we made it + out' +- source_sentence: J. David Spurlock was born on November 18 , 1959 in Dallas , Texas + . He moved to Memphis , Tennessee in 1973 . sentences: - - Kentucky Derby Trophy The Kroger Company has been the official florist of the - Kentucky Derby since 1987. After taking over the duties from the Kingsley Walker - florist, Kroger began constructing the prestigious garland in one of its local - stores for the public to view on Derby Eve. The preservation of the garland and - crowds of spectators watching its construction are a testament to the prestige - and mystique of the Garland of Roses. - - Energy in Australia Historically–and until recent times–energy in Australia was - sourced largely from coal and natural gas,[1] however due to the increasing effects - of global warming and human-induced climate change on the global environment, - there has been a greater shift towards renewable energy such as solar power and - wind power both in Australia and abroad.[2][3] This in turn has led to a decrease - in the demand of coal worldwide.[4] - - Grease (film) The opening beach scene was shot at Malibu's Leo Carrillo State - Beach, making explicit reference to From Here to Eternity. The exterior Rydell - scenes, including the basketball, baseball and track segments, were shot at Venice - High School in Venice, California, while the Rydell interiors, including the high - school dance, were filmed at Huntington Park High School. The sleepover was shot - at a private house in East Hollywood. The Paramount Pictures studio lot was the - location of the scenes that involve Frosty Palace and the musical numbers "Greased - Lightning" and "Beauty School Dropout". The drive-in movie scenes were shot at - the Burbank Pickwick Drive-In (it was closed and torn down in 1989 and a shopping - center took its place). The race was filmed at the Los Angeles River, between - the First and Seventh Street Bridges, where many other films have been shot.[10] - The final scene where the carnival took place used John Marshall High School.[11] - And due to budget cuts a short scene was filmed at Hazard Park in Los Angeles. -- source_sentence: where is survivor heros vs hustlers vs healers filmed + - David Spurlock was born on 18 November 1959 in Dallas , Texas , and moved to Memphis + , Tennessee in 1973 . + - This is a list of the etymology of street names in the district Covent Garden + in London . + - During the five days of the journey , he brought some books about Elba which he + studied from Fontainebleau . +- source_sentence: The musical films '' Mark Twain `` and '' Huckleberry Finn `` , + both based on Tom Sawyer 's novels , were partially shot on site . sentences: - - 'Survivor: Heroes vs. Healers vs. Hustlers Survivor: Heroes vs. Healers vs. Hustlers - is the 35th season of the American CBS competitive reality television series Survivor. - This season features 18 new players divided into three tribes based on dominant - perceived trait: "Heroes" (courage), "Healers" (compassion), and "Hustlers" (tenacity).[1] - This is the fourth season of the show filmed in Fiji, following Survivor: Fiji, - Survivor: Millennials vs. Gen X, and Survivor: Game Changers.' - - Governor (India) The governors and lieutenant-governors are appointed by the president - for a term of five years. - - Competition (economics) The competitive process in a market economy exerts a sort - of pressure that tends to move resources to where they are most needed, and to - where they can be used most efficiently for the economy as a whole. For the competitive - process to work however, it is "important that prices accurately signal costs - and benefits." Where externalities occur, or monopolistic or oligopolistic conditions - persist, or for the provision of certain goods such as public goods, the pressure - of the competitive process is reduced.[2] -- source_sentence: first new zealander to run a mile in under four minutes + - The musical films `` Mark Twain '' and `` Huckleberry Finn '' , both based on + Tom Sawyer 's novels , were shot partially on location here . + - His father called him Ali and his nickname was Murtaza . + - A KWL chart can be used for all subjects in a whole group or a small group atmosphere + . +- source_sentence: what blood type can donate blood to all other blood types. sentences: - - House of Saud The most influential member of the Royal family is the King of Saudi - Arabia, currently King Salman. The succession to the Saudi Arabian throne was - designed to pass from one son of the first king, Ibn Saud, to another. The next - in line, Crown Prince Mohammad bin Salman, is the son of King Salman, and thus - from the ruling House of Saud.[2][3][4] The king-appointed cabinet includes more - members of the royal family. The monarchy was hereditary by agnatic seniority - until 2006, when a royal decree provided that future Saudi kings are to be elected - by a committee of Saudi princes.[5] Although current King Salman first choose - his nephew and then his son as a crown prince without any consulation with Allegiance - Council. - - The Crown (TV series) The first season was released on Netflix on November 4, - 2016, while the second was released on December 8, 2017. The Crown has received - widespread acclaim, with critics praising the cast's performances, direction, - writing, cinematography, production values, and the relatively accurate historical - accounts of Queen Elizabeth's reign. Significant praise in the first season was - directed towards the performances of Foy in the leading role and John Lithgow - as Winston Churchill. The series has received several industry nominations and - awards, including winning Best Actress and Best Actor at the 23rd Screen Actors - Guild Awards for Foy and Lithgow, respectively, and receiving thirteen nominations - for the 69th Primetime Emmy Awards, including Outstanding Drama Series. - - Four-minute mile New Zealand's John Walker, the first man to run the mile under - 3:50, managed to run 135 sub-four-minute miles during his career (during which - he was the first person to run over 100 sub-four-minute miles), and American Steve - Scott has run the most sub-four-minute miles, with 136. Algeria's Noureddine Morceli - was the first under 3:45. Currently, the mile record is held by Morocco's Hicham - El Guerrouj, who ran a time of 3:43.13 in Rome in 1999. + - A number of Blood donors also donate platelets by apheresis (a procedure in which + Blood is drawn from a Blood donor and separated into its components, some of which + are retained, such as plasma or platelets, and the remainder of the Blood is returned, + by transfusion, to the Blood donor; also called hemapheresis). + - "Uluru is easily the most iconic natural landform in Australia, and its formation\ + \ was equally special.The creation of Uluru and Kata Tjuta â\x80\x94 as both were\ + \ formed at the same time â\x80\x94 began over 500 million years ago. At this\ + \ time the big crustal blocks that form the Australian continent coming together.luru\ + \ is easily the most iconic natural landform in Australia, and its formation was\ + \ equally special." + - "AB can only donate blood to other ABs. A can donate blood to As and ABs. B can\ + \ donate blood to Bs and ABs. O can donate to all blood types. Negative Rh factors\ + \ can donate toâ\x80¦ both positive and negative Rh factors, however postive Rh\ + \ factors can only donate to other positive. So if I had O+ blood, I couldn't\ + \ donate to A-, but could donate to A+." +datasets: +- tasksource/merged-2l-nli +- tasksource/merged-3l-nli +- tasksource/zero-shot-label-nli +- MoritzLaurer/dataset_train_nli +- google-research-datasets/paws +- nyu-mll/glue +- mwong/fever-evidence-related +- tasksource/sts-companion +- tomaarsen/natural-questions-hard-negatives +- tomaarsen/gooaq-hard-negatives +- bclavie/msmarco-500k-triplets +- sentence-transformers/all-nli +- sentence-transformers/msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1 +- sentence-transformers/gooaq +- sentence-transformers/natural-questions pipeline_tag: sentence-similarity library_name: sentence-transformers --- # SentenceTransformer based on jhu-clsp/ettin-encoder-17m -This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [jhu-clsp/ettin-encoder-17m](https://huggingface.co/jhu-clsp/ettin-encoder-17m) on the contrastive dataset. It maps sentences & paragraphs to a 256-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more. +This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [jhu-clsp/ettin-encoder-17m](https://huggingface.co/jhu-clsp/ettin-encoder-17m) on 18 datasets. It maps sentences & paragraphs to a 256-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more. ## Model Details @@ -164,9 +134,26 @@ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [j - **Maximum Sequence Length:** 128 tokens - **Output Dimensionality:** 256 dimensions - **Similarity Function:** Cosine Similarity -- **Training Dataset:** - - contrastive - +- **Training Datasets:** + - [merged-2l-nli](https://huggingface.co/datasets/tasksource/merged-2l-nli) + - [merged-3l-nli](https://huggingface.co/datasets/tasksource/merged-3l-nli) + - [zero-shot-label-nli](https://huggingface.co/datasets/tasksource/zero-shot-label-nli) + - [dataset_train_nli](https://huggingface.co/datasets/MoritzLaurer/dataset_train_nli) + - [paws/labeled_final](https://huggingface.co/datasets/paws) + - [glue/mrpc](https://huggingface.co/datasets/glue) + - [glue/qqp](https://huggingface.co/datasets/glue) + - [fever-evidence-related](https://huggingface.co/datasets/mwong/fever-evidence-related) + - [glue/stsb](https://huggingface.co/datasets/glue) + - sick/relatedness + - [sts-companion](https://huggingface.co/datasets/tasksource/sts-companion) + - [tomaarsen/natural-questions-hard-negatives](https://huggingface.co/datasets/tomaarsen/natural-questions-hard-negatives) + - [tomaarsen/gooaq-hard-negatives](https://huggingface.co/datasets/tomaarsen/gooaq-hard-negatives) + - [bclavie/msmarco-500k-triplets](https://huggingface.co/datasets/bclavie/msmarco-500k-triplets) + - [sentence-transformers/all-nli](https://huggingface.co/datasets/sentence-transformers/all-nli) + - [sentence-transformers/msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1](https://huggingface.co/datasets/sentence-transformers/msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1) + - [sentence-transformers/gooaq](https://huggingface.co/datasets/sentence-transformers/gooaq) + - [sentence-transformers/natural-questions](https://huggingface.co/datasets/sentence-transformers/natural-questions) +- **Language:** en ### Model Sources @@ -201,21 +188,23 @@ from sentence_transformers import SentenceTransformer # Download from the 🤗 Hub model = SentenceTransformer("tasksource/ettin-17m-embed") # Run inference -sentences = [ - 'first new zealander to run a mile in under four minutes', - "Four-minute mile New Zealand's John Walker, the first man to run the mile under 3:50, managed to run 135 sub-four-minute miles during his career (during which he was the first person to run over 100 sub-four-minute miles), and American Steve Scott has run the most sub-four-minute miles, with 136. Algeria's Noureddine Morceli was the first under 3:45. Currently, the mile record is held by Morocco's Hicham El Guerrouj, who ran a time of 3:43.13 in Rome in 1999.", - "The Crown (TV series) The first season was released on Netflix on November 4, 2016, while the second was released on December 8, 2017. The Crown has received widespread acclaim, with critics praising the cast's performances, direction, writing, cinematography, production values, and the relatively accurate historical accounts of Queen Elizabeth's reign. Significant praise in the first season was directed towards the performances of Foy in the leading role and John Lithgow as Winston Churchill. The series has received several industry nominations and awards, including winning Best Actress and Best Actor at the 23rd Screen Actors Guild Awards for Foy and Lithgow, respectively, and receiving thirteen nominations for the 69th Primetime Emmy Awards, including Outstanding Drama Series.", +queries = [ + "what blood type can donate blood to all other blood types.", ] -embeddings = model.encode(sentences) -print(embeddings.shape) -# [3, 256] +documents = [ + "AB can only donate blood to other ABs. A can donate blood to As and ABs. B can donate blood to Bs and ABs. O can donate to all blood types. Negative Rh factors can donate toâ\x80¦ both positive and negative Rh factors, however postive Rh factors can only donate to other positive. So if I had O+ blood, I couldn't donate to A-, but could donate to A+.", + 'A number of Blood donors also donate platelets by apheresis (a procedure in which Blood is drawn from a Blood donor and separated into its components, some of which are retained, such as plasma or platelets, and the remainder of the Blood is returned, by transfusion, to the Blood donor; also called hemapheresis).', + 'Uluru is easily the most iconic natural landform in Australia, and its formation was equally special.The creation of Uluru and Kata Tjuta â\x80\x94 as both were formed at the same time â\x80\x94 began over 500 million years ago. At this time the big crustal blocks that form the Australian continent coming together.luru is easily the most iconic natural landform in Australia, and its formation was equally special.', +] +query_embeddings = model.encode_query(queries) +document_embeddings = model.encode_document(documents) +print(query_embeddings.shape, document_embeddings.shape) +# [1, 256] [3, 256] # Get the similarity scores for the embeddings -similarities = model.similarity(embeddings, embeddings) +similarities = model.similarity(query_embeddings, document_embeddings) print(similarities) -# tensor([[1.0000, 0.8112, 0.0234], -# [0.8112, 1.0000, 0.1274], -# [0.0234, 0.1274, 1.0000]]) +# tensor([[ 0.6162, 0.7105, -0.1445]]) ```