Spaces:
Runtime error
Runtime error
| from sentence_transformers import CrossEncoder | |
| # 1. Load a pre-trained CrossEncoder model | |
| model = CrossEncoder("cross-encoder/ms-marco-MiniLM-L6-v2") | |
| query = "How many people live in Berlin?" | |
| passages = [ | |
| "Berlin had a population of 3,520,031 registered inhabitants in an area of 891.82 square kilometers.", | |
| "Berlin is well known for its museums.", | |
| "In 2014, the city state Berlin had 37,368 live births (+6.6%), a record number since 1991.", | |
| "The urban area of Berlin comprised about 4.1 million people in 2014, making it the seventh most populous urban area in the European Union.", | |
| "The city of Paris had a population of 2,165,423 people within its administrative city limits as of January 1, 2019", | |
| "An estimated 300,000-420,000 Muslims reside in Berlin, making up about 8-11 percent of the population.", | |
| "Berlin is subdivided into 12 boroughs or districts (Bezirke).", | |
| "In 2015, the total labour force in Berlin was 1.85 million.", | |
| "In 2013 around 600,000 Berliners were registered in one of the more than 2,300 sport and fitness clubs.", | |
| "Berlin has a yearly total of about 135 million day visitors, which puts it in third place among the most-visited city destinations in the European Union.", | |
| ] | |
| # 2a. Either: predict scores for all pairs of sentences involved in the query | |
| scores = model.predict([(query, passage) for passage in passages]) | |
| # => [ 8.607138 -4.320077 7.5978117 8.915804 -4.237982 8.2359 0.33119553 3.4510403 6.352979 5.416662 ] | |
| # 2b. Or rank a list of passages for a query | |
| ranks = model.rank(query, passages, return_documents=True) | |
| # Print the reranked passages | |
| print("Query:", query) | |
| for rank in ranks: | |
| print(f"- #{rank['corpus_id']} ({rank['score']:.2f}): {rank['text']}") | |
| """ | |
| Query: How many people live in Berlin? | |
| - #3 (8.92): The urban area of Berlin comprised about 4.1 million people in 2014, making it the seventh most populous urban area in the European Union. | |
| - #0 (8.61): Berlin had a population of 3,520,031 registered inhabitants in an area of 891.82 square kilometers. | |
| - #5 (8.24): An estimated 300,000-420,000 Muslims reside in Berlin, making up about 8-11 percent of the population. | |
| - #2 (7.60): In 2014, the city state Berlin had 37,368 live births (+6.6%), a record number since 1991. | |
| - #8 (6.35): In 2013 around 600,000 Berliners were registered in one of the more than 2,300 sport and fitness clubs. | |
| - #9 (5.42): Berlin has a yearly total of about 135 million day visitors, which puts it in third place among the most-visited city destinations in the European Union. | |
| - #7 (3.45): In 2015, the total labour force in Berlin was 1.85 million. | |
| - #6 (0.33): Berlin is subdivided into 12 boroughs or districts (Bezirke). | |
| - #4 (-4.24): The city of Paris had a population of 2,165,423 people within its administrative city limits as of January 1, 2019 | |
| - #1 (-4.32): Berlin is well known for its museums. | |
| """ | |