SentenceTransformer based on intfloat/multilingual-e5-small

This is a sentence-transformers model finetuned from intfloat/multilingual-e5-small on the title_excerpt, ne_en, excerpt_paraphrase, nepali_triplets, stsb_en, stsb_ne, nepali_qa_9k, ecommerce, cross_lingual and sanoir_general datasets. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for retrieval.

Model Details

Model Description

Model Type: Sentence Transformer
Base model: intfloat/multilingual-e5-small
Maximum Sequence Length: 512 tokens
Output Dimensionality: 384 dimensions
Similarity Function: Cosine Similarity
Supported Modality: Text
Training Datasets:
Languages: ne, en

Model Sources

Documentation: Sentence Transformers Documentation
Repository: Sentence Transformers on GitHub
Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'BertModel'})
  (1): Pooling({'embedding_dimension': 384, 'pooling_mode': 'mean', 'include_prompt': True})
  (2): Normalize({})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("jangedoo/sanolm-v1")
# Run inference
queries = [
    'yo dictionary ko quality kasto cha ra reviews hernu hai',
]
documents = [
    'The Oxford English-Hindi Dictionary (Pocket Edition) has 1,200 pages with over 40,000 entries, priced at NPR 890. It features phonetic transcriptions and clear usage examples, making it ideal for Nepali students learning English. Users on SastoDeal have rated it 4.5 stars, praising its compact size and accurate translations for exam preparation.',
    'The Nepali Best Friend Notebook (A5, 200 pages) is made of recycled paper with a hardcover binding, costing NPR 350. It comes in six vibrant colors and is suitable for school notes or journaling. Many customers appreciate its smooth pages that prevent ink bleed-through.',
    'This Faber-Castell Watercolor Paint Set (12 colors) includes a brush and mixing palette, retailing at NPR 1,200. It is non-toxic and suitable for children aged 6 and above. Artists recommend it for its vibrant pigmentation and easy blending.',
]
query_embeddings = model.encode_query(queries)
document_embeddings = model.encode_document(documents)
print(query_embeddings.shape, document_embeddings.shape)
# [1, 384] [3, 384]

# Get the similarity scores for the embeddings
similarities = model.similarity(query_embeddings, document_embeddings)
print(similarities)
# tensor([[ 0.5669, -0.1183, -0.1831]])

Evaluation

Metrics

Information Retrieval

Datasets: multi_lang_news_ir, en_news_ir, ne_news_ir and nepali_qa_9k

Evaluated with InformationRetrievalEvaluator with these parameters:

{
    "query_prompt_name": "query",
    "corpus_prompt_name": "document"
}

Metric	multi_lang_news_ir	en_news_ir	ne_news_ir	nepali_qa_9k
cosine_accuracy@10	0.9784	0.9898	0.9777	0.9311
cosine_precision@10	0.0978	0.099	0.0978	0.0931
cosine_precision@50	0.0199	0.0199	0.0198	0.02
cosine_recall@10	0.9784	0.9898	0.9777	0.9311
cosine_recall@50	0.9932	0.9969	0.992	0.9989
cosine_ndcg@10	0.9307	0.9546	0.9222	0.6025
cosine_mrr@10	0.9151	0.943	0.904	0.5005
cosine_map@10	0.9151	0.943	0.904	0.5005

Translation

Dataset: translation
Evaluated with TranslationEvaluator

Metric	Value
src2trg_accuracy	0.9841
trg2src_accuracy	0.9894
mean_accuracy	0.9868

Semantic Similarity

Datasets: stsb_en and stsb_ne
Evaluated with EmbeddingSimilarityEvaluator

Metric	stsb_en	stsb_ne
pearson_cosine	0.8571	0.7958
spearman_cosine	0.8638	0.7966

Information Retrieval

Datasets: nepali_query_passage_10k, nepali_ecomm and sanoir_general

Evaluated with InformationRetrievalEvaluator with these parameters:

{
    "query_prompt_name": "query",
    "corpus_prompt_name": "document"
}

Metric	nepali_query_passage_10k	nepali_ecomm	sanoir_general
cosine_accuracy@10	0.91	0.8894	0.9663
cosine_precision@3	0.265	0.2463	0.3056
cosine_precision@10	0.091	0.0889	0.0966
cosine_precision@50	0.0194	0.0199	0.0197
cosine_recall@3	0.795	0.7388	0.9169
cosine_recall@10	0.91	0.8894	0.9663
cosine_recall@50	0.9725	0.9929	0.9865
cosine_ndcg@10	0.7601	0.6949	0.8872
cosine_mrr@10	0.712	0.6326	0.861
cosine_map@10	0.712	0.6326	0.861

Training Details

Training Datasets

title_excerpt

Dataset: title_excerpt at 1582ca1
Size: 102,803 training samples
Columns: title and excerpt
Approximate statistics based on the first 100 samples:
title excerpt
type string string

modality text text
details
min: 9 tokens
mean: 17.72 tokens
max: 32 tokens

min: 27 tokens
mean: 41.83 tokens
max: 67 tokens

	title	excerpt
type	string	string
modality	text	text
details	min: 9 tokens mean: 17.72 tokens max: 32 tokens	min: 27 tokens mean: 41.83 tokens max: 67 tokens

Samples:

title	excerpt
`Electricity poles erected a year ago, but villages still without power`	`Residents of six settlements in Kumakh Rural Municipality, Salyan district, remain without electricity a year after poles were erected due to contractor negligence and transformer supply issues.`
`नेप्सेले सार्वजनिक गर्यो धितोपत्र व्यापारीका लागि कारोबारयोग्य ११० कम्पनीको नामावली, कुन–कुन परे ?`	`नेपाल स्टक एक्सचेञ्जले धितोपत्र व्यापारीका लागि कारोबार योग्य ११० कम्पनीहरूको नामावली सार्वजनिक गरेको छ। यसमा बैंक, फाइनान्स, बीमा, जलविद्युत लगायतका कम्पनीहरू समावेश छन्।`
`एसीसी यू-१६ इस्ट जोन कपको फाइनलमा पहिले बलिङ गर्दै नेपाल`	`एसीसी पुरुष यू-१६ इस्ट जोन कपको फाइनलमा नेपालले पहिलो बलिङ गर्ने निर्णय लिएको छ। सिंगापुरले टस जितेर ब्याटिङ रोज्दा नेपालले फिल्डिङ गर्ने भयो।`

Loss: CachedMultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "mini_batch_size": 32,
    "gather_across_devices": false,
    "directions": [
        "query_to_doc"
    ],
    "partition_mode": "joint",
    "hardness_mode": null,
    "hardness_strength": 0.0
}

ne_en

Dataset: ne_en at e4c18f5
Size: 3,765 training samples
Columns: title and translation
Approximate statistics based on the first 100 samples:
title translation
type string string

modality text text
details
min: 3 tokens
mean: 17.48 tokens
max: 33 tokens

min: 3 tokens
mean: 18.38 tokens
max: 32 tokens

	title	translation
type	string	string
modality	text	text
details	min: 3 tokens mean: 17.48 tokens max: 33 tokens	min: 3 tokens mean: 18.38 tokens max: 32 tokens

Samples:

title	translation
`FWLD pushes for inclusive, non-discriminatory citizenship law`	`FWLD समावेशी, गैर-भेदभावरहित नागरिकता कानूनको लागि जोड दिन्छ`
`Clouded leopard: A vanishing jewel of the forest`	`बादलयुक्त चितुवा: जंगलको हराउने रत्न`
`सिटिजन्स सदाबहार इकाइमा आवेदन म्याद थप`	`Application deadline extended to Citizens Sadabahar Unit`

Loss: MultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "gather_across_devices": false,
    "directions": [
        "query_to_doc",
        "doc_to_query"
    ],
    "partition_mode": "per_direction",
    "hardness_mode": null,
    "hardness_strength": 0.0
}

excerpt_paraphrase

Dataset: excerpt_paraphrase at b521e5a
Size: 549 training samples
Columns: sentence1 and sentence2
Approximate statistics based on the first 100 samples:
sentence1 sentence2
type string string

modality text text
details
min: 22 tokens
mean: 40.88 tokens
max: 69 tokens

min: 20 tokens
mean: 44.12 tokens
max: 82 tokens

	sentence1	sentence2
type	string	string
modality	text	text
details	min: 22 tokens mean: 40.88 tokens max: 69 tokens	min: 20 tokens mean: 44.12 tokens max: 82 tokens

Samples:

sentence1	sentence2
`भरतपुर कारागारमा मौसम परिवर्तन र वर्षातका कारण २२ कैदीबन्दीलाई रुघा र ज्वरोको समस्या देखिएको छ र उनीहरूको छुट्टै उपचार भैरहेको छ।`	`मौसममा आएको बदलाव र वर्षाका कारण भरतपुर जेलमा २२ जना कैदीबन्दीलाई रुघाखोकी र ज्वरोले सताएको छ, जसका लागि उनीहरूको विशेष उपचार भइरहेको छ।`
`Heavy to very heavy rainfall is likely today in six provinces of Nepal due to the monsoon trough near its average position, with thunder and lightning expected in several regions.`	`Intense precipitation is anticipated this day across six Nepalese provinces, owing to the monsoon trough maintaining its usual course, and electrical storms are predicted in various areas.`
भोजपुरको रामप्रसाद राई गाउँपालिका–६ बैकुण्ठेका पाँच सामुदायिक विद्यालयका ४३८ विद्यार्थीलाई पोसाक वितरण गरिएको छ। वडाले विद्यालयबीच एकरुपता ल्याउने लक्ष्यले पोसाक, जुत्ता र टिसर्ट वितरण गरेको हो।	रामप्रसाद राई गाउँपालिका–६, भोजपुरको बैकुण्ठेस्थित पाँच सामुदायिक विद्यालयका ४३८ जना विद्यार्थीहरूलाई वडाले विद्यालयहरूमा एकरूपता कायम गर्नका लागि पोसाक, जुत्ता तथा टिसर्ट प्रदान गरेको छ।

Loss: MultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "gather_across_devices": false,
    "directions": [
        "query_to_doc",
        "doc_to_query"
    ],
    "partition_mode": "per_direction",
    "hardness_mode": null,
    "hardness_strength": 0.0
}

nepali_triplets

Dataset: nepali_triplets at bd8c184
Size: 1,600 training samples
Columns: sentence, positive_sentence, and negative_sentence

Approximate statistics based on the first 100 samples:

	sentence	positive_sentence	negative_sentence
type	string	string	string
modality	text	text	text
details	min: 21 tokens mean: 40.32 tokens max: 68 tokens	min: 20 tokens mean: 41.32 tokens max: 76 tokens	min: 19 tokens mean: 33.11 tokens max: 58 tokens

Samples:

sentence	positive_sentence	negative_sentence
`भारतका रक्षा प्रमुख जनरल अनिल चौहानले चीन, पाकिस्तान र बंगलादेशको गठबन्धनलाई भारतको सुरक्षाका लागि ठूलो खतरा भएको बताएका छन्।`	`चीन, पाकिस्तान र बंगलादेशको संयुक्त गठबन्धनलाई भारतको सुरक्षा चुनौतीको रूपमा जनरल अनिल चौहानले औंल्याएका छन्।`	`जनरल अनिल चौहानले भारतको सुरक्षाका लागि चीन र पाकिस्तानको गठबन्धन भन्दा मात्र बंगलादेशलाई ठूलो खतरा भनेका छन्।`
`The Sarlahi District Court has granted bail to suspended Bagmati Municipality Mayor Bharat Bahadur Thapa on a Rs 5 million bond in connection with illegal forest resource extraction charges.`	`Bharat Bahadur Thapa, the suspended mayor of Bagmati Municipality, was released on bail by the Sarlahi District Court after posting a bond of Rs 5 million related to allegations of unlawful forest resource exploitation.`	`The Sarlahi District Court denied bail to Bharat Bahadur Thapa, the suspended mayor of Bagmati Municipality, in the case concerning illegal forest resource extraction.`
नेपाली युवा महिला फुटबल टोलीका प्रशिक्षक यामप्रसाद गुरुङले साफ यु-२० महिला च्याम्पियनसिपको उपाधि जित्ने आशा दिएका छन्। नेपालले जुलाईमा बंगलादेशमा हुने प्रतियोगितामा बलियो टोली बनाएर प्रतिस्पर्धा गर्नेछ।	यामप्रसाद गुरुङले साफ यु-२० महिला च्याम्पियनसिपमा नेपालको टोलीले शीर्ष स्थान हासिल गर्ने विश्वास व्यक्त गरेका छन्। आगामी जुलाईमा बंगलादेशमा आयोजना हुने प्रतियोगितामा नेपालले सशक्त टोली प्रस्तुत गर्ने तयारीमा छ।	`नेपाली युवा महिला फुटबल टोलीले आगामी साफ यु-२० महिला च्याम्पियनसिपमा कमजोर प्रदर्शन गर्ने सम्भावना व्यक्त गरिएको छ।`

Loss: TripletLoss with these parameters:

{
    "distance_metric": "TripletDistanceMetric.COSINE",
    "triplet_margin": 0.2
}

stsb_en

Dataset: stsb_en at 4bfcc74
Size: 5,710 training samples
Columns: sentence1, sentence2, and score

Approximate statistics based on the first 100 samples:

	sentence1	sentence2	score
type	string	string	float
modality	text	text
details	min: 7 tokens mean: 10.43 tokens max: 16 tokens	min: 7 tokens mean: 10.62 tokens max: 19 tokens	min: 0.1 mean: 0.66 max: 1.0

Samples:

sentence1	sentence2	score
`A plane is taking off.`	`An air plane is taking off.`	`1.0`
`A man is playing a large flute.`	`A man is playing a flute.`	`0.76`
`A man is spreading shreded cheese on a pizza.`	`A man is spreading shredded cheese on an uncooked pizza.`	`0.76`

Loss: CoSENTLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "pairwise_cos_sim"
}

stsb_ne

Dataset: stsb_ne at 4bfcc74
Size: 5,710 training samples
Columns: sentence1, sentence2, and score

Approximate statistics based on the first 100 samples:

	sentence1	sentence2	score
type	string	string	float
modality	text	text
details	min: 8 tokens mean: 11.96 tokens max: 21 tokens	min: 8 tokens mean: 12.14 tokens max: 23 tokens	min: 0.1 mean: 0.66 max: 1.0

Samples:

sentence1	sentence2	score
`एउटा विमान उडिरहेको छ।`	`हवाई जहाज उडिरहेको छ।`	`1.0`
`एउटा मान्छे ठूलो बाँसुरी बजाइरहेको छ।`	`एउटा मान्छे बाँसुरी बजाउँदै छ।`	`0.76`
`एक मानिस पिज्जामा टुक्रा चिज फैलाउँदै छ।`	`एक जना मानिसले न पकाएको पिज्जामा टुक्रा पारेको चीज फैलाउँदै छ।`	`0.76`

Loss: CoSENTLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "pairwise_cos_sim"
}

nepali_qa_9k

Dataset: nepali_qa_9k at 33f9def
Size: 6,480 training samples
Columns: question and answer
Approximate statistics based on the first 100 samples:
question answer
type string string

modality text text
details
min: 10 tokens
mean: 20.6 tokens
max: 36 tokens

min: 24 tokens
mean: 38.75 tokens
max: 60 tokens

	question	answer
type	string	string
modality	text	text
details	min: 10 tokens mean: 20.6 tokens max: 36 tokens	min: 24 tokens mean: 38.75 tokens max: 60 tokens

Samples:

question	answer
`मेरो ल्यापटप धेरै ढिलो (slow) भइरहेको छ, के गर्ने?`	`ल्यापटपको प्रदर्शन सुधार गर्न, अनावश्यक सफ्टवेयर हटाउनुहोस्, RAM र प्रोसेसरको प्रयोग जाँच गर्नुहोस्, र सिस्टमलाई अपडेट गर्नुहोस्।`
`मलाई अचानक ज्वरो आएको छ, मैले के गर्नुपर्छ?`	`यदि तपाईंलाई ज्वरो आएको छ भने, आराम गर्नुहोस्, पर्याप्त पानी पिउनुहोस्, र यदि ज्वरो धेरै छ वा असहजता महसुस हुन्छ भने तुरुन्त डाक्टरसँग परामर्श लिनुहोस्।`
`मेरो मोबाइलको डाटा ब्याकअप कसरी गर्न सकिन्छ? विभिन्न विकल्पहरू के-के छन्?`	`तपाईंले आफ्नो मोबाइल सेटिङ्समा गएर क्लाउड सर्भिस (जस्तै Google Drive वा iCloud) प्रयोग गरेर वा विशेष ब्याकअप एपहरू मार्फत डाटा ब्याकअप गर्न सक्नुहुन्छ।`

Loss: CachedMultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "mini_batch_size": 32,
    "gather_across_devices": false,
    "directions": [
        "query_to_doc"
    ],
    "partition_mode": "joint",
    "hardness_mode": null,
    "hardness_strength": 0.0
}

ecommerce

Dataset: ecommerce at 4b7dd81
Size: 1,367 training samples
Columns: query, document, negative1, negative2, and negative3

Approximate statistics based on the first 100 samples:

	query	document	negative1	negative2	negative3
type	string	string	string	string	string
modality	text	text	text	text	text
details	min: 10 tokens mean: 20.68 tokens max: 42 tokens	min: 61 tokens mean: 103.96 tokens max: 179 tokens	min: 33 tokens mean: 70.3 tokens max: 102 tokens	min: 28 tokens mean: 62.54 tokens max: 94 tokens	min: 25 tokens mean: 57.67 tokens max: 79 tokens

Samples:

query	document	negative1	negative2	negative3
`Samsung Galaxy S24 Ultra price in Nepal`	`The Samsung Galaxy S24 Ultra is now available in Nepal for NPR 1,59,999. It features a 200MP camera, S Pen support, and a powerful Snapdragon 8 Gen 3 processor. The phone comes with 12GB RAM and 256GB storage, offering a stunning 6.8-inch Dynamic AMOLED 2X display.`	`The Samsung Galaxy S24 FE is a more affordable option at NPR 75,999, with a 50MP camera and Exynos 2400 chipset. It offers 8GB RAM and 128GB storage, making it a good mid-range choice. The display is a 6.7-inch Super AMOLED with 120Hz refresh rate.`	`The Samsung Galaxy Tab S9 Ultra is a high-end tablet priced at NPR 1,49,999. It features a 14.6-inch Dynamic AMOLED 2X display and comes with the S Pen included. This tablet is ideal for creative professionals and students.`	`The Samsung 65-inch 4K Smart TV is available for NPR 1,20,000. It supports HDR10+ and has built-in Alexa. This TV offers vibrant picture quality and is perfect for home entertainment.`
`sasto tel kun ramro fortuna ki sathi cooking oil price compare gara na`	`When comparing Fortune versus Sathi refined cooking oils, Fortune 1-liter bottle is priced at NPR 210 while Sathi's same size costs NPR 195, making Sathi a more budget-friendly option for daily use. Both are suitable for deep frying and regular cooking, but Fortune is often preferred for its lighter texture and neutral flavor. If you are looking to save on your monthly grocery bill, switching to Sathi oil can save you around NPR 15 per liter without sacrificing quality.`	`Fortune basmati rice 5kg is now available at NPR 850, which is a good deal compared to other premium brands like Kohinoor. Many customers praise its long grains and aromatic flavor, perfect for biryani and pulao. It is currently on a 10% discount for new users on our store.`	`Wai Wai noodles are a popular instant snack in Nepal, available in curry, chicken, and vegetable flavors. A single packet costs NPR 15, and bulk packs of 12 are priced at NPR 170. They are quick to prepare and loved by students and travelers.`	`Our store now offers free delivery on all orders above NPR 1000 within Kathmandu Valley. You can also earn reward points on every purchase of groceries and household items. Check out the new arrivals section for exclusive discounts this week.`
`CDC Grade 10 Nepali textbook quality kasto cha? review ra ratings hernu hai`	`For students using the CDC Grade 10 Nepali textbook, our guide shows how to annotate and highlight key poems like 'Mero Desh' for better exam preparation. We recommend Pilot V7 pens for clean underlining and Stabile Boss highlighters in yellow, available at NPR 85 and NPR 120 per piece at Sajha Bookstore. Users report that using sticky tabs for grammar sections improves revision speed by 30%, making this a top-rated method among Kathmandu school teachers.`	`Our guide for Oxford Advanced Learner's Dictionary explains how to use the companion app to check word pronunciations and build vocabulary lists. This digital tool costs NPR 1,500 for a one-year subscription and syncs across phone and laptop. Students in Pokhara have praised its clarity for improving their English speaking skills.`	`This blog post reviews the top five ballpoint pens under NPR 200, including Linc Pentonic and Hauser XO, focusing on smooth writing and durability. We mention that the Hauser XO offers a 1.2mm tip for bold strokes, ideal for signatures. However, no Nepali textbook usage or teacher feedback is included.`	`Today's special offer: Buy three A4 notebooks from Classic Notebooks for just NPR 350 and get a free Bic pen set. Available only at our Jawalakhel outlet while stocks last. Visit our store for stationery deals on school supplies.`

Loss: CachedMultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "mini_batch_size": 32,
    "gather_across_devices": false,
    "directions": [
        "query_to_doc"
    ],
    "partition_mode": "joint",
    "hardness_mode": "hard_negatives",
    "hardness_strength": 5
}

cross_lingual

Dataset: cross_lingual at 7efcacf
Size: 8,000 training samples
Columns: source_text and text
Approximate statistics based on the first 100 samples:
source_text text
type string string

modality text text
details
min: 19 tokens
mean: 39.83 tokens
max: 71 tokens

min: 12 tokens
mean: 44.38 tokens
max: 111 tokens

	source_text	text
type	string	string
modality	text	text
details	min: 19 tokens mean: 39.83 tokens max: 71 tokens	min: 12 tokens mean: 44.38 tokens max: 111 tokens

Samples:

source_text	text
`The Supreme Court of Nepal will deliver its verdict on the controversial 52 appointments to constitutional bodies made through amended ordinances, amidst multiple legal challenges.`	`Nepal ko Supreme Court le aba controversial 52 appointments ko barema verdict dine wala cha, jo constitutional bodies ma amended ordinances through bhako thiyo. Tara tyo bichama dherai legal challenges pani aairako cha.`
`सांसद ज्ञानेन्द्रबहादुर कार्कीले नेपालको विकास मोडलमा छलफल गर्न आवश्यक रहेको र छिमेकी देशहरूको विकास अध्ययन गर्नुपर्ने बताएका छन्।`	`सांसद ज्ञानेन्द्रबहादुर कार्की कहलन कि नेपाल के विकास मोडल प छलफल जरूरी बा, आ पड़ोसी देसन के विकास के अध्ययन करल जाय के चाही।`
`कालीमाटी तरकारी बजारमा आज काउली, गोलभेँडा र भिन्डी लगायतका तरकारीको थोक मूल्य घटेको छ भने अन्य तरकारीहरूका मूल्य स्थिर रहेका छन्।`	`Kalimati tarkari bazar ma aaj kauli, golbhenda ra bhindi lagayat ka tarkari ko wholesale price ghatya cha bhane aru tarkari haru ka price sthir raheka chan.`

Loss: MultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "gather_across_devices": false,
    "directions": [
        "query_to_doc",
        "doc_to_query"
    ],
    "partition_mode": "per_direction",
    "hardness_mode": null,
    "hardness_strength": 0.0
}

sanoir_general

Dataset: sanoir_general at 7e53250
Size: 4,977 training samples
Columns: query, positive, negative_1, negative_2, negative_3, and negative_4

Approximate statistics based on the first 100 samples:

	query	positive	negative_1	negative_2	negative_3	negative_4
type	string	string	string	string	string	string
modality	text	text	text	text	text	text
details	min: 12 tokens mean: 34.71 tokens max: 98 tokens	min: 17 tokens mean: 81.83 tokens max: 130 tokens	min: 11 tokens mean: 64.88 tokens max: 113 tokens	min: 13 tokens mean: 57.9 tokens max: 102 tokens	min: 8 tokens mean: 54.97 tokens max: 111 tokens	min: 9 tokens mean: 54.83 tokens max: 110 tokens

Samples:

query	positive	negative_1	negative_2	negative_3	negative_4
`Is it better for Nepal to switch completely to organic farming instead of using chemical fertilizers?`	के पूर्ण रूपमा जैविक खेती (Organic Farming) अपनाउनु नै नेपालको कृषि भविष्यका लागि उत्तम विकल्प हो? हो, पूर्ण जैविक खेती अपनाउनु नै सबैभन्दा उत्तम विकल्प हो। रासायनिक मल र कृत्रिम कीटनाशकको प्रयोगले माटोको प्राकृतिक उर्वराशक्ति नष्ट गरिरहेको छ। जैविक खेतीले माटोको जीवसत्त्वलाई जोगाउँछ, वातावरणलाई प्रदूषणमुक्त राख्छ र उपभोक्तालाई स्वस्थ खाद्यान्न उपलब्ध गराउँछ। दीर्घकालीन रूपमा यो पद्धतिले माटोको स्वास्थ्य र कृषकको आम्दानी दुवैलाई सुनिश्चित गर्दछ।	नेपालका साना किसानहरूका लागि रासायनिक मलको प्रयोग पूर्णतया बन्द गर्नु व्यावहारिक छैन। यसले उत्पादनमा तत्काल कमी ल्याउन सक्छ। त्यसैले, रासायनिक मलको मात्रा बिस्तारै घटाउँदै लैजानुपर्छ र प्राङ्गारिक मलको प्रयोगलाई प्रोत्साहन गर्ने नीति ल्याउनुपर्छ।	जैविक खेती गर्दा माटोको गुणस्तर दीर्घकालीन रूपमा सुध्रिन्छ र हानिकारक विषादीको प्रयोग हुँदैन। तर, यसका लागि आवश्यक पर्ने श्रम र समय बढी लाग्ने भएकाले व्यावसायिक खेती गर्ने ठूला कृषकहरूका लागि यो चुनौतीपूर्ण हुन सक्छ।	सरकारले कृषि क्षेत्रमा अनुदान दिँदा केवल रासायनिक मलमा मात्र सीमित नभई जैविक मल र कीटनाशक उत्पादन गर्ने उद्योगहरूलाई पनि प्राथमिकता दिनुपर्छ। यसले गर्दा कृषकहरूले सस्तो दरमा प्राङ्गारिक सामग्री प्राप्त गर्न सक्छन्।	`हिमाली भेगका किसानहरूले आफ्नो उत्पादन बढाउन रासायनिक मलको सट्टा स्थानीय रूपमा उपलब्ध हुने कम्पोस्ट मल र गोबर मलको प्रयोगमा बढी ध्यान दिनुपर्छ। यसले गर्दा माटोको उत्पादकत्व बढ्नेछ।`
`मुस्ताङ जाने कच्ची बाटो हिउँदमा बर्खाको तुलनामा सुगम हुन्छ कि भन्ने claim लाई support गर्ने forum answer खोज्दैछु, जहाँ landslide र river obstruction कम हुँदा safe travel months अक्टोबरदेखि मार्चसम्म भनेर local guide को consensus छ।`	मुस्ताङ जाने कच्ची बाटो हिउँदमा बर्खाको तुलनामा धेरै सुगम हुन्छ किनभने बर्खामा भासिने र खोलामा बगेर आउने पहिरोले मार्ग अवरुद्ध गर्छ भने हिउँदमा जमेको हिउँले तल्लो भूभाग स्थिर राख्छ र गाडी चलाउन मिल्ने अवस्था बन्छ। स्थानीय ट्रेकिङ गाइडहरू पनि अक्टोबरदेखि मार्चसम्मको यात्रालाई सुरक्षित मान्छन्।	`हिउँदमा मुस्ताङ जाने बाटो बर्खाको भन्दा सजिलो हुन्छ किनभने त्यहाँको हावा सफा हुन्छ र पर्यटक कम हुन्छन्। तर यो भनेको मात्र मौसमको अनुभव हो, बाटोको भौतिक अवस्था भने सधैं उस्तै रहन्छ।`	`मुस्ताङको लो मन्थाङबाट जोमसोमसम्मको पैदल मार्ग हिउँदमा बर्खाको तुलनामा बढी जोखिमपूर्ण हुन्छ किनभने त्यहाँ हिउँले मार्ग ढाक्छ र स्थानीय भने यो सिजनमा यात्रा नगर्न सल्लाह दिन्छन्।`	मुस्ताङ जाने प्रमुख सडक मार्ग बेनीबाट कागबेनी हुँदै अगाडि जान्छ। बर्खामा खोला बग्ने भएकाले सवारी चलाउन गाह्रो हुन्छ तर हिउँदमा पनि त्यही मार्ग प्रयोग हुन्छ। यसले मौसम अनुसार मर्मत आवश्यक पर्छ।	`डोल्पा जिल्लाको दुर्गम भेगमा हिउँदमा बाटो बर्खाको भन्दा बढी सुगम हुन्छ किनभने वर्षाका कारण खसेका ढुङ्गा हटिसकेका हुन्छन् र जनजागरण कार्यक्रमले बाटो सफा राख्छ।`
`What is the impact of nitrogen fertilizer usage on maize yields in the Terai region of Nepal?`	नेपालको तराई क्षेत्रमा मकैको उत्पादनमा सुधार ल्याउनका लागि नाइट्रोजनको सही मात्रामा प्रयोग महत्त्वपूर्ण मानिन्छ। कृषि विज्ञहरूका अनुसार, माटो परीक्षण गरी तोकिएको मात्रामा मात्र युरिया मल प्रयोग गर्दा मकैको दानाको गुणस्तर र उत्पादन दुवैमा उल्लेख्य वृद्धि हुने गरेको छ। यसले माटोको प्राकृतिक सन्तुलन बिगार्नबाट पनि जोगाउँछ।	नेपालको पहाडी भेगमा धान खेती गर्दासायनिक मलको प्रयोगले उत्पादनमा वृद्धि ल्याएको देखिन्छ। अनुसन्धानले देखाएको छ कि नाइट्रोजनयुक्त मलको उचित प्रयोगले माटोको उर्वरशक्ति कायम राख्न मद्दत गर्छ, जसले गर्दा किसानहरूले कम लागतमा बढी अन्न उत्पादन गर्न सक्छन्।	तराईका क्षेत्रमा गहुँ उत्पादन बढाउन सिँचाइ प्रविधिमा सुधार गर्नु आवश्यक छ। हालैका अध्ययनहरूले देखाए अनुसार आधुनिक सिँचाइ प्रणाली र उन्नत बीउको संयोजनले माटोको गुणस्तर सुधार्नुका साथै उत्पादनको दरलाई पनि स्थिर राख्न सहयोग पुर्‍याउँछ।	जलवायु परिवर्तनका कारण नेपालको कृषि क्षेत्रमा ठूलो चुनौती थपिएको छ। बढ्दो तापक्रम र अनियमित वर्षाले गर्दा परम्परागत बालीनालीको उत्पादनमा ह्रास आउनुका साथै माटोको जैविक संरचनामा पनि नकारात्मक प्रभाव परिरहेको छ।	जैविक खेती (Organic farming) को विस्तारले नेपालको ग्रामीण अर्थतन्त्रलाई बलियो बनाउन सक्छ। रासायनिक विषादीको सट्टा प्राङ्गारिक मलको प्रयोग गर्दा माटोको संरचना मात्र सुध्रिँदैन, यसले उपभोक्ताको स्वास्थ्यलाई पनि प्रत्यक्ष फाइदा पुर्‍याउँछ।

Loss: CachedMultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "mini_batch_size": 32,
    "gather_across_devices": false,
    "directions": [
        "query_to_doc"
    ],
    "partition_mode": "joint",
    "hardness_mode": null,
    "hardness_strength": 0.0
}

Evaluation Datasets

title_excerpt

Dataset: title_excerpt at 1582ca1
Size: 20,560 evaluation samples
Columns: title and excerpt
Approximate statistics based on the first 100 samples:
title excerpt
type string string

modality text text
details
min: 6 tokens
mean: 17.89 tokens
max: 31 tokens

min: 23 tokens
mean: 42.8 tokens
max: 94 tokens

	title	excerpt
type	string	string
modality	text	text
details	min: 6 tokens mean: 17.89 tokens max: 31 tokens	min: 23 tokens mean: 42.8 tokens max: 94 tokens

Samples:

title	excerpt
`UML Youth Protest in Biratnagar Against Party Chairman's Arrest`	`CPN-UML youths in Biratnagar protested against the arrest of Party Chairman KP Sharma Oli, gathering at Mahendra Chowk and chanting slogans against the Home Minister.`
`Special Court extends UML Vice-chair Bishnu Paudel's remand by three days`	`The Special Court has extended the remand of former Finance Minister and CPN-UML Vice-chair Bishnu Prasad Paudel by three days amid an ongoing money laundering investigation. Meanwhile, the Supreme Court is hearing a habeas corpus petition challenging his detention.`
`अनावश्यक रूपमा बिरामीलाई ‘रिफर’ नगर्न अस्पताललाई स्वास्थ्य बीमा बोर्डको निर्देशन`	`स्वास्थ्य बिमा बोर्डले सबै स्वास्थ्य संस्थालाई बिरामीलाई अनावश्यक रिफर नगर्न निर्देशन दिएको छ। अनावश्यक रिफर हुँदा बिरामीलाई समस्या र अतिरिक्त परीक्षण हुन सक्छन्।`

Loss: CachedMultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "mini_batch_size": 32,
    "gather_across_devices": false,
    "directions": [
        "query_to_doc"
    ],
    "partition_mode": "joint",
    "hardness_mode": null,
    "hardness_strength": 0.0
}

ne_en

Dataset: ne_en at e4c18f5
Size: 753 evaluation samples
Columns: title and translation
Approximate statistics based on the first 100 samples:
title translation
type string string

modality text text
details
min: 3 tokens
mean: 17.56 tokens
max: 33 tokens

min: 3 tokens
mean: 18.22 tokens
max: 38 tokens

	title	translation
type	string	string
modality	text	text
details	min: 3 tokens mean: 17.56 tokens max: 33 tokens	min: 3 tokens mean: 18.22 tokens max: 38 tokens

Samples:

title	translation
`Sudurpaschim province sees sharp incline in Covid-19 infection`	`सुदूरपश्चिम प्रदेशमा कोभिड–१९ को संक्रमण बढेको छ`
`खालि हुन थाल्यो पनिका, मुख्य सेवा अनलाइनबाटै`	`Even though it is empty, the main service is online`
`Nepal-UK Tech Forum highlights digital investment opportunities`	`नेपाल-युके टेक फोरमले डिजिटल लगानीका अवसरहरू हाइलाइट गरेको छ`

Loss: MultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "gather_across_devices": false,
    "directions": [
        "query_to_doc",
        "doc_to_query"
    ],
    "partition_mode": "per_direction",
    "hardness_mode": null,
    "hardness_strength": 0.0
}

excerpt_paraphrase

Dataset: excerpt_paraphrase at b521e5a
Size: 110 evaluation samples
Columns: sentence1 and sentence2
Approximate statistics based on the first 100 samples:
sentence1 sentence2
type string string

modality text text
details
min: 23 tokens
mean: 40.33 tokens
max: 75 tokens

min: 22 tokens
mean: 44.34 tokens
max: 77 tokens

	sentence1	sentence2
type	string	string
modality	text	text
details	min: 23 tokens mean: 40.33 tokens max: 75 tokens	min: 22 tokens mean: 44.34 tokens max: 77 tokens

Samples:

sentence1	sentence2
`Khanikhola Hydropower has received approval from SEBON to issue rights shares worth Rs 465.7 million, doubling its paid-up capital to Rs 931.4 million.`	`SEBON has granted approval to Khanikhola Hydropower for the issuance of rights shares valued at Rs 465.7 million, a move that will double its paid-up capital to Rs 931.4 million.`
`अन्तर्राष्ट्रिय आणविक ऊर्जा एजेन्सीले इरानमा अमेरिकाको आक्रमणपछि विकिरण स्तर नबढेको पुष्टि गरेको छ।`	`अमेरिकाले इरानमा आक्रमण गरेपछि अन्तर्राष्ट्रिय आणविक ऊर्जा एजेन्सीले त्यहाँ विकिरणको स्तर नबढेको कुराको पुष्टि गरेको छ।`
`EU foreign affairs chief Kaja Kallas urged China to stop undermining European security amid ongoing tensions over trade practices and Chinese support to Russia during the Ukraine war.`	`Kaja Kallas, the European Union's top diplomat, called on China to cease jeopardizing Europe's safety due to persistent disagreements concerning commercial activities and Beijing's backing of Moscow throughout the conflict in Ukraine.`

Loss: MultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "gather_across_devices": false,
    "directions": [
        "query_to_doc",
        "doc_to_query"
    ],
    "partition_mode": "per_direction",
    "hardness_mode": null,
    "hardness_strength": 0.0
}

nepali_triplets

Dataset: nepali_triplets at bd8c184
Size: 200 evaluation samples
Columns: sentence, positive_sentence, and negative_sentence

Approximate statistics based on the first 100 samples:

	sentence	positive_sentence	negative_sentence
type	string	string	string
modality	text	text	text
details	min: 19 tokens mean: 41.55 tokens max: 77 tokens	min: 20 tokens mean: 41.94 tokens max: 82 tokens	min: 16 tokens mean: 32.9 tokens max: 52 tokens

Samples:

sentence	positive_sentence	negative_sentence
रसुवामा अस्थायी प्रहरी चौकी मैलुङबाट हत्कडीसहित फरार भएका दुई थुनुवा चार घण्टाभित्रै सिम्लेबाट पक्राउ परे। उनीहरूलाई निर्माणाधीन त्रिशूली २१६ हाइड्रोपावरबाट चोरी गरेको सामानसहित पक्राउ गरिएको थियो।	रसुवाको सिम्लेबाट चार घण्टाभित्रै दुई थुनुवाहरूलाई हत्कडी लगाएर फरार भएको मैलुङको अस्थायी प्रहरी चौकीले पक्राउ गरेको छ, जसले त्रिशूली २१६ हाइड्रोपावर निर्माण स्थलबाट चोरी गरेका सामानहरू पनि बरामद गरियो।	`रसुवामा अस्थायी प्रहरी चौकी मैलुङबाट फरार भएका दुई थुनुवाहरू अझै पक्राउ परेका छैनन् र उनीहरूलाई चोरीको आरोपमा अनुसन्धान जारी छ।`
`The Forest Development Fund in Nepal, amounting to Rs 234.22 million, has remained unused for six years despite being established for forest conservation and development. The Department of Forests and Soil Conservation aims to utilize the fund once procedures are approved, with compensation from forest land use and infrastructure projects expected to replenish it.`	`Although the Forest Development Fund in Nepal, totaling Rs 234.22 million, was created to support forest conservation and development, it has not been spent for six years; the Department of Forests and Soil Conservation plans to activate its use following procedural approvals, anticipating that contributions from forest land utilization and infrastructure initiatives will restore the fund.`	`The Forest Development Fund in Nepal, amounting to Rs 234.22 million, has been fully allocated to infrastructure projects over the past six years, leaving no resources for forest conservation efforts.`
रसुवागढीस्थित भोटेकोसी नदीमा आएको बाढीमा २० जना बेपत्ता भएका थिए जसमा एक प्रहरी सहायक निरीक्षक लालबहादुर श्रेष्ठको मात्रै शव पहिचान भएको छ। ५ शव र ४ मानव अंग त्रिवि शिक्षण अस्पतालमा राखिएका छन्।	भोटेकोसी नदीमा आएको बाढीका कारण रसुवागढीमा २० जना हराइरहेका थिए, जसमा प्रहरी सहायक निरीक्षक लालबहादुर श्रेष्ठको मात्र शव पुष्टि भएको छ भने पाँच शव र चार मानव अंग त्रिवि शिक्षण अस्पतालमा सुरक्षित राखिएका छन्।	`रसुवागढीस्थित भोटेकोसी नदीमा आएको बाढीले धेरै घरहरू भत्काएको छ, तर कुनै पनि व्यक्ति बेपत्ता भएको खबर आएको छैन।`

Loss: TripletLoss with these parameters:

{
    "distance_metric": "TripletDistanceMetric.COSINE",
    "triplet_margin": 0.2
}

stsb_en

Dataset: stsb_en at 4bfcc74
Size: 1,498 evaluation samples
Columns: sentence1, sentence2, and score

Approximate statistics based on the first 100 samples:

	sentence1	sentence2	score
type	string	string	float
modality	text	text
details	min: 7 tokens mean: 11.07 tokens max: 20 tokens	min: 8 tokens mean: 11.12 tokens max: 18 tokens	min: 0.0 mean: 0.53 max: 1.0

Samples:

sentence1	sentence2	score
`A man with a hard hat is dancing.`	`A man wearing a hard hat is dancing.`	`1.0`
`A young child is riding a horse.`	`A child is riding a horse.`	`0.95`
`A man is feeding a mouse to a snake.`	`The man is feeding a mouse to the snake.`	`1.0`

Loss: CoSENTLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "pairwise_cos_sim"
}

stsb_ne

Dataset: stsb_ne at 4bfcc74
Size: 1,498 evaluation samples
Columns: sentence1, sentence2, and score

Approximate statistics based on the first 100 samples:

	sentence1	sentence2	score
type	string	string	float
modality	text	text
details	min: 8 tokens mean: 12.93 tokens max: 26 tokens	min: 9 tokens mean: 13.12 tokens max: 25 tokens	min: 0.0 mean: 0.53 max: 1.0

Samples:

sentence1	sentence2	score
`कडा टोपी लगाएको मान्छे नाचिरहेको छ।`	`कडा टोपी लगाएको मान्छे नाचिरहेको छ।`	`1.0`
`एउटा सानो बालक घोडा चढिरहेको छ।`	`एउटा बच्चा घोडा चढिरहेको छ।`	`0.95`
`एउटा मानिसले मुसालाई सर्पलाई खुवाइरहेको छ।`	`मानिसले मुसालाई सर्पलाई खुवाइरहेको छ।`	`1.0`

Loss: CoSENTLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "pairwise_cos_sim"
}

nepali_qa_9k

Dataset: nepali_qa_9k at 33f9def
Size: 720 evaluation samples
Columns: question and answer
Approximate statistics based on the first 100 samples:
question answer
type string string

modality text text
details
min: 12 tokens
mean: 20.52 tokens
max: 32 tokens

min: 19 tokens
mean: 39.32 tokens
max: 71 tokens

	question	answer
type	string	string
modality	text	text
details	min: 12 tokens mean: 20.52 tokens max: 32 tokens	min: 19 tokens mean: 39.32 tokens max: 71 tokens

Samples:

question	answer
`मले गाडी चलाउँदा ट्राफिक नियम उल्लंघन गरेर जरिवाना पाएँ, त्यसलाई कसरी तिर्न सक्छु?`	`तपाईंले सरकारी वेबसाइट वा आधिकारिक यातायात कार्यालयको पोर्टल मार्फत आफ्नो ट्राफिक जरिवानाको विवरण जाँच गर्न र तिर्न सक्नुहुन्छ।`
`मेरो बच्चाको लागि COVID-19 को खोप कहिले लगाउनु पर्छ? के यो अनिवार्य छ?`	बच्चाहरूको लागि खोपको समय बाल स्वास्थ्य विभागको नवीनतम निर्देशन अनुसार जाँच गर्नुपर्छ। कृपया स्थानीय स्वास्थ्य कार्यालय वा आधिकारिक सरकारी वेबसाइटमा हालको खोप कार्यक्रमको जानकारी लिनुहोस्।
`जन्मदर्ता गराउनका लागि आवश्यक कागजातहरू के-के हुन्?`	`जन्मदर्ताका लागि सामान्यतया जन्मदर्ताको फारम, अभिभावकको नागरिकता/पहचान पत्रको प्रतिलिपि, र जन्मस्थान तथा जन्ममिति प्रमाणित गर्ने अन्य आवश्यक कागजातहरू चाहिन्छन्।`

Loss: CachedMultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "mini_batch_size": 32,
    "gather_across_devices": false,
    "directions": [
        "query_to_doc"
    ],
    "partition_mode": "joint",
    "hardness_mode": null,
    "hardness_strength": 0.0
}

ecommerce

Dataset: ecommerce at 4b7dd81
Size: 198 evaluation samples
Columns: query, document, negative1, negative2, and negative3

Approximate statistics based on the first 100 samples:

	query	document	negative1	negative2	negative3
type	string	string	string	string	string
modality	text	text	text	text	text
details	min: 8 tokens mean: 22.54 tokens max: 39 tokens	min: 61 tokens mean: 103.8 tokens max: 182 tokens	min: 46 tokens mean: 72.73 tokens max: 116 tokens	min: 35 tokens mean: 66.14 tokens max: 110 tokens	min: 39 tokens mean: 61.4 tokens max: 99 tokens

Samples:

query	document	negative1	negative2	negative3
`कुन पश्मिना राम्रो छ, हिमालयन ट्रेजरको कि पश्मिना प्यालेसको?`	`I bought the 'Hatti Dhundo' black pashmina shawl from Himalayan Treasure for NPR 3,200 and it was incredibly soft and warm. However, my friend got a similar pashmina from Pashmina Palace for NPR 2,800, but hers felt a bit thinner and less fluffy. The Himalayan Treasure one had better stitching and a more elegant finish, perfect for winter events. I'm glad I paid a bit more for the quality.`	`The 'Hatti Dhundo' pashmina from Himalayan Treasure is made from pure cashmere wool and comes in various colors. It is machine washable on a gentle cycle and dries quickly without shrinking. Many customers have praised its durability over multiple seasons.`	`I ordered a traditional Nepali dhaka topi from Kathmandu Handicrafts for NPR 500. The fabric was high-quality and the embroidery was precise, but it was a bit tight for my head size. They offered free exchanges, which was convenient.`	`These running shoes from Nike are lightweight and have great arch support. I wear them for my daily jog at Ratna Park and they've lasted over six months. The cushioning is still as good as new.`
`Prestige Omega electric cooker specs kati watt ko cha ra kati liter ko ho?`	`The Prestige Omega 4-in-1 Electric Cooker (model: POC-45) features a 5-liter capacity stainless steel inner pot, 900W power consumption, and multi-function capabilities including rice cooking, slow cooking, steaming, and sautéing. It comes with a 24-hour digital timer, keep-warm function, and a non-stick inner lid for easy cleaning. Priced at NPR 8,500, it is available with a 1-year warranty in Nepal.`	`The Prestige Omega Induction Cooktop (model: PIC-2000) has a 2000W power output, 8 preset cooking modes, and a digital LED display with touch controls. It is compatible with all types of cookware and comes with a 2-year warranty. Price is NPR 5,200.`	`The Philips Airfryer XXL (model: HD9650/90) uses 2225W of power, has a 3-pound capacity basket, and features fat reduction technology for healthier frying. It includes 11 preset cooking programs and a keep-warm function. Available for NPR 22,000.`	`The IKEA KALLAX Shelf Unit (dimensions: 147x147 cm) is a versatile storage solution made from particleboard with a foil finish. It comes in black-brown and white colors and can be used as a room divider or bookshelf. Price is NPR 9,500.`
`Khadi Natural Vitamin C Serum कसरी use गर्ने?`	To get the best results from your Khadi Natural Vitamin C Face Serum, apply 3-4 drops to a clean, damp face every morning after cleansing. Gently massage it into your skin using upward motions, avoiding the eye area, and let it absorb for a minute before layering with a moisturizer. For Nepali users, this ₹450 (approx. NPR 720) serum is ideal for brightening dull skin and reducing hyperpigmentation, especially in Kathmandu's polluted environment. Always use sunscreen during the day, as Vitamin C can increase sun sensitivity.	`The Khadi Natural Vitamin C Face Serum contains 20% stabilized Vitamin C, hyaluronic acid, and aloe vera, making it a potent antioxidant formula for all skin types. It is available in a 30ml glass bottle with a dropper and is free from parabens and sulfates. This serum is manufactured in India and has a shelf life of 24 months from the date of manufacture.`	`Are you looking for the best Vitamin C serums in Nepal? Check out our top picks including The Ordinary, Minimalist, and Khadi Natural, with prices ranging from NPR 800 to NPR 3,500. We also have a buying guide for Nepali skin types, including tips for oily and acne-prone skin. Order now for free delivery in Kathmandu and Lalitpur.`	`Get glowing skin with our new range of organic face masks made from Nepali turmeric and local honey. Each mask is handcrafted in Pokhara and costs only NPR 500, with a 100% money-back guarantee. These masks are perfect for a weekly pampering session and come in eco-friendly packaging.`

Loss: CachedMultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "mini_batch_size": 32,
    "gather_across_devices": false,
    "directions": [
        "query_to_doc"
    ],
    "partition_mode": "joint",
    "hardness_mode": "hard_negatives",
    "hardness_strength": 5
}

cross_lingual

Dataset: cross_lingual at 7efcacf
Size: 1,600 evaluation samples
Columns: source_text and text
Approximate statistics based on the first 100 samples:
source_text text
type string string

modality text text
details
min: 26 tokens
mean: 41.56 tokens
max: 67 tokens

min: 16 tokens
mean: 46.09 tokens
max: 79 tokens

	source_text	text
type	string	string
modality	text	text
details	min: 26 tokens mean: 41.56 tokens max: 67 tokens	min: 16 tokens mean: 46.09 tokens max: 79 tokens

Samples:

source_text	text
`माध्यमिक शिक्षा परीक्षा (एसईई) को नतिजा आज साँझ सार्वजनिक हुँदैछ। करिब ५ लाख १४ हजार विद्यार्थीहरूले परीक्षा दिएका थिए।`	`माध्यमिक शिक्षा परीक्षा (एसईई) को नतिजा आज साँझ public हुँदैछ। करिब ५ लाख १४ हजार studentsहरूले exam दिएका थिए।`
`देशभर मनसुनी वायुको प्रभावले आंशिकदेखि सामान्य बदली रहने र केहि प्रदेशहरूमा वर्षा र हिमपातको सम्भावना रहेको छ।`	`desh bhar ma mansuni vayu ko prabhawle aanshik dekhi samanya badli rahne ra kehi pradhesh haru ma barsha ra himpat ko sambhavana xa.`
`नेपाल उद्योग वाणिज्य महासङ्घका अध्यक्ष चन्द्रप्रसाद ढकालले स्पेनका व्यवसायीलाई नेपालमा लगानी गर्न आग्रह गरेका छन्, विशेष गरी पर्यटन, ऊर्जा, कृषि तथा पूर्वाधार क्षेत्रमा।`	`Nepal Udyog Vanijya Mahasanghka adhyakshya Chandraprasad Dhakal le Spainka byabasayilaai Nepalma lagani garna agrah gareka xan, vishesh gari paryatan, urja, krishi tatha purwadhar kshetrama.`

Loss: MultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "gather_across_devices": false,
    "directions": [
        "query_to_doc",
        "doc_to_query"
    ],
    "partition_mode": "per_direction",
    "hardness_mode": null,
    "hardness_strength": 0.0
}

sanoir_general

Dataset: sanoir_general at 7e53250
Size: 553 evaluation samples
Columns: query, positive, negative_1, negative_2, negative_3, and negative_4

Approximate statistics based on the first 100 samples:

	query	positive	negative_1	negative_2	negative_3	negative_4
type	string	string	string	string	string	string
modality	text	text	text	text	text	text
details	min: 13 tokens mean: 35.4 tokens max: 71 tokens	min: 15 tokens mean: 79.82 tokens max: 153 tokens	min: 17 tokens mean: 65.24 tokens max: 95 tokens	min: 13 tokens mean: 56.26 tokens max: 91 tokens	min: 16 tokens mean: 53.84 tokens max: 85 tokens	min: 12 tokens mean: 53.05 tokens max: 84 tokens

Samples:

query	positive	negative_1	negative_2	negative_3	negative_4
`कुवेत जाने नयाँ कामदारको लागि दूतावासबाट जारी हुने अनिवार्य प्रमाणपत्र कुन हो र यसको आवेदन दिने अन्तिम मिति र चाहिने कागजात के के हुन्?`	वैदेशिक रोजगारी सम्बन्धी आधिकारिक म्यानुअल अनुसार, कुवेत जाने नयाँ कामदारले दूतावासबाट जारी गरिने 'वर्क एग्रिमेन्ट सर्टिफिकेट' लिनु अनिवार्य छ। यो प्रमाणपत्र लिन २०८१ साल असार मसान्तभित्र आवेदन दिनुपर्छ। आवश्यक कागजातमा नियुक्ति पत्र, पासपोर्ट र मेडिकल रिपोर्ट पर्छन्। प्रमाणपत्र नभएमा कामदारलाई रोजगारदाताले कुवेतमा प्रवेश दिन पाउँदैन।	वैदेशिक रोजगारीमा जाने कामदारले के.वाई.सी. प्रमाणपत्र लिनुपर्छ भनी बैंक सञ्चालन म्यानुअलमा उल्लेख छ। यसअनुसार कामदारले आफ्नो बैंक खाता खोल्दा मात्र नागरिकता र पासपोर्ट देखाउनु पर्याप्त हुन्छ। के.वाई.सी. ले कामदारको विदेशी रोजगारदातासँगको सम्बन्ध जाँच्दैन। यो प्रक्रिया रेमिट्यान्स पठाउन अनिवार्य छैन।	सिफाली उद्यमशीलता तालिम केन्द्रले २०८० सालमि सञ्चालन गरेको ६ हप्ते बेकरी तालिममा ४५ जना सहभागीले सफलतापूर्वक समापन गरे। तालिममा व्यावसायिक योजना, खुद्रा बजार विश्लेषण र पकाउने प्रविधि सिकाइयो। केन्द्रका अनुसार तालिमपछि ३० जनाले स्थानीय पसल खोले।	वैदेशिक रोजगारीबाट फर्केका कामदारका लागि पुनः एकीकरण मार्गदर्शिकामा भनिएको छ कि नेपाल फर्किएपछि पहिलो ९० दिनभित्र कामदारले स्वास्थ्य बीमा दाबी गर्न सक्छ। यसमा व्यावसायिक सीप मूल्याङ्कन वा रोजगार कार्यालय दर्ताको प्रक्रिया समावेश छैन।	वैदेशिक रोजगारीमा जान चाहने नयाँ कामदारले दूतावासबाट प्राप्त गर्ने प्रमाणपत्र 'भिसा अनुमोदन पत्र' हो जुन काजस्थानमा मात्र लागू हुन्छ। यसका लागि कामदारले आफ्नो नियुक्ति पत्र र मेडिकल रिपोर्ट पेस गर्नुपर्छ। यो प्रमाणपत्र रोजगारदाताले जारी गर्दैन।
`वित्तीय वर्ष २०८१ देखि प्रदेश सरकारको पोर्टलबाट प्रादेशिक न्यायिक सहायता कोषमा अनलाइन आवेदन दिन मिल्ने नीति कुन हो?`	नीति सूचना: प्रादेशिक न्यायिक सहायता कोषको लागि नागरिकले अनलाइन माध्यमबाट दरखास्त दिन पाउने व्यवस्था वित्तीय वर्ष २०८१ बाट लागू भएको छ। यस अन्तर्गत आवेदकले सम्बन्धित प्रदेश सरकारको आधिकारिक पोर्टलमार्फत निवेदन पेश गर्न सक्नेछन्।	स्थानीय निकायले जारी गरेको नीति सूचना: वित्तीय वर्ष २०८१ मा प्रादेशिक न्यायिक सहायता कोषको लागि छुट्ट्याइएको बजेट ४ करोड रुपैयाँ थियो। यस्तो रकम केन्द्रीय कोषभन्दा फरक छ। आवेदकले प्रदेश सरकारको पोर्टलबाट मात्र निवेदन दिनुपर्ने व्यवस्था गरिएको छ।	नीति सूचना: नागरिकले प्रादेशिक न्यायिक सहायता कोषबाट सहायता लिन केन्द्रीय कार्यालयमा उपस्थित हुनुपर्छ भन्ने व्यवस्था खारेज गरिएको छ। अब सेवा भौतिक रूपमा मात्र उपलब्ध हुनेछ, अनलाइन प्रणाली लागू हुँदैन।	`कार्यविधि सूचना: प्रादेशिक न्यायिक सहायता कोषको लागि दरखास्त दिने अनलाइन माध्यम वित्तीय वर्ष २०८२ देखि लागू हुने गरी तयार गरिएको छ। हाललाई कागजी निवेदन मात्र मान्य हुन्छ।`	नीति सूचना: केन्द्रीय न्यायिक सहायता कोषको लागि अनलाइन आवेदन प्रणाली वित्तीय वर्ष २०८१ बाट सञ्चालनमा आएको छ। प्रादेशिक कोषभन्दा फरक रूपमा केन्द्रीय पोर्टलबाट नै दरखास्त दिनुपर्ने व्यवस्था छ।
`How can people of foreign origin obtain Nepali citizenship?`	`विदेशी मूलका व्यक्तिहरूले नेपालको नागरिकता प्राप्त गर्ने कानुनी व्यवस्था के छ?`	`नेपालको नयाँ नागरिकता कानुन अनुसार, विदेशी नागरिकले नेपाली नागरिकता प्राप्त गर्नका लागि कुन प्रक्रिया अपनाउनुपर्छ?`	`के विदेशी नागरिकहरूले नेपालमा स्थायी बसोबास प्राप्त गरेपछि मात्र नागरिकताको आवेदन दिन पाउँछन्?`	`नेपाली नागरिकता प्राप्त गर्नका लागि कुन प्रकारका कागजातहरू पेश गर्न आवश्यक पर्दछ?`	`नेपाल सरकारले विदेशी नागरिकता त्याग्ने प्रक्रियालाई कसरी सरल बनाउने नीति ल्याएको छ?`

Loss: CachedMultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim",
    "mini_batch_size": 32,
    "gather_across_devices": false,
    "directions": [
        "query_to_doc"
    ],
    "partition_mode": "joint",
    "hardness_mode": null,
    "hardness_strength": 0.0
}

Training Hyperparameters

Non-Default Hyperparameters

per_device_train_batch_size: 128
num_train_epochs: 7.0
learning_rate: 0.0001
warmup_steps: 0.1
bf16: True
tf32: True
torch_compile: True
torch_compile_backend: inductor
load_best_model_at_end: True
dataloader_num_workers: 2
dataloader_pin_memory: False
dataloader_persistent_workers: True
dataloader_prefetch_factor: 2
prompts: {'title_excerpt': {'title': 'query: ', 'excerpt': 'query: '}, 'ne_en': {'title': 'query: ', 'translation': 'query: '}, 'excerpt_paraphrase': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'nepali_triplets': {'sentence': 'query: ', 'positive_sentence': 'query: ', 'negative_sentence': 'query: '}, 'stsb_translation_1': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'stsb_translation_2': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'stsb_en': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'stsb_ne': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'stsb_en_ne': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'stsb_ne_en': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'nepali_qa_9k': {'question': 'query: ', 'answer': 'passage: '}, 'ecommerce': {'query': 'query: ', 'document': 'passage: ', 'negative1': 'passage: ', 'negative2': 'passage: ', 'negative3': 'passage: '}, 'nepali_nli_20k': {'hypothesis': 'query: ', 'premise': 'query: '}, 'sanoir_general': {'query': 'query: ', 'positive': 'passage: ', 'negative_1': 'passage: ', 'negative_2': 'passage: ', 'negative_3': 'passage: ', 'negative_4': 'passage: '}}
batch_sampler: no_duplicates

All Hyperparameters

Click to expand

per_device_train_batch_size: 128
num_train_epochs: 7.0
max_steps: -1
learning_rate: 0.0001
lr_scheduler_type: linear
lr_scheduler_kwargs: None
warmup_steps: 0.1
optim: adamw_torch_fused
optim_args: None
weight_decay: 0.0
adam_beta1: 0.9
adam_beta2: 0.999
adam_epsilon: 1e-08
optim_target_modules: None
gradient_accumulation_steps: 1
average_tokens_across_devices: True
max_grad_norm: 1.0
label_smoothing_factor: 0.0
bf16: True
fp16: False
bf16_full_eval: False
fp16_full_eval: False
tf32: True
gradient_checkpointing: False
gradient_checkpointing_kwargs: None
torch_compile: True
torch_compile_backend: inductor
torch_compile_mode: None
use_liger_kernel: False
liger_kernel_config: None
use_cache: False
neftune_noise_alpha: None
torch_empty_cache_steps: None
auto_find_batch_size: False
log_on_each_node: True
logging_nan_inf_filter: True
include_num_input_tokens_seen: no
log_level: passive
log_level_replica: warning
disable_tqdm: False
project: huggingface
trackio_space_id: None
trackio_bucket_id: None
trackio_static_space_id: None
per_device_eval_batch_size: 8
prediction_loss_only: True
eval_on_start: False
eval_do_concat_batches: True
eval_use_gather_object: False
eval_accumulation_steps: None
include_for_metrics: []
batch_eval_metrics: False
save_only_model: False
save_on_each_node: False
enable_jit_checkpoint: False
push_to_hub: False
hub_private_repo: None
hub_model_id: None
hub_strategy: every_save
hub_always_push: False
hub_revision: None
load_best_model_at_end: True
ignore_data_skip: False
restore_callback_states_from_checkpoint: False
full_determinism: False
seed: 42
data_seed: None
use_cpu: False
accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
parallelism_config: None
dataloader_drop_last: False
dataloader_num_workers: 2
dataloader_pin_memory: False
dataloader_persistent_workers: True
dataloader_prefetch_factor: 2
remove_unused_columns: True
label_names: None
train_sampling_strategy: random
length_column_name: length
ddp_find_unused_parameters: None
ddp_bucket_cap_mb: None
ddp_broadcast_buffers: False
ddp_static_graph: None
ddp_backend: None
ddp_timeout: 1800
fsdp: None
fsdp_config: None
deepspeed: None
debug: []
skip_memory_metrics: True
do_predict: False
resume_from_checkpoint: None
warmup_ratio: None
local_rank: -1
prompts: {'title_excerpt': {'title': 'query: ', 'excerpt': 'query: '}, 'ne_en': {'title': 'query: ', 'translation': 'query: '}, 'excerpt_paraphrase': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'nepali_triplets': {'sentence': 'query: ', 'positive_sentence': 'query: ', 'negative_sentence': 'query: '}, 'stsb_translation_1': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'stsb_translation_2': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'stsb_en': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'stsb_ne': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'stsb_en_ne': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'stsb_ne_en': {'sentence1': 'query: ', 'sentence2': 'query: '}, 'nepali_qa_9k': {'question': 'query: ', 'answer': 'passage: '}, 'ecommerce': {'query': 'query: ', 'document': 'passage: ', 'negative1': 'passage: ', 'negative2': 'passage: ', 'negative3': 'passage: '}, 'nepali_nli_20k': {'hypothesis': 'query: ', 'premise': 'query: '}, 'sanoir_general': {'query': 'query: ', 'positive': 'passage: ', 'negative_1': 'passage: ', 'negative_2': 'passage: ', 'negative_3': 'passage: ', 'negative_4': 'passage: '}}
batch_sampler: no_duplicates
multi_dataset_batch_sampler: proportional
router_mapping: {}
learning_rate_mapping: {}

Training Logs

Epoch	Step	Training Loss	title excerpt loss	ne en loss	excerpt paraphrase loss	nepali triplets loss	stsb en loss	stsb ne loss	nepali qa 9k loss	ecommerce loss	cross lingual loss	sanoir general loss	multi_lang_news_ir_cosine_ndcg@10	en_news_ir_cosine_ndcg@10	ne_news_ir_cosine_ndcg@10	translation_mean_accuracy	stsb_en_spearman_cosine	stsb_ne_spearman_cosine	nepali_qa_9k_cosine_ndcg@10	nepali_query_passage_10k_cosine_ndcg@10	nepali_ecomm_cosine_ndcg@10	sanoir_general_cosine_ndcg@10
2.1004	2323	-	0.0039	0.0021	0.0000	0.0510	3.6856	4.6929	0.0312	0.2370	0.0018	0.0323	0.9535	0.9662	0.9496	0.9947	0.8546	0.7835	0.5488	0.7813	0.6819	0.8782
3.5	3871	0.8950	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
4.2007	4646	-	0.0044	0.0016	0.0000	0.0496	3.6801	4.5263	0.0299	0.3049	0.0024	0.0510	0.9581	0.9709	0.9530	0.9841	0.8606	0.7851	0.5840	0.7961	0.6763	0.8866
6.3011	6969	-	0.0046	0.0018	0.0000	0.0439	3.7092	4.3615	0.0325	0.1565	0.0015	0.0280	0.9280	0.9535	0.9208	0.9868	0.8638	0.7973	0.5980	0.7514	0.6990	0.8822
7.0	7742	0.6839	0.0045	0.0017	0.0000	0.0432	3.7097	4.2690	0.0321	0.1654	0.0015	0.0272	0.9307	0.9546	0.9222	0.9868	0.8638	0.7966	0.6025	0.7601	0.6949	0.8872

Training Time

Training: 50.9 minutes

Framework Versions

Python: 3.12.11
Sentence Transformers: 5.6.0
Transformers: 5.13.0
PyTorch: 2.10.0+cu128
Accelerate: 1.13.0
Datasets: 4.3.0
Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

CachedMultipleNegativesRankingLoss

@misc{gao2021scaling,
    title={Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup},
    author={Luyu Gao and Yunyi Zhang and Jiawei Han and Jamie Callan},
    year={2021},
    eprint={2101.06983},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

MultipleNegativesRankingLoss

@misc{günther2024jinaembeddings28192token,
      title={Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documents},
      author={Michael Günther and Jackmin Ong and Isabelle Mohr and Alaeddine Abdessalem and Tanguy Abel and Mohammad Kalim Akram and Susana Guzman and Georgios Mastrapas and Saba Sturua and Bo Wang and Maximilian Werk and Nan Wang and Han Xiao},
      year={2024},
      eprint={2310.19923},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2310.19923},
}

TripletLoss

@misc{hermans2017defense,
    title={In Defense of the Triplet Loss for Person Re-Identification},
    author={Alexander Hermans and Lucas Beyer and Bastian Leibe},
    year={2017},
    eprint={1703.07737},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}

CoSENTLoss

@article{10531646,
    author={Huang, Xiang and Peng, Hao and Zou, Dongcheng and Liu, Zhiwei and Li, Jianxin and Liu, Kay and Wu, Jia and Su, Jianlin and Yu, Philip S.},
    journal={IEEE/ACM Transactions on Audio, Speech, and Language Processing},
    title={CoSENT: Consistent Sentence Embedding via Similarity Ranking},
    year={2024},
    doi={10.1109/TASLP.2024.3402087}
}

Downloads last month: 65

Safetensors

Model size

0.1B params

Tensor type

F32

Model tree for jangedoo/sanolm-v1

Base model

intfloat/multilingual-e5-small

Finetuned

(183)

this model

Datasets used to train jangedoo/sanolm-v1

Papers for jangedoo/sanolm-v1

Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documents

Paper • 2310.19923 • Published Oct 30, 2023 • 15

Evaluation results

Cosine Accuracy@10 on multi lang news ir
self-reported

0.978
Cosine Precision@10 on multi lang news ir
self-reported

0.098
Cosine Precision@50 on multi lang news ir
self-reported

0.020
Cosine Recall@10 on multi lang news ir
self-reported

0.978
Cosine Recall@50 on multi lang news ir
self-reported

0.993
Cosine Ndcg@10 on multi lang news ir
self-reported

0.931
Cosine Mrr@10 on multi lang news ir
self-reported

0.915
Cosine Map@10 on multi lang news ir
self-reported

0.915