--- tags: - sentence-transformers - sentence-similarity - feature-extraction - dense - generated_from_trainer - dataset_size:284573 - loss:MultipleNegativesRankingLoss base_model: BAAI/bge-m3 widget: - source_sentence: durable plastic shed for garden supplies sentences: - 'stoney resin outdoor 4 ft. 4 in . w x 2 ft. 8 in . d plastic horizontal storage shed Sheds this handy horizontal storage shed can handle any and all of your outdoor organizational needs . ideal for storing garbage cans , lawn and garden products , snow blowers , bicycles , and more , this stylish storage solution is essential in every season . additional features include durable , multi-w doorstyle : double door|primarymaterial : plastic|countryoforigin : united states|shedtype : storage shed|roofstyle : pent|estimatedtimetosetup:30|countryoforigin-additionaldetails : made in usa|overallproductweight:76|interiorheight-toptobottom:43.5|color : gray|doorwidth-sidetoside:46.25|overallwi' - 'outdoor 4 ft. w x 2 ft. d plastic vertical tool shed Deck Boxes|Sheds this large vertical shed is designed to supply generous storage space for outdoor gear , tools , equipment , firewood , sporting goods , and more . it ''s fashioned with multi-wall resin and is outfitted with adjoining door handles to attach a padlock ( sold separately ) . to augment this unit with s coveragearea:11.23|estimatedtimetosetup:180|approximatedepth-fronttoback:3|windrating:65|overallwidth-sidetoside:53|interiorheight-toptobottom:69.5|overallheight-toptobottom:71.5|primarymaterial : plastic|shedtype : tool shed|overalldepth-fronttoback:32.5|color : mustang brown|countryoforigin-additi' - 'suncast golf organizer in black Bike And Sport Racks when it comes to the great outdoors and engaging in such sporting activities as golf , an organizer is just right to keep those accessories in place . it is sure to become your best friend when out playing on the links . producttype : sports rack|finish : black|compatiblebike : |overallheight-toptobottom:37|overallwidth-sidetoside:32|overallproductweight:38.15|mounttype : wall mounted|overalldepth-fronttoback:16|holdingcapacity:2|hooksincluded : no|multi-use : no|installationrequired : yes|productwarranty : yes|adju' - source_sentence: large standing mirror for living room sentences: - 'bar serving cart Patio Bar Sets time to grill but do n''t have enough space to set everything nearby ? forget running back and forth into the house and simply open up the portable outdoor patio serving station table and cabinet . great for entertaining and dining al fresco . this suncast serving station patio cabinet has a lot of s overallproductweight:20|interiorcabinetdepth-fronttoback:19|outerframematerial : plastic|producttype : bar cart|weightcapacity:30|cabinetinteriorheight-toptobottom:11|countertopmaterialdetails : polypropelene|countryoforigin : united states|overallheight-toptobottom:34|overalldepth-fronttoback:22|du' - 'kori industrial metal wall mirror Wall & Accent Mirrors mimicking the look of exposed pipes , this mirror brings industrial style to your living room , bedroom , or guest room . it ''s crafted from iron and awash in a slate gray finish that complements any color palette . this rugged piece showcases slight distressed detailing for a weathered look , and a countryoforigin-additionaldetails : made in china|mirrorheight-toptobottom:29|shape : rectangle|additionaltoolsrequirednotincluded : hammer|installationtypedetails : keyhole|mirrorfinishes : beveled|surfaceshape : flat|orientation : horizontal and vertical|framefinish : distressed slate gray|lsbinve' - 'wyrick on the door full length mirror Wall & Accent Mirrors this high-quality mirror complements your decor without the need for unsightly `` over the door '''' brackets . viewing area , it gives you a full image either on the back of a door or on the wall as a standard full-length mirror . glassthickness:0.141732|installationtypedetails : d rings|silvercontent : silver|framematerialdetails : polystyrene|dampdryorwetlocationlisted : dry|countryoforigin : united states|mirrorwidth-sidetoside:14|frameconstruction : closed corner frame|mirrormaterial : glass|holidayoccasion : no holiday|o' - source_sentence: sleek contemporary coffee table for tidy living space sentences: - 'kalmus coffee table marrying modern and glamorous elements , this coffee table sets a sleek and chic foundation in your living room layout . crafted with a metal frame with a metallic and glossy finish , this piece features a mirrored glass top that provides a place to set down a spread of snacks , a stack of magazines basematerial : nickel|basetype:4 legs|dsmetallic : nickel|topcolor : black|producttype : coffee table|topshape : round|weightcapacity:30|dssecondaryproductstyle : contemporary industrial|overallheight-toptobottom:17|topmaterial : glass|basecolor : black|overallproductweight:22|topdesign : glass|over' - 'pangburn haven all-weather outdoor recliner patio chair with cushions and ottoman Patio Lounge Chairs this gorgeous set of two outdoor recliners with matching ottomans mean you and your pal can sit back and relax in style on your porch or patio . all-weather wicker and weather-resistant cushions will provide comfort and a fresh update to your outdoor living space . simply pull on the lever and the s cushionfillmaterialdetails : polyurethane foam and polyester fiber batting|overallheight-toptobottom:43.75|design : armchair|cushioncolor : dark gray|overalldepth-fronttoback:26.75|cushioncovermaterial : polyester/polyester blend|levelofassembly : full assembly needed|ottomanheight-toptobottom:17|fr' - 'plascencia coffee table with storage Coffee & Cocktail Tables bring mid-century modern design to your home with the storage coffee table . this rectangle coffee table is the answer to keeping communal space tidy , without sacrificing style . the hidden storage space is perfect for stowing away books , or mail during your next get together . the wood coffee tab dssecondaryproductstyle : mid-century modern|warrantylength:1 year|basemetalfinishapplication : powder coated|overallproductweight:40.35|basecolor : walnut|overalllength-endtoend:39.76|dsprimaryproductstyle : modern|producttype : coffee table|weightcapacity:100|basematerialdetails : mdf and melamine' - source_sentence: durable plastic storage bench for garden sentences: - 'wicker 22 gallon resin/plastic storage bench Deck Boxes this wicker resin storage container from suncast is an attractive and highly versatile solution for use throughout your home and yard . the chest design and hinged lid allow for easy access to your tools and accessories stored inside . with a holding capacity of 22 gallons ( 17 '''' d x 22 '''' w 20.5 '' storagecapacity:22|estimatedtimetosetup:20|additionaltoolsrequirednotincluded : screw driver|topstyle : flat| : waterproof|topweightcapacity:150|levelofassembly : full assembly needed|overallproductweight:9.8|countryoforigin : united states|color : java|primarymaterial : resin|countryoforigin-additi' - 'galaz console table - rustic black a demi lune shape and scalloped edge make this console table a stunning addition to a foyer or entryway . it comes with tapered legs and a bold rustic black finish that goes with anything . made of iron , it will withstand the test of time , and its low profile aesthetic will ensure it fits in with overallwidth-sidetoside:35.4|overallproductweight:26.8|basecolor : rustic black|basematerialdetails:100 % iron|topshape : rectangle|overallheight-toptobottom:29.5|levelofassembly : none|topcolor : rustic black|overalldepth-fronttoback:15.7|basetype : pedestal|glossfinish : no|cablemanagement : no|ca' - 'plastic deck storage box Deck Boxes elegant and functional , the lifetime 116 gallon plastic deck storage box is an excellent addition to your patio or deck . made from high-quality plastic , this storage box is strong and durable . it is enameled with a brown finish . it has a storage capacity of 116 gallons and gives enough space fo levelofassembly : partial assembly|warrantylength:10 years|topweightcapacity:600|dswoodtone : gray wood|additionaltoolsrequirednotincluded : ratchet|interiorwidth-sidetoside:47|primarymaterial : plastic|overallheight-toptobottom:26|overallwidth-sidetoside:50.3|storagecapacity:116|interiorheight-topt' - source_sentence: compact garage storage shed under 3 feet wide sentences: - 'garden plastic/metal storage shed Sheds easily add storage space and value to your property with an outdoor garden shed . the metal shed has distinct advantages over traditional wooden models that make it a much more attractive choice for purchase . a metal shed is more affordable and being pre-fabricated significantly cuts down on expens dsmetallic : steel|shedtype : storage shed|color : grey|construction : traditional|overallheight-toptobottom:75.5|countryoforigin-additionaldetails : made in china|warrantylength:1 year|levelofassembly : full assembly needed|overallwidth-sidetoside:126.75|overalldepth-fronttoback:109|overallproductw' - 'outdoor 2 ft. 9 in . w x 2 ft. d plastic vertical tool shed Sheds with its tall profile , this 22 cubic foot vertical shed is great for storing ladders , long-handled tools , garden accessories , and more when space is at a premium . the durable , all-weather resin construction provides water resistance and uv protection , while the multi-wall panels are engineere interiorwidth-sidetoside:27|interiorheight-toptobottom:69|compatibleshelfpartnumber : xa1182|windrating:65|overallwidth-sidetoside:33|countryoforigin : united states|interiordepth-fronttoback:20.25|levelofassembly : full assembly needed|countryoforigin-additionaldetails : made in usa|doorwidth-sidet' - 'foulds 11.5 '''' wall clock Wall Clocks large , glow-in-the-dark numbers make this clock easy to read , even at night ! with attractive styling , the wall clock features a round face with luminous numbers that glow automatically when the lights are off . overallheight-toptobottom:11.5|overallwidth-sidetoside:11.5|operatingmechanism : mechanical|dsprimaryproductstyle : modern|shape : round|dssecondaryproductstyle : transitional modern|theme : no theme|timedisplay : analog : numerical|specialfeatures : none|overalldepth-fronttoback:1.75|supplierintend' pipeline_tag: sentence-similarity library_name: sentence-transformers --- # SentenceTransformer based on BAAI/bge-m3 This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [BAAI/bge-m3](https://huggingface.co/BAAI/bge-m3). It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, classification, clustering, and more. ## Model Details ### Model Description - **Model Type:** Sentence Transformer - **Base model:** [BAAI/bge-m3](https://huggingface.co/BAAI/bge-m3) - **Maximum Sequence Length:** 8192 tokens - **Output Dimensionality:** 1024 dimensions - **Similarity Function:** Cosine Similarity - **Supported Modality:** Text ### Model Sources - **Documentation:** [Sentence Transformers Documentation](https://sbert.net) - **Repository:** [Sentence Transformers on GitHub](https://github.com/huggingface/sentence-transformers) - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers) ### Full Model Architecture ``` SentenceTransformer( (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}}, 'module_output_name': 'token_embeddings', 'architecture': 'XLMRobertaModel'}) (1): Pooling({'embedding_dimension': 1024, 'pooling_mode': 'cls', 'include_prompt': True}) (2): Normalize({}) ) ``` ## Usage ### Direct Usage (Sentence Transformers) First install the Sentence Transformers library: ```bash pip install -U sentence-transformers ``` Then you can load this model and run inference. ```python from sentence_transformers import SentenceTransformer # Download from the 🤗 Hub model = SentenceTransformer("sentence_transformers_model_id") # Run inference sentences = [ 'compact garage storage shed under 3 feet wide', 'outdoor 2 ft. 9 in . w x 2 ft. d plastic vertical tool shed Sheds with its tall profile , this 22 cubic foot vertical shed is great for storing ladders , long-handled tools , garden accessories , and more when space is at a premium . the durable , all-weather resin construction provides water resistance and uv protection , while the multi-wall panels are engineere interiorwidth-sidetoside:27|interiorheight-toptobottom:69|compatibleshelfpartnumber : xa1182|windrating:65|overallwidth-sidetoside:33|countryoforigin : united states|interiordepth-fronttoback:20.25|levelofassembly : full assembly needed|countryoforigin-additionaldetails : made in usa|doorwidth-sidet', 'garden plastic/metal storage shed Sheds easily add storage space and value to your property with an outdoor garden shed . the metal shed has distinct advantages over traditional wooden models that make it a much more attractive choice for purchase . a metal shed is more affordable and being pre-fabricated significantly cuts down on expens dsmetallic : steel|shedtype : storage shed|color : grey|construction : traditional|overallheight-toptobottom:75.5|countryoforigin-additionaldetails : made in china|warrantylength:1 year|levelofassembly : full assembly needed|overallwidth-sidetoside:126.75|overalldepth-fronttoback:109|overallproductw', ] embeddings = model.encode(sentences) print(embeddings.shape) # [3, 1024] # Get the similarity scores for the embeddings similarities = model.similarity(embeddings, embeddings) print(similarities) # tensor([[1.0000, 0.5560, 0.5587], # [0.5560, 1.0000, 0.5424], # [0.5587, 0.5424, 1.0000]]) ``` ## Training Details ### Training Dataset #### Unnamed Dataset * Size: 284,573 training samples * Columns: anchor, positive, and negative * Approximate statistics based on the first 100 samples: | | anchor | positive | negative | |:---------|:---------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------| | type | string | string | string | | modality | text | text | text | | details | | | | * Samples: | anchor | positive | negative | |:------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | modern 10 inch semi-flush mount light for entryway | bucholz 1 -light 10 '' semi flush mount Flush Mount Lighting this 1-light semi-flush mount has a sleek , streamlined shape that gives a modern look to your hallway , entryway , or over your dining room table . it has a metal frame and downrod , and an egg-shaped glass shade with an opening at the bottom for light to shine through . the downrod retracts and ro shadematerial : glass\|dry , damporwetlocationlisted : dry\|whatisdrydamporwetlocationlisted : this indicates whether the fixture is safe to use in dry locations , damp locations ( moist environments ) , or wet locations ( direct exposure to water ) .\|estimatedtimetosetup:5\|bodyheight-toptobottom:10\|w | weatherford 1 - light 10 '' semi flush mount Flush Mount Lighting marrying modern minimalism and factory flair , this understated one-light flush mount brings a splash of industrial style as it shines a light down on your space . crafted of metal , this fixture features a round canopy and a conical shade with its upper portion left open to provide a peek at the so canopywidth-sidetoside:4.875\|recommendedbulbshapecode : a19\|warrantylength:1 year\|canopydepth-fronttoback:0.75\|powersource : hardwired\|dssecondaryproductstyle : nautical\|canopyheight-toptobottom:4.875\|recommendedbulbshape : standard\|producttype : flush mount\|whatisullisted : the underwriters laborat | | sleek glass pendant light for dining room | bucholz 1 -light 10 '' semi flush mount Flush Mount Lighting this 1-light semi-flush mount has a sleek , streamlined shape that gives a modern look to your hallway , entryway , or over your dining room table . it has a metal frame and downrod , and an egg-shaped glass shade with an opening at the bottom for light to shine through . the downrod retracts and ro shadematerial : glass\|dry , damporwetlocationlisted : dry\|whatisdrydamporwetlocationlisted : this indicates whether the fixture is safe to use in dry locations , damp locations ( moist environments ) , or wet locations ( direct exposure to water ) .\|estimatedtimetosetup:5\|bodyheight-toptobottom:10\|w | 6 '' h glass sphere pendant shade ( screw on ) in smoke color : smoke\|shape : sphere\|overallproductweight:0.67\|overalldepth-fronttoback:6\|theme : no theme\|attachmenttype : screw on\|style : modern & contemporary\|overallwidth-sidetoside:6\|fittersize:3.25\|producttype : pendant shade\|primarymaterial : glass\|overallheight-toptobottom:6\| : no\|fitterincluded : | | small metal frame flush mount light with glass shade | bucholz 1 -light 10 '' semi flush mount Flush Mount Lighting this 1-light semi-flush mount has a sleek , streamlined shape that gives a modern look to your hallway , entryway , or over your dining room table . it has a metal frame and downrod , and an egg-shaped glass shade with an opening at the bottom for light to shine through . the downrod retracts and ro shadematerial : glass\|dry , damporwetlocationlisted : dry\|whatisdrydamporwetlocationlisted : this indicates whether the fixture is safe to use in dry locations , damp locations ( moist environments ) , or wet locations ( direct exposure to water ) .\|estimatedtimetosetup:5\|bodyheight-toptobottom:10\|w | 3 - light semi flush mount Flush Mount Lighting\|Commercial Ceiling Lighting it is perfect to transform your dining room or entryway with this charming transitional flush mount ceiling light . bodydepth-fronttoback:16.1\|producttype : semi flush mount\|recommendedbulbshape : candle\|bodydepth-fronttoback:12.2\|lightdirection : up\|warrantylength:2 years\|dssecondaryproductstyle : classic glam\|dsprimaryproductstyle : glam\|fixturedesign : unique/statement\|craftsmanshiptype : handcrafted / hand-fo | * Loss: [MultipleNegativesRankingLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters: ```json { "scale": 20.0, "similarity_fct": "cos_sim", "gather_across_devices": false, "directions": [ "query_to_doc" ], "partition_mode": "joint", "hardness_mode": null, "hardness_strength": 0.0 } ``` ### Evaluation Dataset #### Unnamed Dataset * Size: 14,978 evaluation samples * Columns: anchor, positive, and negative * Approximate statistics based on the first 100 samples: | | anchor | positive | negative | |:---------|:----------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------| | type | string | string | string | | modality | text | text | text | | details | | | | * Samples: | anchor | positive | negative | |:--------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | quirky rooster shelf sitters | 4 piece rooster shelf sitter figurine set Decorative Objects add these colorful rooster sitters to shelves , windowsills , and more throughout your home . the set includes four hand-painted roosters with delightful floral accents . each cute sitter has dangling legs and plenty of charm . overallwidth-sidetoside:1.63\|geometricshapes : no geometric & shapes\|producttype : figurine\|subject : animals\|nature : no nature\|spiritualreligious : no spiritual & religious\|structuresbuildings : no structures & buildings\|wordstext : no words & text\|overallproductweight:0.25\|quantity:4\|entertainmen | dunellen farmhouse rooster 2 piece figurine set Decorative Objects be the early bird in grabbing these farmhouse silver metal and wood rooster sculpture by the head and complete your farmhouse set up now . this 2-piece set features two small and medium standing rooster sculptures with a gray finish on the body , and silver on the rest . this will look great as a ce overallwidth-sidetoside:13\|color : brown , silver\|purposefuldistressingtype : distressed metal\|style : farmhouse / country\|overallheight-toptobottom:5.1\|fantasysci-fi : no fantasy & sci-fi\|overallheight-toptobottom:16\|nature : no nature\|geometricshapes : no geometric & shapes\|spiritualreligious : no | | decorative rooster figurines with floral accents | 4 piece rooster shelf sitter figurine set Decorative Objects add these colorful rooster sitters to shelves , windowsills , and more throughout your home . the set includes four hand-painted roosters with delightful floral accents . each cute sitter has dangling legs and plenty of charm . overallwidth-sidetoside:1.63\|geometricshapes : no geometric & shapes\|producttype : figurine\|subject : animals\|nature : no nature\|spiritualreligious : no spiritual & religious\|structuresbuildings : no structures & buildings\|wordstext : no words & text\|overallproductweight:0.25\|quantity:4\|entertainmen | 2 piece metal figurine set Decorative Objects the antique style of these two metal rooster decors will bring a fascinating appeal to any rustic , vintage , or antique accent table . with its iron construction , these rooster sculptures will continue to enhance the look of your home interior for years to come . featuring a decorative rustic bron geometricshapes : no geometric & shapes\|spiritualreligious : no spiritual & religious\|overallwidth-sidetoside:20.47\|producttype : figurine\|nature : no nature\|foodbeverage : no food & beverage\|fantasysci-fi : no fantasy & sci-fi\|people : no people\|agegroup : adult\|animals : rooster\|overallproductweig | | comfortable anti-fatigue mat for kitchen counter | catrisha soothing foam comfort anti-fatigue mat Kitchen Mats this anti-fatigue mat provides a full inch of soothing foam comfort for your tired feet . perfect in front of a kitchen counter and has a skid-resistant backing . color : red\|pattern : solid color\|backingmaterial : polyester\|color : brown\|shape : rectangle\|supplierintendedandapproveduse : non residential use\|productcare : machine washable\|construction : machine made\|color : blue\|dssecondaryproductstyle : transitional modern\|overalllength-endtoend:30\|color : g | grano hello standing anti-fatigue mat Kitchen Mats use this mat in any part of your home . whether it be the kitchen , laundry room , bathroom , or doorway this elegant mat will bring luscious texture , enduring material , and comfortable steps for your convenience . this perfectly crafted pvc mat is joined with a rubber backing for long-lasting usa pattern : no pattern and not solid color\|overalllength-endtoend:30\|overalllength-endtoend:47\|overallproductweight:2.09\|holidayoccasion : no holiday\|dssecondaryproductstyle : modern farmhouse\|overallheight-toptobottom:0.47\|material : synthetics\|theme : text\|materialdetails:100 % pvc\|overallwidth-side | * Loss: [MultipleNegativesRankingLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters: ```json { "scale": 20.0, "similarity_fct": "cos_sim", "gather_across_devices": false, "directions": [ "query_to_doc" ], "partition_mode": "joint", "hardness_mode": null, "hardness_strength": 0.0 } ``` ### Training Hyperparameters #### Non-Default Hyperparameters - `per_device_train_batch_size`: 64 - `num_train_epochs`: 1 - `learning_rate`: 2e-05 - `warmup_steps`: 0.1 - `bf16`: True - `per_device_eval_batch_size`: 64 - `dataloader_num_workers`: 4 #### All Hyperparameters
Click to expand - `per_device_train_batch_size`: 64 - `num_train_epochs`: 1 - `max_steps`: -1 - `learning_rate`: 2e-05 - `lr_scheduler_type`: linear - `lr_scheduler_kwargs`: None - `warmup_steps`: 0.1 - `optim`: adamw_torch_fused - `optim_args`: None - `weight_decay`: 0.0 - `adam_beta1`: 0.9 - `adam_beta2`: 0.999 - `adam_epsilon`: 1e-08 - `optim_target_modules`: None - `gradient_accumulation_steps`: 1 - `average_tokens_across_devices`: True - `max_grad_norm`: 1.0 - `label_smoothing_factor`: 0.0 - `bf16`: True - `fp16`: False - `bf16_full_eval`: False - `fp16_full_eval`: False - `tf32`: None - `gradient_checkpointing`: False - `gradient_checkpointing_kwargs`: None - `torch_compile`: False - `torch_compile_backend`: None - `torch_compile_mode`: None - `use_liger_kernel`: False - `liger_kernel_config`: None - `use_cache`: False - `neftune_noise_alpha`: None - `torch_empty_cache_steps`: None - `auto_find_batch_size`: False - `log_on_each_node`: True - `logging_nan_inf_filter`: True - `include_num_input_tokens_seen`: no - `log_level`: passive - `log_level_replica`: warning - `disable_tqdm`: False - `project`: huggingface - `trackio_space_id`: None - `trackio_bucket_id`: None - `trackio_static_space_id`: None - `per_device_eval_batch_size`: 64 - `prediction_loss_only`: True - `eval_on_start`: False - `eval_do_concat_batches`: True - `eval_use_gather_object`: False - `eval_accumulation_steps`: None - `include_for_metrics`: [] - `batch_eval_metrics`: False - `save_only_model`: False - `save_on_each_node`: False - `enable_jit_checkpoint`: False - `push_to_hub`: False - `hub_private_repo`: None - `hub_model_id`: None - `hub_strategy`: every_save - `hub_always_push`: False - `hub_revision`: None - `load_best_model_at_end`: False - `ignore_data_skip`: False - `restore_callback_states_from_checkpoint`: False - `full_determinism`: False - `seed`: 42 - `data_seed`: None - `use_cpu`: False - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None} - `parallelism_config`: None - `dataloader_drop_last`: False - `dataloader_num_workers`: 4 - `dataloader_pin_memory`: True - `dataloader_persistent_workers`: False - `dataloader_prefetch_factor`: None - `remove_unused_columns`: True - `label_names`: None - `train_sampling_strategy`: random - `length_column_name`: length - `ddp_find_unused_parameters`: None - `ddp_bucket_cap_mb`: None - `ddp_broadcast_buffers`: False - `ddp_static_graph`: None - `ddp_backend`: None - `ddp_timeout`: 1800 - `fsdp`: None - `fsdp_config`: None - `deepspeed`: None - `debug`: [] - `skip_memory_metrics`: True - `do_predict`: False - `resume_from_checkpoint`: None - `warmup_ratio`: None - `local_rank`: -1 - `prompts`: None - `batch_sampler`: batch_sampler - `multi_dataset_batch_sampler`: proportional - `router_mapping`: {} - `learning_rate_mapping`: {}
### Training Logs | Epoch | Step | Training Loss | Validation Loss | |:------:|:----:|:-------------:|:---------------:| | 0.0225 | 100 | 1.1596 | - | | 0.0450 | 200 | 0.6243 | - | | 0.0675 | 300 | 0.5484 | - | | 0.0899 | 400 | 0.4963 | - | | 0.1124 | 500 | 0.4665 | 0.4796 | | 0.1349 | 600 | 0.4426 | - | | 0.1574 | 700 | 0.4353 | - | | 0.1799 | 800 | 0.4284 | - | | 0.2024 | 900 | 0.4111 | - | | 0.2249 | 1000 | 0.3946 | 0.4274 | | 0.2474 | 1100 | 0.3883 | - | | 0.2698 | 1200 | 0.3806 | - | | 0.2923 | 1300 | 0.3590 | - | | 0.3148 | 1400 | 0.3661 | - | | 0.3373 | 1500 | 0.3632 | 0.4086 | | 0.3598 | 1600 | 0.3717 | - | | 0.3823 | 1700 | 0.3517 | - | | 0.4048 | 1800 | 0.3428 | - | | 0.4273 | 1900 | 0.3574 | - | | 0.4497 | 2000 | 0.3412 | 0.3882 | | 0.4722 | 2100 | 0.3340 | - | | 0.4947 | 2200 | 0.3356 | - | | 0.5172 | 2300 | 0.3261 | - | | 0.5397 | 2400 | 0.3358 | - | | 0.5622 | 2500 | 0.3208 | 0.3833 | | 0.5847 | 2600 | 0.3206 | - | | 0.6072 | 2700 | 0.3254 | - | | 0.6296 | 2800 | 0.3215 | - | | 0.6521 | 2900 | 0.3082 | - | | 0.6746 | 3000 | 0.3099 | 0.3684 | | 0.6971 | 3100 | 0.3060 | - | | 0.7196 | 3200 | 0.3009 | - | | 0.7421 | 3300 | 0.3021 | - | | 0.7646 | 3400 | 0.3163 | - | | 0.7870 | 3500 | 0.3020 | 0.3652 | | 0.8095 | 3600 | 0.3012 | - | | 0.8320 | 3700 | 0.2927 | - | | 0.8545 | 3800 | 0.2878 | - | | 0.8770 | 3900 | 0.2974 | - | | 0.8995 | 4000 | 0.3125 | 0.3584 | | 0.9220 | 4100 | 0.2938 | - | | 0.9445 | 4200 | 0.2997 | - | | 0.9669 | 4300 | 0.2915 | - | | 0.9894 | 4400 | 0.2923 | - | | 1.0 | 4447 | - | 0.3572 | ### Training Time - **Training**: 26.3 minutes - **Evaluation**: 3.2 minutes - **Total**: 29.5 minutes ### Framework Versions - Python: 3.12.13 - Sentence Transformers: 5.7.0 - Transformers: 5.14.1 - PyTorch: 2.13.0+cu130 - Accelerate: 1.14.0 - Datasets: 5.0.1 - Tokenizers: 0.22.2 ## Additional Resources - [Training and Finetuning Embedding Models with Sentence Transformers](https://huggingface.co/blog/train-sentence-transformers): the end-to-end guide for training or finetuning Sentence Transformer models. - [Introduction to Matryoshka Embedding Models](https://huggingface.co/blog/matryoshka): variable-size embeddings that can be truncated with minimal quality loss. - [Binary and Scalar Embedding Quantization for Significantly Faster & Cheaper Retrieval](https://huggingface.co/blog/embedding-quantization): post-training compression of embedding vectors. - [Multimodal Embedding & Reranker Models with Sentence Transformers](https://huggingface.co/blog/multimodal-sentence-transformers): use text, image, audio, and video models through the same API. - [Training and Finetuning Multimodal Embedding & Reranker Models with Sentence Transformers](https://huggingface.co/blog/train-multimodal-sentence-transformers): train multimodal embedding models, with a Visual Document Retrieval walkthrough. ## Citation ### BibTeX #### Sentence Transformers ```bibtex @inproceedings{reimers-2019-sentence-bert, title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks", author = "Reimers, Nils and Gurevych, Iryna", booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing", month = "11", year = "2019", publisher = "Association for Computational Linguistics", url = "https://arxiv.org/abs/1908.10084", } ``` #### MultipleNegativesRankingLoss ```bibtex @misc{oord2019representationlearningcontrastivepredictive, title={Representation Learning with Contrastive Predictive Coding}, author={Aaron van den Oord and Yazhe Li and Oriol Vinyals}, year={2019}, eprint={1807.03748}, archivePrefix={arXiv}, primaryClass={cs.LG}, url={https://arxiv.org/abs/1807.03748}, } ```