last-checkpoint/README.md

metadata

tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - dense
  - generated_from_trainer
  - dataset_size:552482
  - loss:MultipleNegativesRankingLoss
base_model: sentence-transformers/all-MiniLM-L6-v2
widget:
  - source_sentence: >-
      title: 

      Creatto Flashy Fish  Silly Swimmers LightUp 3D Puzzle Kit  Includes
      Creatto Puzzle Pieces to Make Illuminated Craft Creations Sting Ray Turtle
      Crab Fish  DIY Activity  LED Lights
    sentences:
      - >-
        description

        With 43 Creatto pieces and a string of 20 LED lights you can build a
        cute cartoony fish a crab a stingray and a turtle Batterypowered lights
        require 2 AA batteries Suitable for ages 8 and upMAKE Each Creatto kit
        consists of just two primary building components that easily piece
        together into countless different 3D creations

        PLAY Once your creation is complete enjoy it as you play It becomes a
        prop for carrying out infinite adventures and storylines

        DISPLAY Your Creatto doubles as a piece of artwork Display it in your
        room and let it showcase your creativity and individuality The string of
        LED lights makes for a particularly striking sight

        Building instructions are language independent just follow the visual
        steps to learn how the Creatto system worksand how easy it is to use

        Stepbystep building videos for the models included in the kit a cute
        cartoony fish a crab a stingray and a turtle are available online
      - "description\nBring home your favorite characters from Middleearth The Lord of the Rings Frodo Baggins Pop Vinyl Figure steps right off the silver screen of Peter Jacksons\_The Lord of the Rings\_trilogy and into that familiar Funko format The Lord of the Rings Frodo Baggins Pop Vinyl Figure measures approximately 3 34inches tall and comes packaged in a window display box\_CHASE VERSIONFrom The Lord of the Rings Gandalf as a stylized POP vinyl from Funko"
      - >-
        description

        Specification

        Condition 100 Brand New

        Item Type RC Accessory

        Material Metal  Magnet

        Color Black

        Length Approx 120mm  472inch

        Diameter Approx 66mm  260inch Fins Not Included

        Shaft Diameter Approx 8mm  031inch

        Length of Extension Shaft Approx 30mm  118inch

        Weight Approx 18112g

        Power 10000W

        imum LiPo 814S

        imum Current 200A

        Pole 4

        IO 45A

        Resistance 00095

        KVRPMVolt 620

        RPM 35000

        Package List

        1  70120 620KV Brushless MotorLevel 4Brushless motor 4pole 12slot height
        design Design for maximum energy conversion

        UniversalUniversal RC car motor suitable for 15 scale brushless remote
        control car also suitable for electric skateboard

        ReliableThe Sensorless brushless motor precisely balances the rotor to
        ensure reliability and maximum speed

        High efficiency RC car engine starter kit highpurity copper winding
        maximizes efficiency

        StableRC brushless motor accessoryABEC5 bearing stability
  - source_sentence: >-
      title: 

      LEGO Friends Heartlake Surf Shop 41315 Building Kit 186 Pieces
      Discontinued by Manufacturer
    sentences:
      - >-
        description

        Take one of the most popular games with you wherever you go The Coop
        Hydro Lacrosse game set is great for playing lacrosse at the pool beach
        or in the backyard The soft foam handles of this fun water toy make it
        easy for all skill levels to catch scoop cradle and throw the ball Coop
        Hydro Lacrosse is an excellent choice for encouraging young players who
        are not quite ready for a larger lacrosse stick Features quality
        construction for longlasting play and the colorful ontrend graphics add
        to the fun Two lacrosse sticks and one ball in each set Each set sold
        individuallyFUN OUTDOOR GAME Lacrosse game set is perfect for pool beach
        or backyard play

        EASY TO PLAY catch scoop throw and cradle with ease Great for young
        lacrosse players and the whole family

        DURABLE Plastic frame maintains shape for long time use The lacrosse
        stick is strong with a foam handle for comfort

        ALL PIECES INCLUDED Each set includes 2 lacrosse sticks and 1 soft ball
      - >-
        description

        ACHIEVE TRUE RANDOM

        What makes a single die Casino Quality Casino dice must be manufactured
        with superlative care to exacting standards in order to meet stringent
        casino specifications Every die must be truly random which requires it
        to have razorsharp edges and flush pips so each face has equal weight A
        typical casino die is a perfect 19mm cube with an error margin of up to
        3mm The error margin of our Grade AAA dice 05mm Thats thinner than 13
        the thickness of an eyelash These dice look casino authentic are
        manufactured using the authentic process and with an authentic quality
        indistinguishable from the very same dice used on casino floors every
        day They make the perfect gift for any gaming enthusiast that wants to
        get as close to the Vegas tables as possible

        Why Youll Love It

        Our dice began as high quality raw materials cut into cubes with
        razorsharp edges Each of the 21 pips are drilled to identical depths and
        to ensure that all 6 sides maintain equal weight the holes are then
        filled with a special white epoxy with the precise weight and density of
        the material that was removed during the drilling process Pairs of
        opposite sides are then abraded and cut in sequence to ensure each side
        remains the same size The dice are then given a glossy polished finish
        before being professionally serialized to prevent tampering and preserve
        authenticityMAKE THE GRADE Our Fine Precision Dice meet or exceed all
        exacting casino dice specifications for the most professional gaming
        experience

        TRUE PRECISION Dice are cut with an exacting error margin of 05mm which
        is about 13 the thickness of an eyelash

        RAZORS EDGE Real Casino Dice are known for having sharp razor edges and
        flush pips drilled to identical depths This ensures truly random rolls

        TAMPER PROOF All sets of Brybelly Casino Dice are professionally
        serialized as a set of 5 to prevent tampering

        GOOD AS GOLD These sets make the perfect gift for any gaming enthusiast
        Each set even comes wrapped in giftable golden foil
      - >-
        description

        Your explorer can celebrate their summer excitement with all of the
        accessories in the LEGO Friends Heartlake Surf Shop set Kids can catch a
        wave and create stories about the adventures they have on their boards
        Builders will love to create summer memories with this set Multiple
        models and plenty of extras makes this set a great value and combine it
        with LEGO Friends Sunshine Catamaran and Andreas Speedboat Transporter
        to continue the summer funFeatures a surf shop with opening door beach
        area with sun lounger jetty with buoys surfboard stand buildable kayak
        and a rock for the seal

        Includes a Mia minidoll figure in a wetsuit plus a Velvet the seal
        figure

        Accessory elements include a paddle 2 surfboards waterproof camera
        sunglasses binoculars water bottles postcard and a cash register

        Surf shop measures over 4in 11cm high 5in 14cm wide and 6in 17cm deep

        Kayak measures over 4in 12cm long and under 1in 1cm high and 1in 2cm
        wide
  - source_sentence: >-
      title: 

      Terra by Battat  Horses Set  Detailed Miniature Horse Toys and Farm
      Animals with Quarter Horse for Kids 3 6 pc
    sentences:
      - "description\nPrincess Bride is the beloved fantasy adventure that celebrates true love and follows the adventures of one\_farmhandturnedpirate as he fights for his true love Featuring a memorable cast including Billy Crystal and Andre the Giant If youre a fan of Princess Bride you need these cool diecut vinyl stickers All our products are officially licensed and 100 authenticExclusive custom collectible and 100 official vinyl diecut stickers\nEach one of our designs are officially licensed and 100 authentic\nPerfect to personalize Laptops MacBooks Surfaces iPads Lockers Bedroom and much more Great for DIY decoration a gift for your kids and friends\nSimply get the stickers clean the surface sticker on and enjoy 30 Day 100 Satisfaction is guarantee\nSticker Sheet Size 4 x 7"
      - >-
        description

        Peppa Pig Tin Lunch Box With Puzzle Set  5 Pc Bundle with Peppa Lunch
        Box 24Piece Puzzle for Kids Stickers Flash Cards and More Peppa Pig
        Activity Set This Peppa Pig lunch and puzzle set comes with 1 Peppa Pig
        tin lunch box measuring 775 x 3 x 62 with 1 24piece Peppa Pig jigsaw
        puzzle for kids and toddlers inside The Peppa Pig puzzle measures 15 x
        125 inches when complete and features your favorite characters from
        Peppa Pig Ideal for kids ages 35 and 48 boys and girls alike This Peppa
        Pig activity set is great at home or around town Use the Peppa Pig tin
        lunch box for school lunch or keep it as your puzzle storage case
        Officially licensed Peppa Pig puzzles and games The Peppa Pig tin lunch
        box and puzzle activity also comes with 3 packs of Peppa Pig flash cards
        Peppa Pig stickers and a Barn Bots door hangerThis Peppa Pig lunch and
        puzzle set comes with 1 Peppa Pig tin lunch box measuring 775 x 3 x 62
        with 1 24piece Peppa Pig jigsaw puzzle for kids and toddlers inside

        The Peppa Pig puzzle measures 15 x 125 inches when complete and features
        your favorite characters from Peppa Pig Ideal for kids ages 35 and 48
        boys and girls alike

        This Peppa Pig activity set is great at home or around town Use the
        Peppa Pig tin lunch box for school lunch or keep it as your puzzle
        storage case

        Officially licensed Peppa Pig puzzles and games The Peppa Pig tin lunch
        box and puzzle activity also comes with 3 packs of Peppa Pig flash cards
        and 1 Peppa Pig play pack containing stickers coloring pages and
        coloring utensils

        Skill level Kids Children Girls Boys Toddlers
      - >-
        description

        Theres no horsing around with this set of 6 classic Horse toys for
        toddlers from Terra by Battat Little ones and collectors alike will love
        the adorable and realistic miniature animals Each plastic horse has
        individual characteristics and details from the speedy quarter Horse to
        the graceful pizzas and the hardworking Shire The carefullycrafted
        horses are made from safe and durable plastic that looks great in any
        animal figure collection Your pony toy will be proud to share the toy
        horse stable with these gorgeous Fillies Saddle up this collection of
        farm animal toy figures from Terra by Battat6 detailed horse toy
        figurines with natural poses that stand on their own hooves

        Beautifully crafted lifelike toys with realistic details

        Includes 1 quarter Horse 1 Friesian 1 falabella 1 lipizzan 1 spotted
        saddle and 1 Shire horse toy

        Educational toys provide information about horses and encourage
        compassion for animals

        Imaginative play reduces screen time while improving social skills

        Size horse toys approximately 4 05 0 inches long

        Recommended for children ages 3 and up

        This set of small animals is made of worryfree materials We make toys
        that are safe and sturdy at terra

        Discover the entire Terra by Battat family of toy animal figures
  - source_sentence: |-
      title: 
      Disguise Costumes Sequin Eye Mask Bright Red
    sentences:
      - >-
        description

        Magic the Gathering is a collectible card game created by Richard
        Garfield In Magic you play the role of a planeswalker who fights other
        planeswalkers for glory knowledge and conquest Your deck of cards
        represents all the weapons in your arsenal It contains the spells you
        know and the creatures you can summon to fight for you

        Card Name
         Grand Arbiter Augustin IV
        Cost
         2WU
        Color
         MultiColor
        Card Type
         Legendary Creature  Human Advisor
        PowerToughness
         23
        Card Text
         White spells you play cost 1 less to play Blue spells you play cost 1 less to play Spells your opponents play cost 1 more to playA single individual card from the Magic the Gathering MTG trading and collectible card game TCGCCG
        This is of Rare rarity

        From the Dissension set
      - >-
        description

        Disguise Costumes has been making fun interactive costumes for children
        and adults for decades Trusted in the industry for its creativity
        ingenuity and amazing price for the value Disguise wont let you down
        when it comes to fun dress up timeQuality materials used to make
        Disguise products

        Fun Colorful Inventive designs to put you in the world of role play

        Whether its Halloween birthday parties or even a fun filled night
        disguise is good for everything
      - >-
        description

        A colourful coffee maker set from New Classic Toys Who wants a coffee
        Everything you need for a good coffee This coffee machine set includes 
        two coffee pods to insert in the removable filter  a milk carton  two
        brightly painted coffee cups with saucers This article is part of the
        New Classic Toys Bon Appetit productline Cutting baking cooking and
        ready for dinner Our little pots pans cuttings sets and kitchens are
        absolute must haves for little master chefs100 wood

        Safety we want to challenge excite and enjoy children with high quality
        toys All products comply with the strictest safety requirements conform
        the standards Our products last for generations And we are very proud of
        this

        Fun this beautiful toy is colourful and has many fun options to play
        with The color is very bright Children would spend lot of time playing
        and parents finally could get some rest

        Learning Playing is not just fun it is also very important While playing
        kids get familiar with the world Building stacking making music or
        imitating playing contributes to the development of insight talent and
        motor skills

        Age Designed for anyone aged 3 and up this imagination toy can be
        enjoyed by every child in the family

        Bon Appetit This toy set is part of the Bon Appetit collection of New
        Classic Toys Cutting baking cooking and ready for dinner Our little pots
        pans cuttings sets and kitchens are absolute must haves for little
        master chefs
  - source_sentence: |-
      title: 
      DH top bottom main gear for 910108 or 905308 or 905008
    sentences:
      - >-
        description

        Lord of the Fries is the followup to Give Me the Brain another game in
        the Fast Food Restaurant of the Damned The mechanic is simple combine
        the ingredients in your hand to build combo meals with dishes like the
        Cowabunga the Meat Munch and of course the Lord of the Fries This is the
        fourth edition of Lord of the Fries It was introduced in 1998 and has
        been updated and improved in every edition The game returns to Cheapass
        Games after a brief vacation at Steve Jackson Games This time the game
        is designed to expand The core box contains the original restaurant menu
        55 cards plus a completely new Coffee Shop menu with allnew art and
        ingredients also 55 cards Each deck can support up to 6 players and
        there is a third menu using ingredients from both decks which supports
        up to 8 players Also arriving on the scene will be four standalone
        restaurant decks Mexican Chinese Italian and Irish Each deck plays alone
        for up to 6 players fits into the core game box and can combine with the
        core deck for up to 8 playersLightweight funny card game make combo
        meals from random ingredients

        Zombies All new card art by Brian Snoddy

        Includes a complete Coffee Shop expansion

        Designed by awardwinning game designer James Ernest

        All new card art by Brian Snoddy
      - >-
        description

        From the Manufacturer

        Round 2s Polar Lights brings back another popular movie car the Time
        Machine made famous in Back to the Future The kit features every detail
        to be expected in a Polar Lights kit from the flux capacitor to its
        gullwing doors A lightning rod hook power assembly is also included as
        an option The car body features a new authentic looking brushed metal
        look that captures the brushed aluminum of the real car The tires roll
        and the snap assembly means the kit can be assembled in no time with
        great results With this model kit youre sure to hit 88 miles an hour and
        be outta timeOfficially licensed from the classic film

        Features every detail including the Flux Capacitor

        Authentic brushedmetal look

        Features rolling tires

        Snap assembly
      - >-
        description

        top bottom main gear for 910108 or 905308 or 9050081 set top bottom main
        geartop bottom main gear for 910108 or 905308 or 905008
datasets:
  - guyhadad01/Amazon_2023_items_processed_filtered
pipeline_tag: sentence-similarity
library_name: sentence-transformers

SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2

This is a sentence-transformers model finetuned from sentence-transformers/all-MiniLM-L6-v2 on the amazon_2023_items_processed_filtered dataset. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-MiniLM-L6-v2
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • amazon_2023_items_processed_filtered

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'BertModel'})
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("guyhadad01/EncodeRec_Toys")
# Run inference
sentences = [
    'title: \nDH top bottom main gear for 910108 or 905308 or 905008',
    'description\ntop bottom main gear for 910108 or 905308 or 9050081 set top bottom main geartop bottom main gear for 910108 or 905308 or 905008',
    'description\nFrom the Manufacturer\nRound 2s Polar Lights brings back another popular movie car the Time Machine made famous in Back to the Future The kit features every detail to be expected in a Polar Lights kit from the flux capacitor to its gullwing doors A lightning rod hook power assembly is also included as an option The car body features a new authentic looking brushed metal look that captures the brushed aluminum of the real car The tires roll and the snap assembly means the kit can be assembled in no time with great results With this model kit youre sure to hit 88 miles an hour and be outta timeOfficially licensed from the classic film\nFeatures every detail including the Flux Capacitor\nAuthentic brushedmetal look\nFeatures rolling tires\nSnap assembly',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.8355, 0.0051],
#         [0.8355, 1.0000, 0.0522],
#         [0.0051, 0.0522, 1.0000]])

Training Details

Training Dataset

amazon_2023_items_processed_filtered

• Dataset: amazon_2023_items_processed_filtered at 6b58dd1
• Size: 552,482 training samples
• Columns: title and description
• Approximate statistics based on the first 1000 samples:

  	title	description
  type	string	string
  details	min: 6 tokens mean: 21.46 tokens max: 61 tokens	min: 13 tokens mean: 193.18 tokens max: 512 tokens

• Samples:

  title	description
  title: Gothic Mothman Plushie Doll with Bright Red Eyes Medieval Style Attractive Evil Moth Stuffed Plush Doll Toy Magical Home Decor for Bedroom for Kids Boyfriend Classmate A	description Description Mothmans bright red eyes could stare you down in an instant and his huge dark figure cast fear and doubt in so many residents He is perfect to join you on your vast adventures This Mothman plushie is looking for a loving and magical home right now A great gift for your cryptid lover friend or that friend who likes a dark in their home decor It would look great resting on your bed sitting on your dresser or on the shelf with your other plushies Material Plush Size Approx Height 8 inches x Width 9 inches Package included 1x Gothic Mothman Plushie Mothmans bright red eyes could stare you down in an instant and his huge dark figure cast fear and doubt in so many residents He is perfect to join you on your vast adventures This Mothman plushie is looking for a loving and magical home right now A great gift for your cryptid lover friend or that friend who likes a dark in their home decor It would look great resting on your bed sitting on your dresser or on the shel...
  title: Traxxas Stampede 4X4 110 Scale 4wd Monster Truck Red	description Stampede 4X4 is built Traxxas Tough to withstand all the 4WD mayhem you can dish out Its high ground clearance and longarm suspension make Stampede 4X4 feel nearly indestructible Chrome AllStar 28 wheels give Stampede 4X4 aggressive style and soft Chevron Maxx tires deliver allterrain capability Its all waterproof so the fun keeps going through wet conditions No other truck offers Stampede 4X4s style capability and durability Stampede 4X4 is perfect for almost any age and comes fully assembled painted and ReadytoDrive Stampede 4x4 features a shaftdriven 4WD system and modular design of the Slash 4X4 Stampedes highly efficient drivetrain offers optimum performance and easy maintenance A single center driveshaft connects the front and rear drive assemblies for maximum power transfer The modular design allows the entire front or rear section to be removed with just a few screws for easy service The extra ground clearance increases the offroad versatility allowing you to tackle...
  title: Hot Wheels Monster Truck 124 Scale 2022 Bone Shaker It All Vehicle with Giant Wheels for Kids Age 3 to 8 Years Old Great Gift Toy Trucks Large Scale	description The Hot Wheels Monster Trucks 124 scale diecast trucks are THE baddest trucks ever built for competition and ultimate dominance The outrageous vehicles are ready to square off in headtohead battles with an oversized body and GIANT wheels Every toy truck package includes fun stats for the monster truck inside including name truck type strength unique crash attack and motorvation for great storytelling fun Each sold separately subject to availability Colors and decorations may varyDesigned in 124 scale with durable diecast metal bodies Hot Wheels Monster Trucks are ready to for outrageous action Giant wheels and rad details amp up the collecting and crashing smashing and stunt play The vehicle package features cool stats on back giving details about strength crash attack motorvation and more Rev up imagination and storytelling with unique toy Monster Trucks that deliver mindblowing features fans will want them all Makes a great gift for kids and Monster Trucks fans ages 3 ye...

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim",
      "gather_across_devices": false
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 512
• num_train_epochs: 1
• warmup_ratio: 0.1
• fp16: True
• push_to_hub: True
• hub_model_id: guyhadad01/EncodeRec_Toys
• hub_strategy: checkpoint

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: no
• prediction_loss_only: True
• per_device_train_batch_size: 512
• per_device_eval_batch_size: 8
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 1
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.1
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: True
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: True
• resume_from_checkpoint: None
• hub_model_id: guyhadad01/EncodeRec_Toys
• hub_strategy: checkpoint
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: False
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

Epoch	Step	Training Loss
0.0463	50	0.6644
0.0926	100	0.3737
0.1389	150	0.3271
0.1852	200	0.309
0.2315	250	0.2706
0.2778	300	0.2587
0.3241	350	0.2629
0.3704	400	0.2518
0.4167	450	0.2492
0.4630	500	0.228
0.5093	550	0.2267
0.5556	600	0.2222
0.6019	650	0.2283
0.6481	700	0.2233
0.6944	750	0.2239
0.7407	800	0.2107
0.7870	850	0.2205
0.8333	900	0.2087
0.8796	950	0.2129
0.9259	1000	0.2103
0.9722	1050	0.2077

Framework Versions

• Python: 3.12.11
• Sentence Transformers: 5.1.0
• Transformers: 4.55.2
• PyTorch: 2.7.1+cu126
• Accelerate: 1.10.0
• Datasets: 3.6.0
• Tokenizers: 0.21.4

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}