last-checkpoint/README.md

metadata

tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - dense
  - generated_from_trainer
  - dataset_size:1007606
  - loss:CachedMultipleNegativesRankingLoss
base_model: sentence-transformers/all-MiniLM-L6-v2
widget:
  - source_sentence: |-
      title: 
      Phi Tee Tail Retractable Golf Towel Set Portable Golf Ball Washer 12X12
    sentences:
      - "description\nWant to hold up to 50 rounds of ammo conveniently These flip top boxes are available in five sizes to accommodate any type of handgun ammo They are stackable for storage feature an easytogrip textured surface and come with a load label\nAll MTM CaseGards are MADE IN USA in our factory in Dayton OhioFor 45 ACP 10mm Auto 40 SW 41 Action Express 357 Sig 44 Auto Mag 45 Auto Rim 45 GAP 38 Casull 400 CorBon 8mm Nambu\nScuffresistant textured surface\nMaximum Overall Length\_  130\nStacking feet mechanical hinge and load labels\nSnap lock latch  25 year guarantee  Made in USA"
      - >-
        description

        Innovative Golf TowelBall Washer System for Every Golfer Cleverly solves
        the drawbacks associated with golf towels Rare but if defective
        components are found free replacements will be sent out upon request All
        of our products are HighQuality  GUARANTEEDRetractable Wearable Belt
        Loop  dont forget or lose with 2 Quality Pocket Water Spray Pens

        The Most Simple and Effective Portable Golf Ball Washer Set

        Premium Microfiber Waffle Texture Towel  Perfect 12X12 Size for Ball and
        Club Head Cleaning

        Easily Attached and Detached from the Durable Retractable Keyring for
        Frequent Washing

        All HighQuality Components  Any Defects will be Replaced for Free
      - >-
        description

        The Dura Outdoor Pickleballs also known as the Dura Fast 40 are a
        seamless plastic whiffle ball specially designed for pickleball They
        like all outdoor pickleballs have thick walls The purpose of using hard
        plastic for a pickleball is to increase the life span of the ball in
        rough outdoor conditions The name of the ball is short for durable and
        these balls live up to their name We are sure you will love playing with
        them We certainly do So a little bit about the manufacturing process To
        start the ball is made by injecting a single glob of hot plastic into a
        mold The mold is closed and rotated to spread the plastic evenly around
        the walls of the mold When the mold has stopped spinning it is opened
        and the new ball is removed from the mold Sometimes there is a minor
        separation seam from excess plastic that leaked out of the mold This
        excess plastic is sanded off Look inside the ball and you will not see a
        seam We double dare you There are two sizes of holes drilled into this
        ball The two sizes of holes and the hole configuration help make the
        ball more aerodynamic The Dura Outdoor Pickleballs is a heavy ball
        weighing 092 ounces This weight helps keep the ball flying straight even
        in windy conditions The weight also makes them a fast ball compared to
        the softer and lighter jugs indoor pickleball The Dura are also a rather
        big the ball measures 29375 in diameter The ball has an average bounce
        height of 32 promising lively response to every hit Formerly called the
        Dura 56 the manufacturer changed the name several years ago to the Dura
        Fast 40 We are happy with either of the names frankly For many years
        this ball has been the official ball for the USA Pickleball Associations
        National Pickleball Tournament so you know its got to be a great choice
        in the pickleball world The Dura brand ball is the original pickleball
        although now there are several companies making identical outdoor
        pickleballs such a
  - source_sentence: |-
      title: 
      47 NFL Atlanta Falcons Womens Trytop Cuff Knit Hat with Pom Red
    sentences:
      - >-
        description

        Show off your team spirit in style with officiallylicensed NFL team
        headwear  apparel from 47 Brand 47 provides the quality all true fans
        desire in their gear Known for their vintage look and feel 47 has
        managed to also provide a new school spin to this old school craze Their
        presentday success comes from never forgetting their roots In 1947 twin
        brothers and Italian immigrants Arthur and Henry DAngelo founded their
        company Twins Enterprises in Boston MA The DAngelos sold pennants and
        other sports memorabilia on the streets around Fenway Park and through a
        combination of hard work sound instincts and incredible passion the
        brothers were able to grow their business from a single street cart to a
        premier sports lifestyle brand that uniquely melds sport and style Now
        known as 47 Brand they produce a unique mix of the finest headwear and
        apparel with an unparalleled attention to detail which has helped
        established them as a premium global sportswear brand wellknown by fans
        the world over 47 is proud to be an Officially Licensed partner with the
        four key professional American sports leaguesMLB NFL NBA  NHLas well as
        over 650 NCAA colleges  universitiesImported

        Support your favorite team in style  comfort

        Officially licensed product of the National Football League

        47 Brand produces only the finest sportswear for the fashionconscious
        fan

        Widely known and loved by sports fans for its vintage look  feel

        Check out all new 47 caps knits tshirts hoodies pullovers socks scarves
        and more  available for all your favorite teams
      - >-
        description

        3 Pair Lenses  Black  Ice Blue Mirror Coating  Titanium Mirror Coating

        Features

        1 Made of premium quality which offers 100 UV Protection  100 Polarized
        2 Precision Cut and Guaranteed to fit with the original Oakley Eyepatch
        2 Sunglasses frame extremely seamless 3 Optional Mirror Coatings
        optimize usable light for specific environment and activities 4 Easy to
        install 5 Reduces glare and enhances contrast perfectly 6 Comes with
        fibre cleaning cloth and compatible size of hard protection case

        Not include the Frame

        Disclaimer Our lenses are not affiliated with Oakley in any aspects

        This Lenses Fit Oakley Model

        Eyepatch 1 Not Fit

        Eyepatch 2 Fit

        Make sure the oakley model and lenses is the right one you need If you
        are not sure please search the SKU  which is marked on your frame

        Fit SKU OO91363 Pair Lenses  Black  Ice Blue Mirror Coating  Titanium
        Mirror Coating This Lenses Only Fit Oakley Eyepatch 2 Sunglasses if you
        are not sure please search the SKU  which is marked on your frame OO9136

        100 Polarized and 100 UV Protection on all lenses

        Suitable for cycling running driving and other outdoor sports and
        activities

        Precision Cut and Guaranteed to Fit

        Reduces glare and enhances contrast perfectly
      - >-
        description

        NCAA Alabama Crimson Tide Neoway Cap MediumLarge100 Cotton

        39Thirty stretch fit 100 Cotton front with Spacer Mesh mids and rear of
        cap

        Primary Team logo in raised embroidery on the front of the cap

        Secondary Team logo in flat embroidery on back of cap

        SmMed fits sizes 7 thru 7 38  MedLg fits sizes 7 14 thru 7 58
  - source_sentence: |-
      title: 
      DV8 Thug Bowling Ball
    sentences:
      - >-
        description

        Product name No Storage Swimming Lifesaving Drift Bag Size4829cm
        Material035mm Ecofriendly PVC BuoyancyMax 10KG FeaturesEquipped with
        inflatable gas nozzlewithout storage spaceIt can not put anything Note
        11Befor you swimmingYou can blow air through the air mouth and then
        ensure there is no leakage by submerging the buoy 2 Do not let sharp
        objects damage the air bag after entering the water 3 Be careful not to
        let the connection rope entangle the body 4 In case of emergency use in
        the water keep calm and relaxed Hold fast and dont panic And quickly to
        a safe area shallow water shore or call for help Package included 1Pcs 
        Swim bouy without storage spacePatron Saint of Swimming Safety With
        bright appearance eyecatching in the water it is easy to be found in
        distress and can quickly use the buoyancy of independent air bags for
        selfrescue and a short rest it is your guardian angel of water safety

        Easily Inflatable Storable and Easy to UseIt only takes 10 seconds to
        inflate by blowing with the mouth very simple and convenient to use It
        has independent storage space and can be used for personal belongings

        UltraPortable and Easy to Store It is light and small after being
        deflated so it is easy to store and carry Material is PVC its
        environmental protection safe durable

        As a Thoughtful Gift For relatives and friends who like swimming or
        water sports

        Guarantee of water safety One of the necessary equipment for open water
        swimming In the water can be used as a lifesaving sign Swimming float it
        can also remind passing vessels
      - >-
        description

        Featuring the new Class 13F Hybrid Reactive coverstock wrapped around
        the Thug core the Thug skids easily through the front and midlane
        flipping on the backend for the most breakpoint potential of any DV8
        ever on medium to oily lane conditions The DV8 Thug can be drilled using
        the standard drilling techniques developed for bowling balls with
        asymmetric cores Core Type Thug Low RG Coverstock Class 13F Reactive
        Finishing Steps 500 Siaair Micro Pad Royal Compound Weights 1216
        Asymmetrical Diff 0015 at 15 lbs RG Max 2557 at 15 lbs RG Min 2505 at 15
        lbs RG Differential 0052 at 15 lbs To reduce oil absorption and remove
        dirt from the surface of the ball clean your ball with a cleaner
        designed for reactive bowling balls after each session Look We dont
        screw around DV8 bowling balls have been manufactured to the highest
        standards of workmanship and material We warrant that theyll be free of
        defects in materials and workmanship for a period of two years from the
        date of purchase We agree to repair or replace the ball you bought if at
        any time during the warranty period its found to be defective in
        material or workmanshipFeaturing the new Class 13F Hybrid Reactive
        coverstock wrapped around the Thug core the Thug skids easily through
        the front and midlane flipping on the backend for the most breakpoint
        potential of any DV8 ever on medium to oily lane conditions

        The DV8 Thug can be drilled using the standard drilling techniques
        developed for bowling balls with asymmetric cores

        Core Type Thug Low RG Coverstock Class 13F Reactive Finishing Steps 500
        Siaair Micro Pad Royal Compound Weights 1216 Asymmetrical Diff
      - >-
        description

        If you havent tried it yet ultralight fishing can be one of the most
        enjoyable ways to fish The Shakespeare Micro Series rods have a variety
        of actions and lengths to fit any species and are perfect for fishing
        with lighter lures and linesMicro Series Spinning Rod 7

        Micro Series Spinning Rod 7

        Micro Series Spinning Rod 7

        Micro Series Spinning Rod 7

        Micro Series Spinning Rod 7

        Graphite composite rods with perfect light and ultra light actions

        Full cork handles

        Conventional reel seat with cushioned hoods

        Stainless Steel guides with stainless steel inserts
  - source_sentence: |-
      title: 
      Altus Athletic 4Inch Premium Padded Lifting Belt Large
    sentences:
      - >-
        description

        Premium padded leather weight lifting belt is competition approved 4
        inch size and offers added support to the core muscle groups during
        heavy exerciseTraditional Leather Belt

        4 in Wide Belt Saddle Stitched

        TwoTongue Steel Buckle With Oval Belt Holes

        Padded Suede Lining
      - >-
        description

        NYX Lightning combines cutting edge performance and classic stylingNylon
        frame

        Nylon lens

        NonPolarized

        Amber lens filters blue light and increases contrast

        Italian made frame has smooth clean lines

        8 base Lens optimizes sun protection

        TR90 Memory Nylon Frame and Polycarbonate Lens

        Complete with carrying case and microfiber pouch
      - >-
        description

        The Yoga Mat is made with high quality imported TPE materialhealthgreen
        soft odorlessit comes with carry stripgift packingwe focus on the
        quality onlyit cant be compared with the price for the normal exercise
        mat pilatespadif you want the best yoga mateours are your best choice
        Remember No NBR PVC Only TPE  Cleanng method Do not use a washing
        machine or dryer Method 1 Please wipe the mat with cloth depped in suds
        or laundry powder solution Then rinse with water and wipe it off from
        mat with towel or cloth Method 2 Please soak yoga mat in warm water with
        some vinegar for 30 minlay out the whole mat in bath tube with some warm
        water the water must cover the mat and put some200ml white vinegar with
        itThen wipe the water off from mat with towel or cloth72 x 24Inches14
        thicky yoga mats ensure comfortable for youeasy carry for travel

        Health Fitness Non toxic Odorless Phthalate FreeThis pilates mat is safe
        for stretching and toning workouts

        TPE material  lake blue rosered grassgreen violetgreen black bluegrey
        blackgreen 8 color for choiceblackgreen and bluegray are
        doublesidememory foam protects your knees and joints which allow you to
        grip the floor for balance

        Ribbed surface on one side with a smooth surface on the other nonslip
        surface grips the floor to prevent injuries

        Elegant easytoclean durable and long lasting material Features an
        integrated carry strap
  - source_sentence: >-
      title: 

      iGreely Trolling Motor Plug and Receptacle Male Plug  Female Panel Mount
      Socket Waterproof IP67 2Pin Connector 12V 24V 36V 48V Plug for Trolling
      Motor Marine Boat RV Solar Panel
    sentences:
      - >-
        description

        Miniature padded halter made of 34 inch webbing Features padded nose and
        crown Snap at throat with adjustable nose and crownItem Package
        Dimensions 58 L X 188 W X 244 H Cm

        Product Type Sporting Goods

        Item Package Weight 0272 kgs

        Country Of Origin China
      - "description\nNote\_The terminals are small its a little difficult to\_solder 12 or 10 gauge cable but its easy for 14 gauge\nProduct Parameter\nWire specification25M5M1412AWG\nLine diameter range812\nDiameternumber274\nRated currentA20A\nOperation voltageACVRMS500V\nContact resistance1m\nTemperature rise20A per contact at 3025A4030A50\nWithstand voltage ACV1minute2500V\nInsulation resistance500M\nProtection levelIP65IP67\nMating cycle500 times\nWorking temperature4080\nConnection modeQuick plug connection\nWiring modeWelding  Crimping\nMaterial\nInsulation componentsHighperformance engineering plastics\nHardwareZinc alloyNickel Plating\nPINCopper alloy  gold plated\nWaterproof circleSilica gel\nFlame retardant gradeUL94V02 pin power industrial circular connector is used for power and signal perfectly fits Furrion solar port that many RVs come with eg Grand Design Forrest River\nRated current 20A operation voltage 500VAC outdoor waterproof IP67Goldplated contacts high strength corrosion resistance good electrical conductivity effective response to current temperature changes\nProtected against solids  liquids provide a secure and reliable connection in the harsh environment\nPBT material of the protective housing with characters of fire safety compression antiexplosion and antideformation\nWidely used in data acquisition systems inclinometer computer automation measurement and control systems mechnical equipment audiovideo communications automotive and other industries\nTrolling Motor Plug and Receptacle Male Plug  Female Panel Mount Socket Waterproof IP67 2Pin Connector 12V 24V 36V 48V Plug for Trolling Motor Marine Boat RV Solar Panel\nNote The terminals are small its a little difficult to solder 12 or 10 gauge cable but its easy for 14 gauge"
      - >-
        description

        Full leather construction perforated palm and fingers for breathability
        an optifeel closure and bright colors make Callaways Opticolor glove the
        best choice for performance and fashion

        Opti Feel Leather

        Premium Feel Fit and Comfort

        Premium Feel Fit and Comfort

        Perforations on Palm Top of Hand and Fingers

        Moisture Reduction  Increased Breathability

        Moisture Reduction  Increased Breathability

        Opti Fit Adjustable Closure

        Thin Light and Secure Fit

        Thin Light and Secure FitLeather

        LeftWorn on Left Hand

        Opti feel plus leather  premium feel fit and comfort

        Perforations on palm fingers and thumb  moisture reduction and increased
        breathability

        Opti fit adjustable closure  thin light and secure fit
datasets:
  - guyhadad01/Amazon_2023_items_processed_filtered
pipeline_tag: sentence-similarity
library_name: sentence-transformers

SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2

This is a sentence-transformers model finetuned from sentence-transformers/all-MiniLM-L6-v2 on the amazon_2023_items_processed_filtered dataset. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-MiniLM-L6-v2
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • amazon_2023_items_processed_filtered

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'BertModel'})
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("guyhadad01/EncodeRec_22M_Sports")
# Run inference
sentences = [
    'title: \niGreely Trolling Motor Plug and Receptacle Male Plug  Female Panel Mount Socket Waterproof IP67 2Pin Connector 12V 24V 36V 48V Plug for Trolling Motor Marine Boat RV Solar Panel',
    'description\nNote\xa0The terminals are small its a little difficult to\xa0solder 12 or 10 gauge cable but its easy for 14 gauge\nProduct Parameter\nWire specification25M5M1412AWG\nLine diameter range812\nDiameternumber274\nRated currentA20A\nOperation voltageACVRMS500V\nContact resistance1m\nTemperature rise20A per contact at 3025A4030A50\nWithstand voltage ACV1minute2500V\nInsulation resistance500M\nProtection levelIP65IP67\nMating cycle500 times\nWorking temperature4080\nConnection modeQuick plug connection\nWiring modeWelding  Crimping\nMaterial\nInsulation componentsHighperformance engineering plastics\nHardwareZinc alloyNickel Plating\nPINCopper alloy  gold plated\nWaterproof circleSilica gel\nFlame retardant gradeUL94V02 pin power industrial circular connector is used for power and signal perfectly fits Furrion solar port that many RVs come with eg Grand Design Forrest River\nRated current 20A operation voltage 500VAC outdoor waterproof IP67Goldplated contacts high strength corrosion resistance good electrical conductivity effective response to current temperature changes\nProtected against solids  liquids provide a secure and reliable connection in the harsh environment\nPBT material of the protective housing with characters of fire safety compression antiexplosion and antideformation\nWidely used in data acquisition systems inclinometer computer automation measurement and control systems mechnical equipment audiovideo communications automotive and other industries\nTrolling Motor Plug and Receptacle Male Plug  Female Panel Mount Socket Waterproof IP67 2Pin Connector 12V 24V 36V 48V Plug for Trolling Motor Marine Boat RV Solar Panel\nNote The terminals are small its a little difficult to solder 12 or 10 gauge cable but its easy for 14 gauge',
    'description\nFull leather construction perforated palm and fingers for breathability an optifeel closure and bright colors make Callaways Opticolor glove the best choice for performance and fashion\nOpti Feel Leather\nPremium Feel Fit and Comfort\nPremium Feel Fit and Comfort\nPerforations on Palm Top of Hand and Fingers\nMoisture Reduction  Increased Breathability\nMoisture Reduction  Increased Breathability\nOpti Fit Adjustable Closure\nThin Light and Secure Fit\nThin Light and Secure FitLeather\nLeftWorn on Left Hand\nOpti feel plus leather  premium feel fit and comfort\nPerforations on palm fingers and thumb  moisture reduction and increased breathability\nOpti fit adjustable closure  thin light and secure fit',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[ 1.0000,  0.5476, -0.0452],
#         [ 0.5476,  1.0000, -0.0572],
#         [-0.0452, -0.0572,  1.0000]])

Training Details

Training Dataset

amazon_2023_items_processed_filtered

• Dataset: amazon_2023_items_processed_filtered at 6b58dd1
• Size: 1,007,606 training samples
• Columns: title and description
• Approximate statistics based on the first 1000 samples:

  	title	description
  type	string	string
  details	min: 6 tokens mean: 19.19 tokens max: 53 tokens	min: 13 tokens mean: 177.15 tokens max: 512 tokens

• Samples:

  title	description
  title: SureGrip Zombie Wheels Low 59mm 4 Pack	description All Zombie wheels are made in the USA Zombie wheels feature anodized aluminum hubs for maximum durability and precise feel while maintaining rock solid stability This allows our unique urethane compounds to deliver all your power to the floor Choose the Zombie combination that fits your skating style and surface Zombie Aluminum Core Designed in house and manufactured using state of the art machining technology What makes this different from other aluminum cores The Zombie core is machined from a solid billet of aluminum using the same manufacturing processes as we use to make our famous Power Trac racing plates This increases strength and allows us to machine the hub to a tighter tolerance than any other hub on the market Creating the perfect fit between bearing and inner core Cores are then treated with a special anodizing process to increase hub durability and urethane bonding This technology is unique to the Zombie wheel line Zombie Insane Urethane Specially formulated...
  title: NHL San Jose Sharks Team Logo Post Earrings	description Complete your game day outfit with these cute earrings and showcase your team spirit all year round with these NHL Team Logo Post Earrings by Aminco These adorable earrings measure approximately 1inch by 1inch and is decorated with your favorite team colored logo The earrings feature post backings for carefree wear and are NHL officially licensed These would make a great gift for the loyal sports fan in your life100 Synthetic Imported Adorable Post Earrings Measures Approximately 1inch by 1inch Decorated with Team Colored Logo NHL Officially Licensed Features Post Backings for Carefree Wear Complete your Game Day Outfit with these Cute Earrings
  title: Team Golf Alamaba Crimson Tide Embroidered Towel from	description Keep your clubs clean while supporting your favorite collegiate team with this officially licensed NCAA embroidered golf towel from Team Golf The trifold embroidered towel features a hook and grommet and measures 16in x 25inCotton Trifold golf towel is embroidered with your favorite collegiate teams logo Hook and grommet Dimensions W 16 in H 25 in Officially licensed

• Loss: CachedMultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim",
      "mini_batch_size": 64,
      "gather_across_devices": false
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 512
• num_train_epochs: 1
• warmup_ratio: 0.1
• bf16: True
• push_to_hub: True
• hub_model_id: guyhadad01/EncodeRec_22M_Sports
• hub_strategy: checkpoint

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: no
• prediction_loss_only: True
• per_device_train_batch_size: 512
• per_device_eval_batch_size: 8
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 1
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.1
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• bf16: True
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• project: huggingface
• trackio_space_id: trackio
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: True
• resume_from_checkpoint: None
• hub_model_id: guyhadad01/EncodeRec_22M_Sports
• hub_strategy: checkpoint
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: no
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: True
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Training Logs

Epoch	Step	Training Loss
0.0254	50	1.3736
0.0508	100	0.9886
0.0762	150	0.7345
0.1016	200	0.6664
0.1270	250	0.6045
0.1524	300	0.5898
0.1778	350	0.5569
0.2033	400	0.5396
0.2287	450	0.5298
0.2541	500	0.5257
0.2795	550	0.5151
0.3049	600	0.5239
0.3303	650	0.5169
0.3557	700	0.4942
0.3811	750	0.4981
0.4065	800	0.4983
0.4319	850	0.4882
0.4573	900	0.4869
0.4827	950	0.4898
0.5081	1000	0.501
0.5335	1050	0.4843
0.5589	1100	0.496
0.5843	1150	0.4878
0.6098	1200	0.4892
0.6352	1250	0.4915
0.6606	1300	0.4868
0.6860	1350	0.4819
0.7114	1400	0.486
0.7368	1450	0.4875
0.7622	1500	0.4874
0.7876	1550	0.4725
0.8130	1600	0.4819
0.8384	1650	0.4808
0.8638	1700	0.4797
0.8892	1750	0.4836
0.9146	1800	0.4832
0.9400	1850	0.4945
0.9654	1900	0.4686
0.9909	1950	0.4889

Framework Versions

• Python: 3.12.11
• Sentence Transformers: 5.1.0
• Transformers: 4.57.0
• PyTorch: 2.7.1+cu126
• Accelerate: 1.10.0
• Datasets: 3.6.0
• Tokenizers: 0.22.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

CachedMultipleNegativesRankingLoss

@misc{gao2021scaling,
    title={Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup},
    author={Luyu Gao and Yunyi Zhang and Jiawei Han and Jamie Callan},
    year={2021},
    eprint={2101.06983},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}