guyhadad01's picture
Training in progress, step 240, checkpoint
8e44320 verified
metadata
tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - dense
  - generated_from_trainer
  - dataset_size:122875
  - loss:CachedMultipleNegativesRankingLoss
base_model: sentence-transformers/all-MiniLM-L6-v2
widget:
  - source_sentence: >-
      title: 

      Baby Formula Dispenser Portable Milk Powder Dispenser Snack Storage
      Container for Travel Bedroom Outdoor Large Pink
    sentences:
      - >-
        description

        Unique Design Protable handle Child Lock Hollow Scraper  Scoop Features
        Compact Size Lightweight Package included 1 x Formula DispenserSize of
        4x4x42 this formula container can hold about 30 scoops formula for your
        baby BPAFree

        Compact Size the formula carrier is small and compact but holds a lot It
        fits in your diaper bag organizer perfectly

        Easy for OntheGo this baby formula holder makes feeding time easier when
        you and baby are out and about

        Unique ChildLock and silicone sealing ring ensure airtightness and does
        not leak in any time

        Multipurpose  it also can be used as snack cups or container for storing
        oatmeal cornflour nuts candy fruit
      - >-
        description

        Stay on top of diaper odor and cleanup with the upup 1Pack Diaper Pail
        Refills Theyre compatible with Genie Elite Diaper Genie II Elite Diaper
        Genie Essentials and Diaper Genie II pails The refills are made with a
        7layer film that keeps odor at bay so the nursery stays fresh Holds up
        to 272 newborn diapers  Quality needs priced to please With up  up your
        satisfaction is 100 guaranteed or your money back  Features 7layer
        Plastic Material Plastic Care and Cleaning Does Not Apply Dimensions
        1950H x 6550W x 6550L Imported
      - >-
        description

        This super soft wearable blanket replaces loose blankets in the crib for
        a safer sleeping environment65 Cotton 35 Polyester

        Imported

        Machine Wash

        Includes 1 zipup wearable blanket neck widths 36 mos 3 618 mos 35 1824
        mos 4

        Certified free from over 100 harmful chemicals by OekoTex Standard 100

        An Amazon Brand

        Fill is made from 100 polyester

        Handmedown lasting quality

        Prewashed fabric for added softness and minimal shrinkage
  - source_sentence: |-
      title: 
      Dream On Me 2in1 Folding Birch Portable Crib Cherry
    sentences:
      - >-
        description

        Clean and pamper your baby with the Lil Luxuries Whirlpool Bubbling Spa
        and Shower in a luxurious spa experience at home With a calming
        whirlpool and massaging bubbles keeping your little one entertained and
        soothed during bath time has never been easier The innovative design of
        this baby bathtub keeps baby warm during bath time with the insulated
        double wall tub For added convenience and comfort the deluxe newborn
        sling with plush bolster can be used in the sink infant tub or adult
        bathtub Keep baby entertained with the motorized water jet by creating
        bubbles and vibrations for the ultimate spa effect This baby tubs
        convenient design grows with your little one as the removable clean
        rinse spashower unit can be used in adult tub for extended useLUXURIOUS
        BABY BATHTUB Clean and pamper your baby with the Lil Luxuries Whirlpool
        Bubbling Spa and Shower in a luxurious spa experience at home Keep baby
        soothed with the calming circulating water jets

        KEEPS NEWBORNS SUPPORTED The deluxe newborn sling with plush bolster can
        be used in the sink infant tub or adult bathtub

        KEEPS BABY WARM The innovative design of this baby bathtub keeps baby
        warm during bath time with the insulated double wall tub

        KEEP BABY ENTERTAINED The motorized water jet keeps baby entertained by
        creating bubbles and vibrations for the ultimate spa effect

        GROWS WITH BABY This baby tubs convenient design grows with your little
        one The removable clean rinse spashower unit can be used in adult tub
        for extended use
      - >-
        description

        The Dream On Me 2in1 Folding Birch Portable Crib is a must for todays
        urban onthego parents and designed to make the most of small spaces The
        crib assembles in a jiffy and the US patented rail design easily helps
        convert the crib into a playpen in seconds It makes for the perfect
        spacesaver with the unique hinge system allowing it to fold flat for
        compact storage Its lightweight portable frame with wheels makes it easy
        for you to move it around the house Take it on your travels or to
        grandmas house Safety is a top priority at Dream On Me The stationary
        non drop side rail system and heavy duty locking commercial size wheels
        provide the utmost in product safety It meets the ASTM standards It
        features a solid birchwood frame Its clean minimalist design and four
        beautiful finish options allow it to blend into any room decor Crib
        dimensions are 40L x 26W x 38H Comes with a twoposition mattress support
        One inch crib mattress and tools for easy assembly includedUSEFUL
        CONVERTIBILITY Perfect for todays urban parents with its
        dualfunctionality Crib assembly is quick and the US patented rail design
        easily helps convert crib into a playpen in seconds

        COMPACT  PORTABLE The perfect spacesaver  unique hinge system allows it
        to fold flat for compact storage making it ideal for small space
        Lightweight portable frame with wheels make it the ideal portable travel
        companion

        SAFETY MATTERS The stationary non drop side rail system and heavy duty
        locking commercial size wheels provide the utmost in product safety It
        meets the ASTM standards

        CLEAN DESIGN Comes with a solid birchwood frame Clean minimalist design
        and four beautiful finish options allow it to blend into any room decor
        One inch crib mattress and tools for easy assembly included

        PRODUCT SPECS Crib dimensions are 40L x 26W x 38H Comes with a
        twoposition mattress support system
      - "description\nJohnsons Cotton\_Swabs\nare made from only 100 pure nonchlorine bleached cotton\_ Pure cotton is naturally soft absorbent and gentle\_ Give your skin the gentle natural care of Johnsons Cotton\_productOur 100 pure high quality cotton has just the right combination of softness and strength\nHere are some ways you can use JOHNSONS Pure Cotton Swabs Beauty Care Baby Care Crafts  Household Tasks"
  - source_sentence: |-
      title: 
      EUBEST Baby Mosquito Net Baby Toddler Bed Crib Canopy Netting White
    sentences:
      - >-
        description

        Product Description

        A customized fit is always better than a standard one especially when it
        comes to babyproofing If you need to extend your Munchkin safety gate
        you can do so with standard gate extensions available in a variety of
        sizes and colors to give you the perfect fit These extensions work with
        pressurefit safety gates and can be combined to span a variety of
        opening sizes up to 54 wide Available in 275 55 and 11 sizes For use
        with the AutoClose Metal Gate MK0006 Easy Close Metal Gate MK0002 and
        Safe Step with TripGuard Gate MK0096

        From the Manufacturer

        Add extra width to your Munchkin AutoClose or Easy Close gate Simply
        measure the narrowest point of your opening often at the base board and
        select the dimensions that correspond to your measurements

        Manufacturer Contact Information

        Phone 1800344BABY 2229 Email cservmunchkincom

        See moreExtends the AutoClose Metal Gate MK0006 Easy Close Metal Gate
        MK0002 and Safe Step with TripGuard Gate MK0096

        Dimensions 11 W x 295 H

        Steel extensions can be combined to span a variety of openings up to 54

        Material Steel
      - >-
        description

        Your baby deserves the best

        We believe that there is nothing more precious delicate and beautiful
        than your baby Qz creation with children AND families in mind Whether
        you are looking for a baby gift a birthday present or family gift hope
        you find the perfect baby Muslin Burp Cloths that will grow with your
        family

        Carefully made from GOTS verified organic cotton

        The Global Organic Textile Standard GOTS is recognised as the worlds
        leading processing standard for textiles made from organic fibres
        Organic cotton is grown without the use of chemical fertilizers
        herbicides or pesticides It is hypoallergenic and soft next to babys
        sensitive skin

        Muslin is a finely woven cotton open weave cotton that is lightweight
        breathable and softens with every wash

        Qz Baby Guarantee

        Offering the very best for your baby is the most important thing in the
        world right We are confident that we can do exactly that for you If you
        are unsatisfied for any reason contact us for a refund Get this
        ultrasoft organic cotton muslin burp cloth today You will not regret
        investing in a highquality burp cloth for your baby

        Click the Add to Cart button NOW and get your very own Qz Organic Cotton
        Muslin Burp Cloth TODAY FOR 32 OFFOrganic Cotton

        SAFER 100 Organic materials with GOTS certified Muslin in natural white
        and ultimately packed in the premium muslin bag our baby burp bibs are
        free from harmful chemicals dyes which makes them safer to baby and our
        planet Labels are sewn appropriately so that babys skin doesnt get hurts
        Made with fully certified organic cotton that is grown and manufactured
        in an environmentally responsible way NO AZO NICKEL FORMALDEHYDE on all
        our muslin burp cloth

        BEST BURP CLOTHS BABY BIBS BABY CAPE A bib burp cloth and cape in one
        our 4 pack of soft burp cloths keeps you and your little one clean Drape
        it over your babys shoulders and snap it at the back for a fullcoverage
        bib or using as a cape when in aircondition and windy day or place it
        over your shoulder for a noslip burp cloth Perfect for teething or
        drooling babies

        EIGHT ABSORBENT THICK and THIRSTY LAYERS are generously sized noslip to
        absorb dribbles lightweight and yet breathable to keep baby cozy dry and
        comfy Babys skin will feel soft and smooth next to organically grown
        cotton Muslin Burp Cloths

        REUSABLE Most Absorbent and Most Durable burp cloth Better than cotton
        or terry cloth they actually get SOFTER after each wash Reusable so you
        can use them Over  Over Again It can save your money More economical and
        environmental Lets Use as a burp cloth now and as a wonderfully soft
        washcloth later

        OVERSIZED Our prewashed burp cloths come in a generous 25x58cm size  2cm
        providing greater shoulder coverage and less outfit changes for Mom and
        Dad
      - >-
        description

        Pacakge1pcsThis mosquito net fits playpens bassinets cribs smaller beds
        etc It would add elegance to the room and at the same time protect your
        baby from mosquitoes and bugs

        Perfect choice for your babys room So cute

        Easier match for the bed  L  W 150  80 cm  59  315 inch

        Lightweight in good condition and in great shape

        shipping from Uhome
  - source_sentence: |-
      title: 
      Little Seeds Rowan Valley Flint 6Drawer Dresser BlackWhite
    sentences:
      - >-
        description

        BisphenolA BPA is used in hard clear plastics such as baby bottles to
        prevent breakage In 2006 when we learned that BPA also disrupts
        reproductive functions and causes other developmental problems we
        discontinued all BPA from our feeding items We know that lugging around
        everything parents need for their little ones can be a real chore We
        have a collection of spillproof easy to carry feeding items to make life
        simpler when onthegoCute lunchbox with locking lid

        Nesting divided tray and bowl

        Dimensions 6x 475x 275152 x 12 x 7 cm

        BPA Free
      - >-
        description

        Add a modern look to your childs bedroom with the Little Seeds Rowan
        Valley Flint 6 Drawer Dresser Made from sturdy MDF the nontoxic painted
        matte black finish on the chassis contrasts the white finish of the
        drawer fronts for a clean sleek look The solid wood angled feet give the
        Dresser a stable base and adds a decorative touch The metal slides on
        each drawer have builtin stops for safety and can withstand years of use
        Keep your childs sweaters folded shirts and pants and seasonal coats and
        gloves stored away and organized in the 6 drawers This 6 Drawer Dresser
        can convert to a changing table by adding our optional changing station
        top sold separately The 6 Drawer Dresser meets or exceeds the CPSIA
        Juvenile testing requirements and comes with a wall anchor kit to ensure
        your childs safety The Little Seeds Rowan Valley Flint 6 Drawer Dresser
        ships flat to your door and requires assembly upon opening Two adults
        are recommended for assembly Once assembled the Dresser measures to be
        32625H x 47625W x 17875D Little Seeds not only creates this and many
        more on trend baby to teen furniture pieces we also partner with various
        environmental protection programs to protect pollinator and other
        wildlife habitats for future generationsThe Little Seeds Rowan Valley
        Flint 6 Drawer Dresser gives your childs bedroom a modern updated look

        Made from sturdy MDF the painted nontoxic finish gives the Dresser an
        updated clean look The solid wood angled feet offer a decorative touch
        that adds stability Each drawer has metal slides with builtin stops for
        safety

        The Dresser can convert to a Changing Table by adding the changing
        station topper sold separately The 6 Drawer Dresser meets or exceeds the
        CPSIA Juvenile testing requirements and comes with a wall anchor kit to
        ensure your childs safety

        Complete your childs bedroom with the Rowan Valley Flint Crib or mix and
        match with other Rowan Valley collections for an eclectic look

        The Little Seeds Rowan Valley Flint 6 Drawer Dresser ships flat to your
        door and 2 adults are recommended for assembly The Dresser top can hold
        up to 75 lbs and each drawer will hold 35 lbs Assembled dimensions
        32625H x 47625W x 17875D
      - "description\nBorn Free BPAFree Drinking Cups are designed to help baby smoothly transition from bottle to cup\_ The cups are completely compatible and interchangeable with Born Free bottles Mix and match cup handles bottle nipples and soft spouts to help baby make and easier transition \_The patented ActiveFlow Venting Technology is clinically designed to help reduce colic symptoms such as gas and fussiness and can help extend breastfeeding by mimicking mothers natural flow which is controlled by baby while nursingNatural transition from bottle to cup with a teething friendly durable soft spout\nNatural flow with ActiveFlow Venting Technology\nNaturally free from BPA and PVC\nTop rack dishwasher safe\nAll handles collars nipples and spouts are completely interchangeable between any Born Free bottle or transition cup"
  - source_sentence: |-
      title: 
      Dream On Me 4 Piece Toddler Bedding Set Spring Garden
    sentences:
      - >-
        description

        The Baby Jogger City Mini GT2 Stroller Barre Collection has an allnew
        design with forever air rubber tires and allwheel suspension providing
        uncompromised agility on any terrain This special edition fashion
        includes premium leatherette detailing on the canopy and harness covers
        and an upgraded seat pad for a sleek modern look Plus the included belly
        bar gives your child a safe and comfortable area to hold onto while
        strolling The signature onehand compact fold adjustable handlebar and
        handoperated parking brake provide you the ultimate convenience while
        the adjustable calf support and nearflat seat recline allow you to find
        the most comfortable position for your child Create a travel system
        using the included Baby Jogger infant car seat adapters car seat sold
        separately or customize your ride with a variety of accessoriesNylon

        Stroller has forever air rubber tires with allwheel suspension providing
        uncompromised agility on any terrain

        Lift a strap with one hand and the City Mini GT2 stroller folds itself
        simply and compactlyDo not use bleach solvents or abrasive cleaning
        materials

        Premium leatherette detailing on the canopy and harness covers and an
        upgraded seat pad for a sleek modern look

        Included belly bar gives your child a safe and comfortable area to hold
        onto while strolling

        Add a Baby Jogger Infant Car Seat using the included infant car seat
        adapters car seat sold separately and go anywhere from day one
      - >-
        description

        Let the little one in your home settle down to sleep in this incredible
        Toddler Bed set This girl bedding set features stunning floral print
        with a butterfly combined with bright solid microfiber fabrics This
        collection uses the stylish colors of purple green and purple This set
        includes comforter fitted Sheet flat sheet Pillow caseCottonPolyester

        4piece crib bedding set includes a Comforter Flat Sheet Fitted Sheet and
        Pillowcase

        Flat Sheet Fitted Sheet and Pillowcase has 35 percent cotton and 65
        percent polyester fabrics Comforter has 100 percent polyester fiber fill

        Measures 52 X 28 inches Sheets fit a standard 52 X 28 cribToddler
        Mattress

        Machine wash 4piece Toddler Bedding set in cold water gentle cycle

        Use only nonchlorine bleach when needed tumble dry low heat iron on low
        heat when needed
      - >-
        description

        Hudson Baby plush security blanket set is soft and cuddly and perfect to
        aid in child development Hudson Baby animal face security blanket will
        keep baby calm and content with their favorite animal friend Our
        security blanket features super soft and luxurious fabric with a fun
        animal creature to play and snuggle to their little hearts desire Our
        security blanket will surely become a baby favorite The larger blanket
        is generously sized perfect for snuggling cuddling swaddling or as a car
        seat or stroller coverSet includes security blanket and plush blanket

        Made with 100 cozy plush fabric  Blanket 30x36 inches and security
        blanket 14x14 inches

        Soft and gentle on babys skin

        Optimal for everyday use

        Affordable high quality nursery blanket set
datasets:
  - guyhadad01/Amazon_2023_items_processed_filtered
pipeline_tag: sentence-similarity
library_name: sentence-transformers

SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2

This is a sentence-transformers model finetuned from sentence-transformers/all-MiniLM-L6-v2 on the amazon_2023_items_processed_filtered dataset. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

Model Sources

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'BertModel'})
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("guyhadad01/EncodeRec_22M_Baby")
# Run inference
sentences = [
    'title: \nDream On Me 4 Piece Toddler Bedding Set Spring Garden',
    'description\nLet the little one in your home settle down to sleep in this incredible Toddler Bed set This girl bedding set features stunning floral print with a butterfly combined with bright solid microfiber fabrics This collection uses the stylish colors of purple green and purple This set includes comforter fitted Sheet flat sheet Pillow caseCottonPolyester\n4piece crib bedding set includes a Comforter Flat Sheet Fitted Sheet and Pillowcase\nFlat Sheet Fitted Sheet and Pillowcase has 35 percent cotton and 65 percent polyester fabrics Comforter has 100 percent polyester fiber fill\nMeasures 52 X 28 inches Sheets fit a standard 52 X 28 cribToddler Mattress\nMachine wash 4piece Toddler Bedding set in cold water gentle cycle\nUse only nonchlorine bleach when needed tumble dry low heat iron on low heat when needed',
    'description\nHudson Baby plush security blanket set is soft and cuddly and perfect to aid in child development Hudson Baby animal face security blanket will keep baby calm and content with their favorite animal friend Our security blanket features super soft and luxurious fabric with a fun animal creature to play and snuggle to their little hearts desire Our security blanket will surely become a baby favorite The larger blanket is generously sized perfect for snuggling cuddling swaddling or as a car seat or stroller coverSet includes security blanket and plush blanket\nMade with 100 cozy plush fabric  Blanket 30x36 inches and security blanket 14x14 inches\nSoft and gentle on babys skin\nOptimal for everyday use\nAffordable high quality nursery blanket set',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[ 1.0000,  0.5313, -0.0115],
#         [ 0.5313,  1.0000,  0.0888],
#         [-0.0115,  0.0888,  1.0000]])

Training Details

Training Dataset

amazon_2023_items_processed_filtered

  • Dataset: amazon_2023_items_processed_filtered at 6b58dd1
  • Size: 122,875 training samples
  • Columns: title and description
  • Approximate statistics based on the first 1000 samples:
    title description
    type string string
    details
    • min: 6 tokens
    • mean: 23.22 tokens
    • max: 51 tokens
    • min: 17 tokens
    • mean: 237.75 tokens
    • max: 512 tokens
  • Samples:
    title description
    title:
    Chicco Viaro Travel System Teak
    description
    Product Description
    For ultimate convenience the Chicco Viaro QuickFold Stroller has a sleek threewheel design lightweight aluminum frame and onehand quick fold A pullstrap and button are conveniently tucked under the seat and easy to activate simultaneously for a compact freestanding fold The stroller is even easier to open again after closingFor infants the Viaro Stroller functions as a travel system with easy clickin attachment for the KeyFit 30 Infant Car Seat For older riders the Viaro Stroller includes a detachable tray with two cup holders adjustable canopy and multiposition backrest A swiveling front wheel and suspension help maintain a smooth ride from surface to surface Toetap rear brakes keep the stroller in place when parked For parents the Viaro Stroller features a padded pushhandle parent tray with two cup holders and a large basket that is easily accessible from the front or back The Viaro Travel System includes the 1rated Chicco KeyFit 30 Infant Car Seat wh...
    title:
    Kisbaby Four Layers Muslin Lightweight Unisex Toddler Wearable Blanket Early Walker Sleeping Sack Footed Sleep Sack for Baby Girls and Boys Blue Star 12M
    description
    You can choose bigger size If you confuse about size
    Medium Age 612 months Height up to 32inches Weight up to 24lbs
    Large Age 1218 months Height up to 35inches Weight up to 28lbs
    Kids Cant Kick Off and Stay Covered All Night
    Super soft draped muslin fabric
    Lightweight and breathable keep baby warm and reduces the risk of overheating
    Tuck feet in at night for warmth
    A blanket your little one cant kick off ensuring better more comfortable sleep
    Foot opening for easy mobility
    Foot opening provide greater mobility when your little one is awake
    Easy bathroom visits
    Inverted zipper for easy bathroom visits or diaper changing95 Cotton 4 Layer Muslin Hand Wash in Cold Water is Recommended
    Imported
    Draped muslin softer touch lightweight breathable and friendly to baby TOG 10
    Use over regular sleepwear to replace loose blankets cannot be kicked off so baby stays warm all night
    Short sleeve for ease of dressing and freedom of movement reduces the risk of overheating
    Unzips from the bo...
    title:
    Nuby iMonster Toddler Bowl
    description
    When babies begin to show interest in feeding themselves having the right equipment is a must Nuby feeding accessories are made to withstand the challenges of daily use and retain their bright color This Toddler Bowl is ideal for children who are beginning to feed themselves Suitable for warm or cold foods Microwave safe BPA FreeMakes feeding fun for baby and easier for parent
    Easy Grip design makes it easy for baby to hold
    Bright color captures your babys attention Fun character inspires your childs imagination
    Wash prior to initial use and after subsequent uses Easy clean with warm soapy water Rinse and dry thoroughly Also safe for top rack of dishwasher
    18 Months BPA Free Microwave safe
  • Loss: CachedMultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim",
        "mini_batch_size": 64,
        "gather_across_devices": false
    }
    

Training Hyperparameters

Non-Default Hyperparameters

  • per_device_train_batch_size: 512
  • num_train_epochs: 1
  • warmup_ratio: 0.1
  • bf16: True
  • push_to_hub: True
  • hub_model_id: guyhadad01/EncodeRec_22M_Baby
  • hub_strategy: checkpoint

All Hyperparameters

Click to expand
  • overwrite_output_dir: False
  • do_predict: False
  • eval_strategy: no
  • prediction_loss_only: True
  • per_device_train_batch_size: 512
  • per_device_eval_batch_size: 8
  • per_gpu_train_batch_size: None
  • per_gpu_eval_batch_size: None
  • gradient_accumulation_steps: 1
  • eval_accumulation_steps: None
  • torch_empty_cache_steps: None
  • learning_rate: 5e-05
  • weight_decay: 0.0
  • adam_beta1: 0.9
  • adam_beta2: 0.999
  • adam_epsilon: 1e-08
  • max_grad_norm: 1.0
  • num_train_epochs: 1
  • max_steps: -1
  • lr_scheduler_type: linear
  • lr_scheduler_kwargs: {}
  • warmup_ratio: 0.1
  • warmup_steps: 0
  • log_level: passive
  • log_level_replica: warning
  • log_on_each_node: True
  • logging_nan_inf_filter: True
  • save_safetensors: True
  • save_on_each_node: False
  • save_only_model: False
  • restore_callback_states_from_checkpoint: False
  • no_cuda: False
  • use_cpu: False
  • use_mps_device: False
  • seed: 42
  • data_seed: None
  • jit_mode_eval: False
  • bf16: True
  • fp16: False
  • fp16_opt_level: O1
  • half_precision_backend: auto
  • bf16_full_eval: False
  • fp16_full_eval: False
  • tf32: None
  • local_rank: 0
  • ddp_backend: None
  • tpu_num_cores: None
  • tpu_metrics_debug: False
  • debug: []
  • dataloader_drop_last: False
  • dataloader_num_workers: 0
  • dataloader_prefetch_factor: None
  • past_index: -1
  • disable_tqdm: False
  • remove_unused_columns: True
  • label_names: None
  • load_best_model_at_end: False
  • ignore_data_skip: False
  • fsdp: []
  • fsdp_min_num_params: 0
  • fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
  • fsdp_transformer_layer_cls_to_wrap: None
  • accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
  • parallelism_config: None
  • deepspeed: None
  • label_smoothing_factor: 0.0
  • optim: adamw_torch
  • optim_args: None
  • adafactor: False
  • group_by_length: False
  • length_column_name: length
  • project: huggingface
  • trackio_space_id: trackio
  • ddp_find_unused_parameters: None
  • ddp_bucket_cap_mb: None
  • ddp_broadcast_buffers: False
  • dataloader_pin_memory: True
  • dataloader_persistent_workers: False
  • skip_memory_metrics: True
  • use_legacy_prediction_loop: False
  • push_to_hub: True
  • resume_from_checkpoint: None
  • hub_model_id: guyhadad01/EncodeRec_22M_Baby
  • hub_strategy: checkpoint
  • hub_private_repo: None
  • hub_always_push: False
  • hub_revision: None
  • gradient_checkpointing: False
  • gradient_checkpointing_kwargs: None
  • include_inputs_for_metrics: False
  • include_for_metrics: []
  • eval_do_concat_batches: True
  • fp16_backend: auto
  • push_to_hub_model_id: None
  • push_to_hub_organization: None
  • mp_parameters:
  • auto_find_batch_size: False
  • full_determinism: False
  • torchdynamo: None
  • ray_scope: last
  • ddp_timeout: 1800
  • torch_compile: False
  • torch_compile_backend: None
  • torch_compile_mode: None
  • include_tokens_per_second: False
  • include_num_input_tokens_seen: no
  • neftune_noise_alpha: None
  • optim_target_modules: None
  • batch_eval_metrics: False
  • eval_on_start: False
  • use_liger_kernel: False
  • liger_kernel_config: None
  • eval_use_gather_object: False
  • average_tokens_across_devices: True
  • prompts: None
  • batch_sampler: batch_sampler
  • multi_dataset_batch_sampler: proportional
  • router_mapping: {}
  • learning_rate_mapping: {}

Training Logs

Epoch Step Training Loss
0.2083 50 1.1163
0.4167 100 0.6972
0.625 150 0.6743
0.8333 200 0.6641

Framework Versions

  • Python: 3.12.11
  • Sentence Transformers: 5.1.2
  • Transformers: 4.57.0
  • PyTorch: 2.7.1+cu126
  • Accelerate: 1.10.0
  • Datasets: 3.6.0
  • Tokenizers: 0.22.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

CachedMultipleNegativesRankingLoss

@misc{gao2021scaling,
    title={Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup},
    author={Luyu Gao and Yunyi Zhang and Jiawei Han and Jamie Callan},
    year={2021},
    eprint={2101.06983},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}