last-checkpoint/README.md

metadata

tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - dense
  - generated_from_trainer
  - dataset_size:21955
  - loss:CachedMultipleNegativesRankingLoss
base_model: Qwen/Qwen3-Embedding-0.6B
widget:
  - source_sentence: 'Title: Gold extatic Musk EDT 90ml'
    sentences:
      - >-
        Description: ['When you’re looking for soothing relief, reach for Aloe
        MSM Gel. MSM stands for Methyl Sulfonyl Methane, an organic sulfur found
        in almost all living organisms. In fact, sulfur is the third most
        abundant substance in our body. The other main ingredient in Aloe MSM
        Gel is pure, stabilized Aloe Vera. Aloe MSM Gel combines these two
        powerful ingredients with herbal extracts and other select ingredients
        for soothing relief anytime. Try Aloe MSM Gel today! DIRECTIONS: Apply
        liberally and massage into skin areas where needed. Should eye contact
        occur, flush with water for several minutes. Repeat application as
        needed.']

        Clear, non-staining formula

        For soothing relief anytime

        Contains pure, stabilized Aloe Vera
      - |-
        Description: ['Edt spray 3 oz design house: balmain']
        Extatic Balmain Gold Musk By Balmain Edt Spray 3 Oz
      - >-
        Description: ['Euphoria is a heavenly and intoxicating perfume for the
        woman who enjoys attention. Its original blend of sparkly and sweet
        ingredients is simply irresistible. Persimmon and pomegranate open the
        scent with an uncommon kick. The two fruits combine for a rich aroma of
        musky, sweet wine deepened by green accords. Black orchid and lotus
        blossom provide clean, watery flower notes just exotic enough to suggest
        the marvels of a faraway land. Violet, cream, amber, and wood notes
        support the perfume with a milky, savory aroma. Made for the uncommon
        woman, this perfume longs to be noticed.']
  - source_sentence: >-
      Title: Nail Clippers for Thick Nails - Heavy Duty Stainless Steel
      Fingernail Toenail Clipper for Tough Nails，Wide Jaw Extra Large Nail
      Cutter for Thick Toenails for Seniors Men & Women，Curved Blades
    sentences:
      - >-
        Description: ['Launched by the design house of Chanel in 2002, CHANEL
        CHANCE by Chanel is classified as a flowery fragrance. This feminine
        scent posesses a blend of: a refined blend of jasmine and citrus. It is
        recommended for daytime wear.']
      - >-
        Description: ['Medicated Treatment Conditioner', '🥇 Intense
        multi-functional formula.🥈 Designed to penetrate the hair shaft to stop
        drying and add moisture. 🥉 Also helps in the aid of minor scalp
        irritations and fungus.']

        ✅ 👩🏾 👩🏽‍🦰👩🏼 Works on all hair types

        ✅ Formulated with Aloe

        ✅ Works best when used with Kiti Kiti Medicated Treatment Shampoo

        ✅ Help remove dry, flaking skin from scalp
      - >-
        Description: ['Are you still spending thousands of dollars a year for
        your thick nail problems? Are you still complaining about traditional
        nail clippers for men that are easily damaged?', 'We recommend you to
        try the new professional nail clippers of the DEJLIG brand.', 'Toenail
        clippers for thick nails adopt a unique lever design, and the blade of
        nail clippers for thick toenails can be opened up to 16mm. Fingernail
        clippers for men can trim nails of any thickness and easily cut our
        thick nails. Clipper pro nail cutters are very durable and sharp, saying
        goodbye to the annoying thick nail problem.', 'DEJLIG is an American
        brand dedicated to producing high-quality large nail clippers for thick
        toenails.', "Our heavy duty nail clippers for thick nails have an
        elegant ergonomic design and have the most durable and sharpest blades.
        Professional nail clippers for seniors made of surgical grade stainless
        steel have outstanding performance and are today's masterpieces. She is
        one of the best nail clippers set for men on the market today.  It's
        time to say goodbye to cheap and low-quality toenail clippers for thick
        toenails.", 'Try our wide jaw toenail clippers now! When you trim your
        nails, they will provide you with the smoothest and most enjoyable
        experience.', '【Gift Box Includes】', '1 x Big Toenail Clippers 1 x Nail
        File1×Instructions', '【After-sales Service: Lifetime Service】', 'All
        heavy duty toenail clippers must pass strict quality inspections before
        they can be sold. If you have any questions about our stainless steel
        nail clippers, please go to the following path: "My Order"-"Contact
        Seller" to contact us.']

        【Professional Nail Clippers Set】- Toe nail clippers for thick toenails
        are designed for various nail types and are suitable for professional
        occasions such as nail salons, including men, women and seniors. This is
        also a great nail clipper kit (including a nail clipper and a nail
        file), which can provide a relaxing and enjoyable experience for heavy
        duty toenail clippers, nail cutters for seniors and travel nail
        clippers. Large Toenail Clippers for Thick Toenails Are the Best Choice
        for Gifts.

        【Sharp & Durable】- Toenail clippers for thick nails for seniors are made
        of high-quality surgical grade stainless steel for rust and durability
        .The new sharp curved blade adapts to the curvature of the nail and
        trims sharp pieces of corners precisely. Nail clippers for thick
        toenails use a unique lever, which is very durable, ergonomic and
        comfortable to use. Nail Clippers for Women Are Professional Cutting
        Tools Manufactured According to The Highest Standards.

        【Ultra Wide Jaw Opening】- Professional toenail clippers use a unique
        lever design, allowing the wide jaw blade to open up to 16mm, suitable
        for trimming nails of any thickness. Ultra wide jaw opening and non-slip
        handle work perfectly together, and nail clippers for men can reduce the
        pressure required to cut thick nails or tough toenails. Fingernail
        clippers for women help us cut nails easily and comfortably, so Large
        Nail Clippers for Thick Toenails Will Be Our Best Tool for Trimming
        Nails.

        【Designed for Thick Nails】- Nail clippers for thick nails can easily
        trim nails of various thicknesses, saving us strength and time. Sturdy
        and sharp curved blade with double curved edges allows toenail clippers
        for thick toenails to trim nails precisely without pain. Heavy duty nail
        clippers for thick nails effectively alleviate tough nail problems
        caused by fungus, diabetes, and aging. Fingernail Clippers for Men Are A
        Good Helper for Every Thick Nail Friend.

        【Lifetime Warranty】- We are very confident in the quality of our nail
        trimmer for women and offer a leading lifetime replacement warranty to
        every customer who buys thick toenail clippers. If you have any
        questions about our toenail clippers for thick nails, please feel free
        to email us. Our US professional team will give you the most
        satisfactory answer within 24 hours. Clipper Pro Nail Cutter Provide
        Reliable Quality, So You Can Buy Stainless Steel Nail Clippers with More
        Confidence.
  - source_sentence: >-
      Title: Nail Art Brushes,Acrylic Nail Brush,Nail Art Brush,Acrylic Brush
      Embossed Sable Nail Tools for Nail Salon Home Use,Nail Tools (#20)
    sentences:
      - >-
        Description: ['Product Details: Weight: about 0.63-0.98 oz Material:
        alloy + plastic + Kolinsky hair Color: Black Size: #8,10,12,14,16,18,20
        Length: about 17.2-18.5 cm Nail brushes soft, flexible bristles give the
        artist great control over the product. Long-lasting and strong, it will
        not split or deform, the alloy handle is easy to handle, has a very
        smooth surface, more durable than any type of brush, both beautiful and
        practical. Nail acrylic brush is the perfect nail art tool for
        professional salons and home DIY nail art, the more times you use it,
        the smoother the result. Warm Tips: Please clean our nail brushes with a
        brush before use. After the manicure, please clean the nail brush with
        Brush Liquid Monomer. Wipe off as much water as possible with a paper
        towel and re-store. Proper care and cleaning will extend the life of
        your nail brushes. Proper use and proper care will ensure a longer life
        for your nail art brushes. Always keep air circulating and in an upright
        position. The acrylic nail brushes need to breathe to prevent bad stuff
        growth. Also, keep pinceles para acrilico out of direct sunlight. With
        proper care, your acrylic brush will have a longer life.']
      - >-
        Description: ['For carefree hair with time to spare start your day with
        Aussie Total Miracle Collection 7N1 Shampoo. Packed with 7 benefits in 1
        bottle it starts by cleansing your tresses to reveal brilliant natural
        shine. The moisture-enriched serum infusion protects your hair from
        dryness split ends and breakage. On top of that this miraculous shampoo
        makes your hair more manageable by detangling your strands. The result?
        Your hair is less prone to damage and breakage. Follow with Aussie Total
        Miracle Collection 7N1 Conditioner and emerge from the shower with a
        head full of silky smooth hair. Because around here we make Aussome hair
        easy!']
      - >-
        Description: ['EVA Hard Protective Travel Case Carrying Pouch Cover Bag
        for John Frieda Salon Shape 1.5 Inch Hot Air Brush By Hermitshell']

        Hermitshell Hard Travel Storage Carrying Case Bag

        Protect your favorite device from bumps dents and scratches

        Made to fit John Frieda Salon Shape 1.5 Inch Hot Air Brush

        Material:EVA ,Color: Black

        For sale is case only (device and accessories are sold separately)
  - source_sentence: 'Title: Stand Electric Toothbrush Heads Case Holder for Braun Oral B'
    sentences:
      - >-
        Description: ['3 bottles of ROSE WATER & IVY Shea & Vitamin E SHOWER
        GELS.']
      - >-
        Description: ['Package Content: 1 x Toothbrush Stand （The toothbrush,
        brush heads, and charger are not included in the package.）']

        A perfect solution to organize your toothbrush, brush heads and charger
        in one stand.Hold up to 4 brush heads,2 Oral B electric toothbrush.and 1
        charger, (Charging port size is only suitable for original oral b
        charger),(The toothbrush, brush heads, and charger are not included in
        the package)

        It comes with a lid that can keep your brush heads safe and clean.the
        holder is made of ABS,100% Environmental protection material,safe and
        durable

        This fit right around the toothbrush charger perfectly. the cover keeps
        it extra clean and Convenient storage

        Size: 19.5 * 9.5 * 3.5cm, IRLIC Stand Electric Toothbrush Heads Case
        Holder for Braun Oral B

        Compatible with Braun Oral-B rechargeable toothbrush, Oral B Stages
        Power Kids-950, Oral B Stages Power Kids, Oral B Vitality Sensitive
        Clean, Oral B Pro 600, Oral B Pro 650, Oral B Pro 700 3d white, Oral B
        Pro 1000, Oral B Pro 2000, Oral B Pro 3000, Oral B Pro 4000, Oral B Pro
        5000, Oral B Pro 6000, Oral B Pro 7000, Oral B Pro 8000, Oral B Genius
        9000, Oral B Genius 10000n
      - >-
        Description: []

        ❤️[Short Hairstyles]- Natural Grey Wigs for White Women, 12 inch Length
        Bob Wigs for Women, Heat Resistant Fiber Synthetic Hair Replacement Wigs
        Colored Blond Side Parting Bangs Trendy Haircuts Wig with Free Wig Cap x
        1

        ❤️[Hair Material]- Heat resistant hair tinsel that holds up to styling
        tools providing a similar styling versatility as with human hair. The
        wig can also be customized to suit your own individual look by cutting
        them or using a curling iron/hair straightener. (Note: optimal
        temperature is 250-275 degrees, but going above 350 degrees is not
        recommended.)

        ❤️[Occasions]- Fashionable and stylish short bob wig look natural, real
        like human hair wig, very pretty, and feminine, soft touch. You can wear
        it for parties, Halloween, cosplay, daily use, gift sending to friends
        and certain themed performances, fashion and attractive, adding more
        charm and fun.

        ❤️[Adjustable Size]- Cap size 20-22.5 inches,There are two adjustment
        straps inside the wig, which can be intertwined to a fixed position to
        suit different head sizes.

        ❤️[Worry-free After-sales]- We Are Committed To Providing Customers with
        Quality Products and Attentive Services, Free Returns If You Don't Like
        It or a Quality Problem.
  - source_sentence: >-
      Title: Sinful Colors Finger Nail Polish Color Lacquer Set 16-Piece
      Collection
    sentences:
      - >-
        Description: []

        Lot of 16 Random Sinful Colors Finger Nail Polish Color Lacquer All
        Different Colors No Repeats

        Images for reference only

        Actual color/texture may vary from the image shown

        Randomly pre-packed 16 nail polishes
      - >-
        Description: ["Adorox Red Horn Devil Woman's Wig Demon Angel Halloween
        Costume Prop Measures about: 27 Inches Length. Perfect for a Woman's
        Devil Halloween Costume. Sized for adults and teens. One Size fits
        most"]

        Long fiery Red hair with Horns

        Measures about: 27 Inches Length

        100% Polyester

        Perfect for a Woman's Devil Halloween Costume

        Sized for adults and teens.
      - >-
        Description: ['Ovvio Oils All Natural Smooth Strength Plus Lip Balm For
        Chapped Lips 0.5 oz (14.2 g)']
pipeline_tag: sentence-similarity
library_name: sentence-transformers

SentenceTransformer based on Qwen/Qwen3-Embedding-0.6B

This is a sentence-transformers model finetuned from Qwen/Qwen3-Embedding-0.6B on the amazon-reviews-2023 dataset. It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: Qwen/Qwen3-Embedding-0.6B
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 1024 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • amazon-reviews-2023

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False, 'architecture': 'Qwen3Model'})
  (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': True, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("guyhadad01/EncodeRec_600M_Beauty")
# Run inference
queries = [
    "Title: Sinful Colors Finger Nail Polish Color Lacquer Set 16-Piece Collection",
]
documents = [
    'Description: []\nLot of 16 Random Sinful Colors Finger Nail Polish Color Lacquer All Different Colors No Repeats\nImages for reference only\nActual color/texture may vary from the image shown\nRandomly pre-packed 16 nail polishes',
    "Description: ['Ovvio Oils All Natural Smooth Strength Plus Lip Balm For Chapped Lips 0.5 oz (14.2 g)']",
    'Description: ["Adorox Red Horn Devil Woman\'s Wig Demon Angel Halloween Costume Prop Measures about: 27 Inches Length. Perfect for a Woman\'s Devil Halloween Costume. Sized for adults and teens. One Size fits most"]\nLong fiery Red hair with Horns\nMeasures about: 27 Inches Length\n100% Polyester\nPerfect for a Woman\'s Devil Halloween Costume\nSized for adults and teens.',
]
query_embeddings = model.encode_query(queries)
document_embeddings = model.encode_document(documents)
print(query_embeddings.shape, document_embeddings.shape)
# [1, 1024] [3, 1024]

# Get the similarity scores for the embeddings
similarities = model.similarity(query_embeddings, document_embeddings)
print(similarities)
# tensor([[ 0.7898, -0.0228, -0.0027]])

Training Details

Training Dataset

amazon-reviews-2023

• Dataset: amazon-reviews-2023
• Size: 21,955 training samples
• Columns: title and description
• Approximate statistics based on the first 1000 samples:

  	title	description
  type	string	string
  details	min: 6 tokens mean: 29.97 tokens max: 114 tokens	min: 15 tokens mean: 197.11 tokens max: 512 tokens

• Samples:

  title	description
  Title: Precision Plunger Bars for Cartridge Grips – 93mm – Bag of 10 Plungers	Description: ['The Precision Plunger Bars are designed to work seamlessly with the\xa0Precision Disposable 1. 25" Contoured Soft Cartridge Grips\xa0and the\xa0Precision Disposable 1" Textured Soft Cartridge Grips\xa0to drive cartridge needles with vice style or standard tattoo machine setups. These plunger bars are manufactured from 304 Stainless Steel and feature a brass tip. The plungers are sold in a bag of ten in your choice of 88mm, 93mm, or 98mm length.'] Material: 304 Stainless Steel; Brass tip Lengths Available: 88mm, 93mm, 98mm Accepts cartridge needles with vice style tattoo machines Works perfectly with Precision Disposable Soft Cartridge Grips Price per one bag of 10 plungers
  Title: Lurrose 100Pcs Full Cover Fake Toenails Artificial Transparent Nail Tips Nail Art for DIY	Description: ['Description', 'The false toenails are durable with perfect length. You have the option to wear them long or clip them short, easy to trim and file them to in any length and shape you like. Plus, ABS is kind of green enviromental material, and makes the nails durable, breathable, light even no pressure on your own toenails. Fit well to your natural toenails. Non toxic, no smell, no harm to your health.', 'Feature', '- Color: As Shown.- Material: ABS.- Size: 14.3 x 7.2 x 1cm.', 'Package Including', '100 x Pieces fake toenails'] The false toenails are durable with perfect length. You have the option to wear them long or clip them short, easy to trim and file them to in any length and shape you like. ABS is kind of green enviromental material, and makes the nails durable, breathable, light even no pressure on your own nails. Fit well to your natural toenails. Non toxic, no smell, no harm to your health. Wonderful as gift for girlfriend, family and friends. The easiest and mo...
  Title: Gold extatic Musk EDT 90ml	Description: ['Edt spray 3 oz design house: balmain'] Extatic Balmain Gold Musk By Balmain Edt Spray 3 Oz

• Loss: CachedMultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim",
      "mini_batch_size": 8,
      "gather_across_devices": false
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 512
• num_train_epochs: 1
• warmup_ratio: 0.1
• bf16: True
• push_to_hub: True
• hub_model_id: guyhadad01/EncodeRec_600M_Beauty
• hub_strategy: checkpoint
• prompts: Instruct: Given a web search query, retrieve relevant passages that answer the query Query:

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: no
• prediction_loss_only: True
• per_device_train_batch_size: 512
• per_device_eval_batch_size: 8
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 1
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.1
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• bf16: True
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• project: huggingface
• trackio_space_id: trackio
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: True
• resume_from_checkpoint: None
• hub_model_id: guyhadad01/EncodeRec_600M_Beauty
• hub_strategy: checkpoint
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: no
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: True
• prompts: Instruct: Given a web search query, retrieve relevant passages that answer the query Query:
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional
• router_mapping: {}
• learning_rate_mapping: {}

Framework Versions

• Python: 3.12.11
• Sentence Transformers: 5.1.0
• Transformers: 4.57.0
• PyTorch: 2.7.1+cu126
• Accelerate: 1.10.0
• Datasets: 3.6.0
• Tokenizers: 0.22.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

CachedMultipleNegativesRankingLoss

@misc{gao2021scaling,
    title={Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup},
    author={Luyu Gao and Yunyi Zhang and Jiawei Han and Jamie Callan},
    year={2021},
    eprint={2101.06983},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}