SentenceTransformer based on google/embeddinggemma-300m

This is a sentence-transformers model finetuned from google/embeddinggemma-300m. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

Model Type: Sentence Transformer
Base model: google/embeddinggemma-300m
Maximum Sequence Length: 128 tokens
Output Dimensionality: 768 dimensions
Similarity Function: Cosine Similarity

Model Sources

Documentation: Sentence Transformers Documentation
Repository: Sentence Transformers on GitHub
Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 128, 'do_lower_case': False, 'architecture': 'Gemma3TextModel'})
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Dense({'in_features': 768, 'out_features': 3072, 'bias': False, 'activation_function': 'torch.nn.modules.linear.Identity'})
  (3): Dense({'in_features': 3072, 'out_features': 768, 'bias': False, 'activation_function': 'torch.nn.modules.linear.Identity'})
  (4): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("yippyyipyip/embeddinggemma-300m-tripletloss")
# Run inference
queries = [
    "A hard, brittle, heat-resistant material made from shaped and fired nonmetallic minerals, most commonly clay. Includes both glazed and unglazed forms such as porcelain and stoneware. Ceramic containers have a smooth surface and are used for decorative pots.",
]
documents = [
    "Product Description: Bring a hint of the outdoors into your home with this elegant faux hydrangea arrangement. It's arranged in a decorative ceramic vase for a sophisticated touch. Lush with lifelike detail, this collection of blossoms brings a classic springtime vibe to your dining table or console. It easily complements any room's aesthetic, whether in your home or office. Made from a combination of plastic and polysilk, this artificial arrangement also has vibrant green leaves and stems to complete the look. Features: - Ideal for dining tables, hallway consoles, kitchen islands, and other surfaces - Great for all occasions, from weddings and parties to banquets and showers - Holiday: Easter, Mother's Day, birthday - Perfect for any season",
    "Product Description: Add a lively pop of greenery to your space with this cheerful artificial grass and daisy arrangement. Set in a black pot, the 48'' tall design features long, wispy blades of green grass accented by bright white faux daisies for a sun-kissed, natural look. Made from durable plastic, the stems and petals offer realistic texture without the upkeep of live plants. This piece is perfect for brightening up a covered porch, sunny nook, or empty corner. We love that it brings fresh, seasonal charm to your décor year-round. Features: - Includes black plastic pot for instant display - Realistic grass and white daisies made from plastic - Stands 48'' tall to make a statement indoors or on covered patios",
    'Product Description: This curio cabinet is a versatile addition to your home, perfect for showcasing your favorite decor or cherished collections. Crafted from engineered wood with a mirrored glass exterior, it features two hinged doors that open to reveal three shelves, including one adjustable, for all your display needs. The tempered glass panels in the doors provide a clear view of your items, while the lacquered finish adds a subtle sheen. Its compact 23” width makes it a smart choice for smaller spaces. Plus, it includes a wall anchor for added safety and stability.\n\nHand-curated by Kelly Clarkson.\n Features: - Ample Storage: Three shelves provide space for various items - Adjustable Shelf: One shelf offers three height placement options - Dust-Free Storage: Keeps items clean and organized - Display Tabletop: Surface suitable for picture frames, vases, and lamps',
]
query_embeddings = model.encode_query(queries)
document_embeddings = model.encode_document(documents)
print(query_embeddings.shape, document_embeddings.shape)
# [1, 768] [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(query_embeddings, document_embeddings)
print(similarities)
# tensor([[-0.9969, -0.9973,  0.9987]])

Training Details

Training Dataset

Unnamed Dataset

Size: 479 training samples
Columns: sentence_0, sentence_1, and sentence_2

Approximate statistics based on the first 479 samples:

	sentence_0	sentence_1	sentence_2
type	string	string	string
details	min: 36 tokens mean: 41.12 tokens max: 117 tokens	min: 55 tokens mean: 123.06 tokens max: 128 tokens	min: 55 tokens mean: 123.51 tokens max: 128 tokens

Samples:

sentence_0	sentence_1	sentence_2
`Indicates that the product does not have drawer glides, making this attribute irrelevant or not applicable. Select only when there are no drawer glides present in the product.`	Product Description: This console table highlights a sleek, modern silhouette and features mixed materials for your space. It has an open, airy frame with three legs that meet in the middle. Crafted from solid wood, this distressed frame comes in a rich brown hue for rustic charm and a well-worn look. The tabletop is oval-shaped and made of a concrete composite that's been wire-brushed in a rustic gray finish. At over 29" tall and 54" wide, this table fits nicely behind your living room sofa or is ready to greet guests in your entryway. Features: - Concrete composite tops - Built up edge - Soft shapes create contemporary feel - Interlocking shaped legs add soft appeal	Product Description: The Chupp 47.3'' Solid Wood Top Console Table offers a perfect blend of understated elegance and practical design, making it an effortless addition to a variety of interior styles. Crafted from solid and engineered wood, this console table features a neutral finish that complements any room palette. Its rectangular shape and compact 13-inch depth make it an ideal choice for smaller spaces such as entryways or hallways, providing both style and function without overwhelming your decor. Our Chupp Console Table is thoughtfully designed with three spacious drawers, each adorned with oversized herringbone patterns and simple metal pulls for a modern yet classic look. The gracefully turned legs add a subtle touch of sophistication, while the lower shelf provides a convenient spot to display decorative accessories or store essentials. Whether you need a stylish entryway catchall or an elegant accent piece, this console table combines durability, beauty, and functionality...
`Indicates that the product does not have drawer glides, making this attribute irrelevant or not applicable. Select only when there are no drawer glides present in the product.`	Product Description: This console table is a sleek, stylish addition to your home, offering a perfect balance of charm and practicality. It's crafted from solid wood that's built to withstand spills while bringing a warm, natural feel to your space. Standing at 31.5'' tall, it's just the right height for displaying your favorite décor or catching keys as you walk through the door. There's not only a spacious surface but a low slatted shelf for baskets, bins, or potted plants. This table is the ideal accent in your entryway or living room. Features: - Solid wood construction for durability and easy maintenance - An open shelf for versatile storage - Available in a dynamic finish of your choice - Handcrafted with care	Product Description: This console table combines natural touches with a modern mixed-material look for a casual, everyday vibe we love. It's made from solid oak wood with a brown finish that shows off the wood's natural grain color variation. Four shelves provide ample space to store or show off just about anything, while the 2 floating drawers with metal pulls offer additional out-of-sight storage we love. Our favorite detail is the Indian quartz tabletop, which adds a crisp contrast set against the rest of the table. Features: - Transitional design This console table embraces a mixed materials design that will blend right in with and enhance traditional, modern, and other décor styles - Stylish details: This natural wood console table is finished with a white quartz tabletop and metal pulls for a distinguished look and modern feel - Ample storage space: A broad tabletop, four open shelves, and two floating drawers provide ample room to display your favorite décor and store living ess...
`Indicates that the product does not have drawer glides, making this attribute irrelevant or not applicable. Select only when there are no drawer glides present in the product.`	Product Description: This console table elevates your space with a classic look that's ideal for a modern farmhouse aesthetic. It's crafted from engineered wood with a petite, rectangular silhouette. The design features two side supports with X-shaped accents that remind us of barn architecture. We love that the lower shelf is ideal for storage bins, baskets, or boxes, and the top is great for florals, picture frames, and decorative trays. Our favorite? It's scratch-resistant for holding up to everyday use in your hallway or living room. Features: - A modern farmhouse sofa table is a charming addition with a relaxed and inviting ambiance - The classic long, narrow silhouette works in an entry or living room - A full lower shelf is great for storage and display - X-cross accents add detail and character to the table - A stylish wood-toned finish adds casual appeal - Laminate surfaces resist scratches and are easy to clean	Product Description: This console table offers functional storage and a vintage-inspired, boho look to complete your space. It's crafted from solid and engineered wood in a distressed brown finish that gives it the feel of a great flea market find. The design features a lower open shelf, great for stylish baskets, a top surface for the display of decor, and two drawers for tucking away smaller items like keys or charging cords. We love the classic turned legs and the scrollwork on the drawer fronts that complete the elegant yet laid-back vibe of this boho sideboard. Features: - Sturdy and durable - Designed with distressed brown and slight white finishes, retro-style bohemian pattern design on two drawers, adding a unique farmhouse charm to any space. - 2 convenient drawerss with iron slide rail allows for easy access to items stored inside and ensures smooth operation without getting stuck.

Loss: TripletLoss with these parameters:

{
    "distance_metric": "TripletDistanceMetric.EUCLIDEAN",
    "triplet_margin": 5
}

Training Hyperparameters

Non-Default Hyperparameters

per_device_train_batch_size: 16
per_device_eval_batch_size: 16
num_train_epochs: 4
multi_dataset_batch_sampler: round_robin

All Hyperparameters

Click to expand

do_predict: False
eval_strategy: no
prediction_loss_only: True
per_device_train_batch_size: 16
per_device_eval_batch_size: 16
gradient_accumulation_steps: 1
eval_accumulation_steps: None
torch_empty_cache_steps: None
learning_rate: 5e-05
weight_decay: 0.0
adam_beta1: 0.9
adam_beta2: 0.999
adam_epsilon: 1e-08
max_grad_norm: 1
num_train_epochs: 4
max_steps: -1
lr_scheduler_type: linear
lr_scheduler_kwargs: None
warmup_ratio: None
warmup_steps: 0
log_level: passive
log_level_replica: warning
log_on_each_node: True
logging_nan_inf_filter: True
enable_jit_checkpoint: False
save_on_each_node: False
save_only_model: False
restore_callback_states_from_checkpoint: False
use_cpu: False
seed: 42
data_seed: None
bf16: False
fp16: False
bf16_full_eval: False
fp16_full_eval: False
tf32: None
local_rank: -1
ddp_backend: None
debug: []
dataloader_drop_last: False
dataloader_num_workers: 0
dataloader_prefetch_factor: None
disable_tqdm: False
remove_unused_columns: True
label_names: None
load_best_model_at_end: False
ignore_data_skip: False
fsdp: []
fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
parallelism_config: None
deepspeed: None
label_smoothing_factor: 0.0
optim: adamw_torch_fused
optim_args: None
group_by_length: False
length_column_name: length
project: huggingface
trackio_space_id: trackio
ddp_find_unused_parameters: None
ddp_bucket_cap_mb: None
ddp_broadcast_buffers: False
dataloader_pin_memory: True
dataloader_persistent_workers: False
skip_memory_metrics: True
push_to_hub: False
resume_from_checkpoint: None
hub_model_id: None
hub_strategy: every_save
hub_private_repo: None
hub_always_push: False
hub_revision: None
gradient_checkpointing: False
gradient_checkpointing_kwargs: None
include_for_metrics: []
eval_do_concat_batches: True
auto_find_batch_size: False
full_determinism: False
ddp_timeout: 1800
torch_compile: False
torch_compile_backend: None
torch_compile_mode: None
include_num_input_tokens_seen: no
neftune_noise_alpha: None
optim_target_modules: None
batch_eval_metrics: False
eval_on_start: False
use_liger_kernel: False
liger_kernel_config: None
eval_use_gather_object: False
average_tokens_across_devices: True
use_cache: False
prompts: None
batch_sampler: batch_sampler
multi_dataset_batch_sampler: round_robin
router_mapping: {}
learning_rate_mapping: {}

Framework Versions

Python: 3.12.3
Sentence Transformers: 5.2.2
Transformers: 5.0.0
PyTorch: 2.10.0+cu128
Accelerate: 1.12.0
Datasets: 4.5.0
Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

TripletLoss

@misc{hermans2017defense,
    title={In Defense of the Triplet Loss for Person Re-Identification},
    author={Alexander Hermans and Lucas Beyer and Bastian Leibe},
    year={2017},
    eprint={1703.07737},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}