zlf18/projfinetuned

SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2

This is a sentence-transformers model finetuned from sentence-transformers/all-MiniLM-L6-v2. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-MiniLM-L6-v2
• Maximum Sequence Length: 256 tokens
• Output Dimensionality: 384 dimensions
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False, 'architecture': 'BertModel'})
  (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("zlf18/projfinetuned")
# Run inference
sentences = [
    'Customer Engineering Manager, State Local Education, Public Sector',
    "Customer Engineering Manager, State Local Education, Public Sector Google Lead a team of Customer Engineers and build a thriving growth culture. Focus on talent strategy and skills development to deliver on successful cloud transformation outcomes for our customers and accelerate business goals for your territory.\nFoster strong partnerships with key customers across the book of business. Provide leadership related to cloud, transformation and relevant industry trends.\nPartner with Google Cloud Sales leadership to define technical go-to-market strategies and execution plan for the team's book of business.\nBalance technical leadership with operational excellence; lead workload and opportunity review meetings and provide insight into how to achieve a technical agreement and migration strategy, working directly with our customers, partners, and prospects.\nWork cross-functionally across Google, our partners, and your team to resolve technical roadblocks including capacity needs, constraints and product issues affecting customer satisfaction. Bachelor's degree or equivalent practical experience.\n10 years of experience with cloud native architecture in a customer-facing or support role.\n3 years of leadership experience, such as people management, team lead, mentorship, or coaching.\nExperience as a Pre-Sales Manager or a people manager in a technical customer-facing role within a Sales Engineering team.\nAbility to travel up to 50% of the time as needed.\n2 years of experience supporting or selling to state, county, local municipal agencies, and academic institutions.\nExperience with software life-cycles, building tools, and architecting and developing software for scalable, distributed systems, including data platform, AI/ML including Generative AI and infrastructure.\nExperience managing a team through sales processes, operations and career development, including account mapping, quota setting, quarterly/annual performance management, and managing sensitive information.\nExperience presenting to technical stakeholders and executive leaders, including delivering messages by the audience, asking tactical questions, and leading conversations that drive business opportunities.\nGoogle is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting. The Google Cloud Platform team helps customers transform and build what's next for their business — all with technology built in the cloud. Our products are developed for security, reliability and scalability, running the full stack from infrastructure to applications to devices and hardware. Our teams are dedicated to helping our customers — developers, small and large businesses, educational institutions and government agencies — see the benefits of our technology come to life. As part of an entrepreneurial team in this rapidly growing business, you will play a key role in understanding the needs of our customers and help shape the future of businesses of all sizes use technology to connect with customers, employees and partners.\nGoogle Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.\nTo all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.",
    "Cook 4 - Full Time, $32.58/hour Aulani, A Disney Resort & Spa Prepares, seasons and cooks to order menu items for all meals throughout the day, including Breakfast, Lunch and Dinner meal periods\nPortions and arranges food on serving dishes and is responsible for portion control and plate presentation\nMay cook, mix, and/or season ingredients to make dressings, sauces, gravies, batters, fillings and spreads\nMay wash, peel, slice, scoop, dice and julienne vegetables and fruits\nPrepares, measures, mixes (following recipes) and/or cooks and garnishes basic appetizers (hot or cold), salads, pastas, sandwich fillings, Waffles and other food items\nSome knowledge of cooking equipment such as grill, gas range, electric range, broiler, deep fat fryer, serving table, waffle iron, griddle, skillets and other standard kitchen equipment\nAbility to prepare products according to recipe guidelines\nKnowledge and understanding of kitchen safety and sanitation including temperature requirements\nHas good judgment of food quality and production, understands the impact of spoilage\nAbility to assist Chef in preparing items for Guests with special dietary needs\nCleans kitchen equipment and practices HACCP (Hazard Analysis and Critical Control Points) Procedures\nExplore our commitments and our work to create a better world through our stories, experiences, operations, and philanthropy. Experience in culinary field/high volume restaurant minimum 3-6 months, or up to 1 year\nAbility to multi task and work in a very fast paced team environment\nDemonstrates a desire to work in a guest service and team environment\nDemonstrates passion and enthusiasm for working in the kitchen\nStrong listening skills and ability to follow direction\nEnrolled in a culinary education program or equivalent\nRecommendation from school\nFood Safety Certification or equivalent\nKnowledge of Hawaiian/Japanese language preferred\nBe Part of the Story There are many different brands and businesses to explore. Once you've found the opportunity that is right for you, take the next step by completing your application.\nThere are many different brands and businesses to explore. Once you've found the opportunity that is right for you, take the next step by completing your application.\nGet the latest job opportunities as they become available.\nJob Category Select a Job Category Administration Animation and Visual Effects Architecture and Design Asset Management Banking Building, Construction and Facilities Business Strategy and Development Call Center Communications Creative Culinary Data Science and Analytics Disneyland Resort Casting Hourly Engineering Finance and Accounting Food and Beverage Gaming and Interactive Governmental Affairs Graphic Design Health Services Horticulture and Landscaping Hotel and Resorts Human Resources Legal and Business Affairs Licensing Maritime and Cruise Operations Marketing and Digital Media Merchandising Operations Production Project Management Publishing Quality Assurance Research and Development Retail Operations Sales Sciences and Animal Programs Security Social Responsibility Sports and Recreation Stage Productions Supply Chain Management Talent Technology Theme Park Operations Walt Disney World Casting Hourly\nJob Level Select Professional Operations / Production Internships / Programs Management Business Support / Administrative Executive Talent 100% full coverage of healthcare for you and your eligible dependents\nFree theme park admission and much more!\nCombining the natural beauty and spirit of the Hawaiian islands with a touch of Disney magic, Aulani, a Disney Resort & Spa embraces and celebrates Hawaiian culture and storytelling. Situated on 21 acres of oceanfront property on the island of O‘ahu, the resort was uniquely designed for families to discover the culture, history and traditions of Hawai‘i against a backdrop of blue skies and beautiful views. Cast members are integral to bringing these stories of Hawai‘i to life, while upholding Disney’s renowned service and enchanting entertainment offerings.\nThe Walt Disney Company, together with its subsidiaries and affiliates, is a leading diversified international family entertainment and media enterprise that includes three core business segments: Disney Entertainment, ESPN, and Disney Experiences. From humble beginnings as a cartoon studio in the 1920s to its preeminent name in the entertainment industry today, Disney proudly continues its legacy of creating world-class stories and experiences for every member of the family. Disney’s stories, characters and experiences reach consumers and guests from every corner of the globe. With operations in more than 40 countries, our employees and cast members work together to create entertainment experiences that are both universally and locally cherished.\nWhere Does Your Story Begin? Explore Disney Careers and the Life at Disney blog to learn about all the amazing opportunities waiting to be discovered at The Walt Disney Company.\nExplore Disney Careers and the Life at Disney blog to learn about all the amazing opportunities waiting to be discovered at The Walt Disney Company.\nOur senior executives bring tremendous experience, visionary thinking and a shared commitment to excellence, creativity and innovation to the day to day operation of the company.\nAt Disney, we are committed to creating a better world. A world of belonging where each person feels seen, heard, and understood. A world filled with hope and promise.\nHeroes Work Here reflects the long history of respect and appreciation Disney has for the U.S. Armed Services. We recognize the commitment and dedication it takes to serve your country, both as military personnel and military spouses, and value the leadership skills and sense of purpose it has instilled in you.",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.5033, 0.0885],
#         [0.5033, 1.0000, 0.0802],
#         [0.0885, 0.0802, 1.0000]])

Training Details

Training Dataset

Unnamed Dataset

• Size: 391 training samples
• Columns: sentence_0 and sentence_1
• Approximate statistics based on the first 391 samples:

  	sentence_0	sentence_1
  type	string	string
  details	min: 2 tokens mean: 7.03 tokens max: 30 tokens	min: 2 tokens mean: 240.47 tokens max: 256 tokens

• Samples:

  sentence_0	sentence_1
  UX Researcher	UX Researcher Dropbox Design and conduct user research studies, including interviews, surveys, and A/B testing. Analyze research data and identify key insights and trends. Create research reports and presentations for stakeholders. Advocate for user needs throughout the product development process. Bachelor's degree in a related field; Master's preferred. 3+ years of experience in UX research. Experience with both qualitative and quantitative research methods. Excellent analytical and communication skills. Plan and execute user research to inform product strategy and design. You will be responsible for designing research studies, analyzing data, and presenting findings to product and engineering teams. This role is critical for ensuring products meet the needs of users.
  Senior PC Support Technician	Senior PC Support Technician Public Storage Diagnose systems and equipment failures and perform corrective actions to resolve any issues. Perform preliminary analysis of major systems problems and escalate the problems in accordance with prescribed procedures. Respond to and manage the IT Service Desk ticket queue and provide principal support on incident resolution. Consult with IT teams and various departments to make sure projects are in line with the company’s IT strategies and plans. Collaborate with existing vendors to evaluate the new technologies that come available and make recommendations to management on possible improvements using these technologies. Installation and maintenance of system updates for OS, software and hardware. Monitor the performance of the company’s desktop infrastructure and make suggestions for improving efficiency. Must be Customer Service oriented and show an ability to take ownership of an issue. One of our values pillars is to work as OneTeam and we ...
  Full Stack Software Engineer, GSCCE	Full Stack Software Engineer, GSCCE Boeing Designs, develops, analyzes, and maintains software systems that meet industry, customer and internal quality, safety, security and certification standards. Completes software system-level analyses to identify risks, issues and opportunities; integrates and deploys mitigation actions throughout the software lifecycle. Performs code reviews to ensure alignment to requirements and standards. Monitors and reviews test completion, verification processes, and issue resolution for software systems. Develops user documentation and training to educate end users about the usage of software products. Develop clean, maintainable, and efficient code within the existing codebase, ensuring alignment with established architecture and coding standards. Works under general direction. Get updates about Boeing job opportunities, events and career information. Our teams are currently hiring for a broad range of experience levels including; Associate, Experienced ...

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim",
      "gather_across_devices": false
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• num_train_epochs: 1
• multi_dataset_batch_sampler: round_robin

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: no
• prediction_loss_only: True
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1
• num_train_epochs: 1
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.0
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch_fused
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: False
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: round_robin
• router_mapping: {}
• learning_rate_mapping: {}

Framework Versions

• Python: 3.12.11
• Sentence Transformers: 5.1.1
• Transformers: 4.56.2
• PyTorch: 2.8.0+cu126
• Accelerate: 1.10.1
• Datasets: 4.0.0
• Tokenizers: 0.22.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}