Training in progress, epoch 4, checkpoint

last-checkpoint/README.md

@@ -7,7 +7,6 @@ tags:
 - generated_from_trainer
 - dataset_size:291522
 - loss:MultipleNegativesSymmetricRankingLoss
-base_model: sentence-transformers/all-MiniLM-L6-v2
 widget:
 - source_sentence: cream 21 baby oil with almond oil
   sentences:
@@ -41,7 +40,7 @@ library_name: sentence-transformers
 metrics:
 - cosine_accuracy
 model-index:
-- name: SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2
+- name: SentenceTransformer
   results:
   - task:
       type: triplet
@@ -51,19 +50,19 @@ model-index:
       type: unknown
     metrics:
     - type: cosine_accuracy
-      value: 0.9337190985679626
+      value: 0.9330878257751465
       name: Cosine Accuracy
 ---
 
-# SentenceTransformer based on sentence-transformers/all-MiniLM-L6-v2
+# SentenceTransformer
 
-This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+This is a [sentence-transformers](https://www.SBERT.net) model trained. It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
 
 ## Model Details
 
 ### Model Description
 - **Model Type:** Sentence Transformer
-- **Base model:** [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) <!-- at revision c9745ed1d9f207416be6d2e6f8de32d1f16199bf -->
+<!-- - **Base model:** [Unknown](https://huggingface.co/unknown) -->
 - **Maximum Sequence Length:** 256 tokens
 - **Output Dimensionality:** 384 dimensions
 - **Similarity Function:** Cosine Similarity
@@ -116,9 +115,9 @@ print(embeddings.shape)
 # Get the similarity scores for the embeddings
 similarities = model.similarity(embeddings, embeddings)
 print(similarities)
-# tensor([[1.0000, 0.7955, 0.3891],
-#         [0.7955, 1.0000, 0.4118],
-#         [0.3891, 0.4118, 1.0000]])
+# tensor([[1.0000, 0.7646, 0.3896],
+#         [0.7646, 1.0000, 0.3910],
+#         [0.3896, 0.3910, 1.0000]])
 ```
 
 <!--
@@ -155,7 +154,7 @@ You can finetune this model on your own dataset.
 
 | Metric              | Value      |
 |:--------------------|:-----------|
-| **cosine_accuracy** | **0.9337** |
+| **cosine_accuracy** | **0.9331** |
 
 <!--
 ## Bias, Risks and Limitations
@@ -230,6 +229,7 @@ You can finetune this model on your own dataset.
 - `per_device_train_batch_size`: 256
 - `per_device_eval_batch_size`: 256
 - `weight_decay`: 0.001
+- `num_train_epochs`: 5
 - `warmup_steps`: 1138
 - `fp16`: True
 - `dataloader_num_workers`: 4
@@ -260,7 +260,7 @@ You can finetune this model on your own dataset.
 - `adam_beta2`: 0.999
 - `adam_epsilon`: 1e-08
 - `max_grad_norm`: 1.0
-- `num_train_epochs`: 3
+- `num_train_epochs`: 5
 - `max_steps`: -1
 - `lr_scheduler_type`: linear
 - `lr_scheduler_kwargs`: {}
@@ -364,13 +364,9 @@ You can finetune this model on your own dataset.
 </details>
 
 ### Training Logs
-| Epoch  | Step | Training Loss | Validation Loss | cosine_accuracy |
-|:------:|:----:|:-------------:|:---------------:|:---------------:|
-| -1     | -1   | -             | -               | 0.8861          |
-| 0.0009 | 1    | 5.8495        | -               | -               |
-| 1.0    | 1139 | 3.0136        | 0.8482          | 0.9113          |
-| 2.0    | 2278 | 2.2096        | 0.7465          | 0.9241          |
-| 3.0    | 3417 | 1.966         | 0.6980          | 0.9337          |
+| Epoch | Step | Training Loss | Validation Loss | cosine_accuracy |
+|:-----:|:----:|:-------------:|:---------------:|:---------------:|
+| 4.0   | 4556 | 1.8731        | 0.7003          | 0.9331          |
 
 
 ### Framework Versions

last-checkpoint/model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5e94dfce1c7a8097a517cdc7e18867845b8cf07b8debbb4c7f86dacfe33f0ad0
+oid sha256:2752eb8ccd6b0b27067ab743dbf88be10d7f0ec0acd07f271adac6466a8f5533
 size 90864192

last-checkpoint/optimizer.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b6e5d3026902eda477b64ceaeccd2e204dd15555061fe0a6a4f2baabb9021e9a
+oid sha256:5c1aba1b25c91aca84ea8033a997c1f341126a19d27ece980f574b412e4f2590
 size 180607738

last-checkpoint/rng_state.pth

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0bd7c67a9db13a1d1d92181014a6e67813669ee1bbe4529e719f8b5106877aef
+oid sha256:4a52c27da178d4afa8ec10888c749f1ddbdcd600f8a415730f56aaf2049e7873
 size 14244

last-checkpoint/scaler.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:67a6b234e82620ea3da8e2a9835166f15a378f21f79ddb4af11eb7a0b287008f
+oid sha256:62e15eeadf456bba5e7d820c26dd489bf5b9eaafa907595755c9e54b984e4c99
 size 988

last-checkpoint/scheduler.pt

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ecbc50cd28f5eb9a427ea169ea55add1d74447c6784544c0cff4a17d832f4ec4
+oid sha256:3090648633fa78302c01f4e8a9a19ea7264f91a0a6f0c04a8378cf412f6c472b
 size 1064

last-checkpoint/trainer_state.json

@@ -2,9 +2,9 @@
   "best_global_step": null,
   "best_metric": null,
   "best_model_checkpoint": null,
-  "epoch": 3.0,
+  "epoch": 4.0,
   "eval_steps": 500,
-  "global_step": 3417,
+  "global_step": 4556,
   "is_hyper_param_search": false,
   "is_local_process_zero": true,
   "is_world_process_zero": true,
@@ -63,12 +63,28 @@
       "eval_samples_per_second": 274.957,
       "eval_steps_per_second": 1.099,
       "step": 3417
+    },
+    {
+      "epoch": 4.0,
+      "grad_norm": 9.933394432067871,
+      "learning_rate": 1.251920122887865e-05,
+      "loss": 1.8731,
+      "step": 4556
+    },
+    {
+      "epoch": 4.0,
+      "eval_cosine_accuracy": 0.9330878257751465,
+      "eval_loss": 0.700294554233551,
+      "eval_runtime": 33.7886,
+      "eval_samples_per_second": 281.308,
+      "eval_steps_per_second": 1.125,
+      "step": 4556
     }
   ],
   "logging_steps": 500,
-  "max_steps": 3417,
+  "max_steps": 5695,
   "num_input_tokens_seen": 0,
-  "num_train_epochs": 3,
+  "num_train_epochs": 5,
   "save_steps": 500,
   "stateful_callbacks": {
     "TrainerControl": {
@@ -77,7 +93,7 @@
         "should_evaluate": false,
         "should_log": false,
         "should_save": true,
-        "should_training_stop": true
+        "should_training_stop": false
       },
       "attributes": {}
     }

last-checkpoint/training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0b003a2d7d735bc23e787cd4f733f53209d08e4cdf3b8af1d2531e29e0efe3b3
+oid sha256:b486c431839a52a655f907407f9ba44cb3ea4d7311c1b455747f81e30659d4c4
 size 5752