PiGrieco/OpenSesame

README.md

@@ -16,36 +16,23 @@ should probably proofread and complete it, then remove this comment. -->
 
 # OpenSesame
 
-This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on the [this](https://assets-eu.researchsquare.com/files/rs-2370113/v1/090f670e-87cd-40e8-8bf1-51fa9c02d105.pdf?c=1671622196) dataset.
+This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2134
-- Accuracy: 0.9469
-- F1: 0.9574
+- Loss: 0.0985
+- Accuracy: 0.9795
+- F1: 0.9798
 
 ## Model description
 
-This model is part of "Word Of Prompt" library and is intended to detect buying intention in LLM prompt from users.
+More information needed
 
-Label 1 = User has buying intention ;
+## Intended uses & limitations
 
-Label 0 = User hasn't buying intention
+More information needed
 
-# Join The Team
+## Training and evaluation data
 
-You can find our pitch deck here:  [Word Of Prompt - Pitch Deck](https://drive.google.com/file/d/16EdcmIdPV7qq4XihTqDHyvNdUW-N7v4A/view?usp=sharing)
-
-Word of Prompt wants to help LLM and Agent democratization: incertain returns on development of such technologies stop their diffusion.
-
-WoP gives to developers an alternative monetization methodology, meanwhile enhances User Experience: revolutionizing advertising by integrating it seamlessly into AI-driven conversations, enhancing user experience while maintaining the natural flow of dialogue.
-
-Unlike traditional disruptive ads, our integrable library leverages AI to present contextually relevant ads, mirroring the trust and personal touch of word-of-mouth recommendations. 
-This approach ensures that ads are not just seen but are also relevant and timely, significantly increasing engagement and conversion rates. 
-
-In future, we'll develop a managed platform giving marketers a new channel to marketing products and developers a new earning opportunity. 
-
-With Word of Prompt, we’re not just changing how ads are delivered; we’re transforming how they're perceived, making them a valuable addition to every conversation.
-
-If you want to know more or join the team, contact us on LinkedIn: [Piermatteo Grieco](https://www.linkedin.com/in/piermatteo-grieco/)
+More information needed
 
 ## Training procedure
 
@@ -58,21 +45,25 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 4
+- num_epochs: 8
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
-| 0.6007        | 1.0   | 85   | 0.5717          | 0.6681   | 0.6753 |
-| 0.7874        | 2.0   | 170  | 0.9614          | 0.7080   | 0.8081 |
-| 0.3041        | 3.0   | 255  | 0.2079          | 0.9381   | 0.9504 |
-| 0.2707        | 4.0   | 340  | 0.2134          | 0.9469   | 0.9574 |
+| 0.629         | 1.0   | 129  | 0.4584          | 0.8187   | 0.8360 |
+| 0.5446        | 2.0   | 258  | 0.4895          | 0.8275   | 0.8435 |
+| 0.5951        | 3.0   | 387  | 0.3360          | 0.8830   | 0.8895 |
+| 0.4456        | 4.0   | 516  | 0.2366          | 0.9327   | 0.9341 |
+| 0.4282        | 5.0   | 645  | 0.1552          | 0.9591   | 0.9605 |
+| 0.2033        | 6.0   | 774  | 0.1302          | 0.9678   | 0.9687 |
+| 0.1816        | 7.0   | 903  | 0.0925          | 0.9825   | 0.9827 |
+| 0.1283        | 8.0   | 1032 | 0.0985          | 0.9795   | 0.9798 |
 
 
 ### Framework versions
 
-- Transformers 4.41.0
+- Transformers 4.41.2
 - Pytorch 2.3.0+cu121
-- Datasets 2.19.1
+- Datasets 2.19.2
 - Tokenizers 0.19.1

config.json

@@ -21,7 +21,7 @@
   "position_embedding_type": "absolute",
   "problem_type": "single_label_classification",
   "torch_dtype": "float32",
-  "transformers_version": "4.41.0",
+  "transformers_version": "4.41.2",
   "type_vocab_size": 1,
   "use_cache": true,
   "vocab_size": 50265

logs/events.out.tfevents.1717783671.e3a39cc1c013.424.6

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e75c98caf5bd3ab1206917aca76e92301417876505bcc5a90c62eed5b19e9e69
+size 29791

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6f68bc2c783a34a3d049d9eabd510539ce3a223652be2f6331c4373c1b427899
+oid sha256:118f42697472ae7cca2a9a78fdb4f9899e3084e6d42d15764b2e6febb17dee1d
 size 498612824

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0879462cfec5eb926365f4b4b382502c863314d23dceddfb8b45fb37d0676e0d
+oid sha256:92b2b5e84bcc930ed0289d7d9b04422c39fe2d411a8bab8e1cd2ffea8f642bcb
 size 5112