Push model using huggingface_hub.

1_Pooling/config.json

@@ -1,7 +1,7 @@
 {
-    "word_embedding_dimension": 384,
-    "pooling_mode_cls_token": false,
-    "pooling_mode_mean_tokens": true,
+    "word_embedding_dimension": 768,
+    "pooling_mode_cls_token": true,
+    "pooling_mode_mean_tokens": false,
     "pooling_mode_max_tokens": false,
     "pooling_mode_mean_sqrt_len_tokens": false,
     "pooling_mode_weightedmean_tokens": false,

README.md

@@ -1,189 +1,130 @@
 ---
-language:
-- en
-license: apache-2.0
-library_name: setfit
 tags:
 - setfit
 - sentence-transformers
 - text-classification
-- sentiment-analysis
-- few-shot-learning
-pipeline_tag: text-classification
+- generated_from_setfit_trainer
+widget: []
 metrics:
 - accuracy
-- f1
-- precision
-- recall
-model-index:
-- name: SetFit Sentiment Analysis
-  results:
-  - task:
-      type: text-classification
-      name: Sentiment Analysis
-    metrics:
-    - name: Accuracy
-      type: accuracy
-      value: 0.81
-    - name: F1 (Weighted)
-      type: f1
-      value: 0.814252790996977
-    - name: Precision (Weighted)
-      type: precision
-      value: 0.8325319693094628
-    - name: Recall (Weighted)
-      type: recall
-      value: 0.81
+pipeline_tag: text-classification
+library_name: setfit
+inference: true
 ---
 
-# SetFit Sentiment Analysis Model
-
-This is a [SetFit](https://github.com/huggingface/setfit) model fine-tuned for sentiment classification on customer feedback data.
-
-## Model Description
-
-| Property | Value |
-|----------|-------|
-| **Base Model** | [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2) |
-| **Total Parameters** | 22,713,216 |
-| **Trainable Parameters** | 22,713,216 |
-| **Body Parameters** | 22,713,216 |
-| **Head Parameters** | 0 |
-| **Model Size** | 86.64 MB |
-| **Labels** | [0, 1, 2, 3, 4] |
-| **Number of Classes** | 5 |
-| **Serialization** | safetensors |
-
-## Training Configuration
-
-| Parameter | Value |
-|-----------|-------|
-| **Batch Size** | 16 |
-| **Epochs** | [1, 16] |
-| **Training Samples** | 540 |
-| **Test Samples** | 100 |
-| **Loss Function** | CosineSimilarityLoss |
-| **Metric for Best Model** | embedding_loss |
-
-### Training Progress
-
-- **Initial Loss:** 0.4661
-- **Final Loss:** 0.1370
-- **Eval Loss:** 0.1149
-- **Training Runtime:** 594.1215 seconds
-- **Samples/Second:** 18.1780
-
-## Evaluation Results
-
-| Metric | Score |
-|--------|-------|
-| **Accuracy** | 0.8100 |
-| **F1 (Weighted)** | 0.8143 |
-| **F1 (Macro)** | 0.8143 |
-| **Precision (Weighted)** | 0.8325 |
-| **Precision (Macro)** | 0.8325 |
-| **Recall (Weighted)** | 0.8100 |
-| **Recall (Macro)** | 0.8100 |
-
-### Per-Class Performance
+# SetFit
 
-```
-              precision    recall  f1-score   support
+This is a [SetFit](https://github.com/huggingface/setfit) model that can be used for Text Classification. A [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance is used for classification.
 
-           0       0.82      0.70      0.76        20
-           1       0.60      0.75      0.67        20
-           2       0.74      0.85      0.79        20
-           3       1.00      0.75      0.86        20
-           4       1.00      1.00      1.00        20
+The model has been trained using an efficient few-shot learning technique that involves:
 
-    accuracy                           0.81       100
-   macro avg       0.83      0.81      0.81       100
-weighted avg       0.83      0.81      0.81       100
+1. Fine-tuning a [Sentence Transformer](https://www.sbert.net) with contrastive learning.
+2. Training a classification head with features from the fine-tuned Sentence Transformer.
 
-```
+## Model Details
+
+### Model Description
+- **Model Type:** SetFit
+<!-- - **Sentence Transformer:** [Unknown](https://huggingface.co/unknown) -->
+- **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
+- **Maximum Sequence Length:** 512 tokens
+- **Number of Classes:** 5 classes
+<!-- - **Training Dataset:** [Unknown](https://huggingface.co/datasets/unknown) -->
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
 
-## Visualizations
+### Model Sources
 
-### Evaluation Metrics Overview
-<p align="center">
-  <img src="evaluation_metrics.png" alt="Evaluation Metrics" width="800"/>
-</p>
+- **Repository:** [SetFit on GitHub](https://github.com/huggingface/setfit)
+- **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
+- **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
 
-### Confusion Matrix
-<p align="center">
-  <img src="confusion_matrix.png" alt="Confusion Matrix" width="600"/>
-</p>
+## Uses
 
-### Training Loss Curve
-<p align="center">
-  <img src="loss_curve.png" alt="Training Loss Curve" width="600"/>
-</p>
+### Direct Use for Inference
 
-### Learning Rate Schedule
-<p align="center">
-  <img src="learning_rate.png" alt="Learning Rate Schedule" width="600"/>
-</p>
+First install the SetFit library:
 
-## Usage
+```bash
+pip install setfit
+```
+
+Then you can load this model and run inference.
 
 ```python
 from setfit import SetFitModel
 
-# Load the model
-model = SetFitModel.from_pretrained("loganh274/nlp-testing-setfit")
-
-# Single prediction
-text = "This product exceeded my expectations!"
-prediction = model.predict([text])
-print(f"Sentiment: {prediction[0]}")
-
-# Batch prediction
-texts = [
-    "Amazing quality, highly recommend!",
-    "It's okay, nothing special.",
-    "Terrible experience, very disappointed.",
-]
-predictions = model.predict(texts)
-probabilities = model.predict_proba(texts)
-
-for text, pred, prob in zip(texts, predictions, probabilities):
-    print(f"Text: {text}")
-    print(f"  Prediction: {pred}, Confidence: {max(prob):.2%}")
+# Download from the 🤗 Hub
+model = SetFitModel.from_pretrained("setfit_model_id")
+# Run inference
+preds = model("I loved the spiderman movie!")
 ```
 
-## Label Mapping
+<!--
+### Downstream Use
 
-| Label | Sentiment |
-|-------|-----------|
-| 0 | Negative |
-| 1 | Somewhat Negative |
-| 2 | Neutral |
-| 3 | Somewhat Positive |
-| 4 | Positive |
+*List how someone could finetune this model on their own dataset.*
+-->
 
-## Environment
+<!--
+### Out-of-Scope Use
 
-| Package | Version |
-|---------|---------|
-| Python | 3.11.14 |
-| SetFit | 1.1.3 |
-| PyTorch | 2.9.1 |
-| scikit-learn | 1.8.0 |
-| Transformers | N/A |
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
 
-## Citation
+<!--
+## Bias, Risks and Limitations
 
-If you use this model, please cite the SetFit paper:
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
 
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Framework Versions
+- Python: 3.11.14
+- SetFit: 1.1.3
+- Sentence Transformers: 5.2.0
+- Transformers: 4.57.5
+- PyTorch: 2.9.1
+- Datasets: 4.4.2
+- Tokenizers: 0.22.2
+
+## Citation
+
+### BibTeX
 ```bibtex
-@article{tunstall2022efficient,
-  title={Efficient Few-Shot Learning Without Prompts},
-  author={Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
-  journal={arXiv preprint arXiv:2209.11055},
-  year={2022}
+@article{https://doi.org/10.48550/arxiv.2209.11055,
+    doi = {10.48550/ARXIV.2209.11055},
+    url = {https://arxiv.org/abs/2209.11055},
+    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
+    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
+    title = {Efficient Few-Shot Learning Without Prompts},
+    publisher = {arXiv},
+    year = {2022},
+    copyright = {Creative Commons Attribution 4.0 International}
 }
 ```
 
-## License
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
 
-Apache 2.0
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -8,14 +8,20 @@
   "gradient_checkpointing": false,
   "hidden_act": "gelu",
   "hidden_dropout_prob": 0.1,
-  "hidden_size": 384,
+  "hidden_size": 768,
+  "id2label": {
+    "0": "LABEL_0"
+  },
   "initializer_range": 0.02,
-  "intermediate_size": 1536,
+  "intermediate_size": 3072,
+  "label2id": {
+    "LABEL_0": 0
+  },
   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 512,
   "model_type": "bert",
   "num_attention_heads": 12,
-  "num_hidden_layers": 6,
+  "num_hidden_layers": 12,
   "pad_token_id": 0,
   "position_embedding_type": "absolute",
   "transformers_version": "4.57.5",

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:18a663e92fec7aa0b54431fa5c10a1481be64df6b7f98defb81887c939f13c28
-size 90864192
+oid sha256:e7ebb39c9b6f04b72a435dd467d6e4a6f8da9a408fdc023095d39b52b19a6601
+size 437951328

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c3e83f7cb8466031df74b40f5ca1f8cc3e3d217bf29f4ff1b64b512bc01c5e0a
-size 16287
+oid sha256:e36d4eac37889fc53236f989c8cd99a56b01cb93c4aa604178f503c6f52f5388
+size 31647

sentence_bert_config.json

@@ -1,4 +1,4 @@
 {
-    "max_seq_length": 256,
-    "do_lower_case": false
+    "max_seq_length": 512,
+    "do_lower_case": true
 }

tokenizer.json

@@ -2,7 +2,7 @@
   "version": "1.0",
   "truncation": {
     "direction": "Right",
-    "max_length": 256,
+    "max_length": 512,
     "strategy": "LongestFirst",
     "stride": 0
   },

tokenizer_config.json

@@ -41,14 +41,14 @@
       "special": true
     }
   },
-  "clean_up_tokenization_spaces": false,
+  "clean_up_tokenization_spaces": true,
   "cls_token": "[CLS]",
   "do_basic_tokenize": true,
   "do_lower_case": true,
   "extra_special_tokens": {},
   "mask_token": "[MASK]",
-  "max_length": 128,
-  "model_max_length": 256,
+  "max_length": 512,
+  "model_max_length": 512,
   "never_split": null,
   "pad_to_multiple_of": null,
   "pad_token": "[PAD]",