metadata
library_name: setfit
tags:
- setfit
- sentence-transformers
- text-classification
- generated_from_setfit_trainer
metrics:
- accuracy
widget:
- text: >-
<s_cord-v2><s_menu><s_nm> MATERAL REGIP REGORI</s_nm><s_unitprice>
RAKE-16</s_unitprice><s_cnt> VR.284 718</s_cnt><s_price>
RAKE-16</s_price><sep/><s_nm> Challen Nus</s_nm><s_unitprice> RER/Requip
Nc. PMBIRUMABUMAGHOMAN</s_nm><s_unitprice> R&R/Requip DATE
30.AUG-16</s_unitprice><s_cnt> M&R/R/Requip DAIE</s_nm><s_discountprice>
PPONIG/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P/P
- text: >-
<s_cord-v2><s_menu><s_nm> BGM INFRACORE</s_nm><s_num> DETAILE OF REGEPENT
(GILLA)</s_nm><s_num> DATAX</s_cnt><s_price>
CULU04309</s_price><sep/><s_nm> HANDOLCO DOUGTRIES LIMITED WHADOLE NOVOICE
NO</s_nm><s_num> DATE</s_nm><s_num> 113/2213</s_price><sep/><s_nm> AYAPUPU
HURAKUND POWER</s_nm><s_num> NOVOICE DATE</s_nm><s_num>
AYAPYCE</s_nm><s_num> 12/21<s_nm> CIST-SAMGALPUR PO NONE</s_nm><s_num>
33/362<s_etc> 25,736<sep/><s_nm> SATE COGE 21</s_nm><s_num> PFRRIOD
O'SEERVICE:</s_nm><s_num> 22.11.022</s_num><s_price>
0.13.202</s_price><sep/><s_nm> GSTNI</s_nm><s_num> 21AACHM201<sep/><s_nm>
WORE:</s_nm><s_num> 22.11.022</s_num><s_price> WAGONE</s_nm><s_num> PAN NO
AACHA12014</s_num><s_price> 22.11.022</s_price><sep/><s_nm> SPICYICE
DESCIPION</s_nm><s_num> HSH/SMC</s_nm><s_num> JUM RATE</s_nm><s_num>
SRL</s_nm><s_num> JUM WOM RATE</s_nm><s_num> JAMUE</s_nm><s_num>
JINCOCOGAL<sep/><s_nm> UNCOGAL FROM WAGING USING</s_nm><s_num>
SPICYE</s_nm><s_num> DXGPICYE</s_nm><s_num> JUM NATE</s_nm><s_num>
JUMINCOE</s_nm><s_num> 78121600013</s_num><s_price> SUSING<sep/><s_nm>
UNCOGALING COAL HYA USING</s_nm><s_num>
SPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPICYPIC
- text: >-
<s_cord-v2><s_menu><s_nm> Iter Goren received</s_nm><s_cnt>
1</s_cnt><s_price> Mocoonde</s_price><sep/><s_nm> bellowed 22
G/12/11</s_nm><s_cnt> 1</s_cnt><s_discountprice>
-o-</s_discountprice><s_price> ---</s_price><sep/><s_nm> leneen
18</s_nm><s_cnt> 1</s_cnt><s_price> ---</s_price><sep/><s_nm> d.Touble
0&</s_nm><s_unitprice> @2x</s_cnt><s_discountprice>
-o-</s_discountprice><s_price> ---</s_price><sep/><s_nm> Milonea
19</s_nm><s_unitprice> 19</s_unitprice><s_cnt> 1</s_cnt><s_price>
---</s_price><sep/><s_nm> Itellatellat</s_nm><s_unitprice>
22/21</s_unitprice><s_cnt> 1</s_cnt><s_price> ---</s_price><sep/><s_nm>
WELLOW 02/</s_nm><s_unitprice> @2x</s_cnt><s_price>
---</s_price><sep/><s_nm> Milo cover n</s_nm><s_unitprice>
@Mik</s_nm><s_unitprice> @Mik</s_nm><s_unitprice> @Mik</s_cnt><s_price>
---</s_price><sep/><s_nm> V.B.Telle</s_nm><s_unitprice>
@11</s_unitprice><s_cnt> 4</s_cnt><s_price> ---</s_price><sep/><s_nm>
Beneh 1/2</s_nm><s_unitprice> @)</s_nm><s_unitprice>
@11</s_unitprice><s_cnt> 1</s_cnt><s_price> ---</s_price><sep/><s_nm>
- text: >-
<s_cord-v2><s_menu><s_nm> MATERIAL REGGIPT REPORT</s_nm><s_cnt>
6</s_cnt><s_price> WRB SUBMITTED</s_price><sep/><s_nm> WINTHARTY'S
INVICE</s_nm><sep/><s_nm> Java ICE Ndg</s_nm><sep/><s_nm> INVALICE
Dentie</s_nm><s_cnt> 3</s_cnt><sep/><s_nm> MRB/Acecipict
WESKIP/SHR/SHR/LIB/CHAMBMB<sep/><s_nm> Commi<sep/><s_nm> N Nb = PO N.
P/PO/SHR/A/G/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/G/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/A/G/A/A/A/A/A/A/A/A/A/A/G/A/A/A/A/A/A/A/A/G/G/A/G/G/E/G/A/A/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M/M
- text: <s_cord-v2><s_menu><s_nm> RT @kanaka<s_nm> RT @kanaka</s_total>
pipeline_tag: text-classification
inference: true
base_model: BAAI/bge-small-en-v1.5
model-index:
- name: SetFit with BAAI/bge-small-en-v1.5
results:
- task:
type: text-classification
name: Text Classification
dataset:
name: Unknown
type: unknown
split: test
metrics:
- type: accuracy
value: 1
name: Accuracy
SetFit with BAAI/bge-small-en-v1.5
This is a SetFit model that can be used for Text Classification. This SetFit model uses BAAI/bge-small-en-v1.5 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.
The model has been trained using an efficient few-shot learning technique that involves:
- Fine-tuning a Sentence Transformer with contrastive learning.
- Training a classification head with features from the fine-tuned Sentence Transformer.
Model Details
Model Description
- Model Type: SetFit
- Sentence Transformer body: BAAI/bge-small-en-v1.5
- Classification head: a LogisticRegression instance
- Maximum Sequence Length: 512 tokens
- Number of Classes: 4 classes
Model Sources
- Repository: SetFit on GitHub
- Paper: Efficient Few-Shot Learning Without Prompts
- Blogpost: SetFit: Efficient Few-Shot Learning Without Prompts
Model Labels
| Label | Examples |
|---|---|
| 5 |
|
| 6 |
|
| 4 |
|
| 3 |
|
Evaluation
Metrics
| Label | Accuracy |
|---|---|
| all | 1.0 |
Uses
Direct Use for Inference
First install the SetFit library:
pip install setfit
Then you can load this model and run inference.
from setfit import SetFitModel
# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("Gopal2002/setfit_zeon_3456")
# Run inference
preds = model("<s_cord-v2><s_menu><s_nm> RT @kanaka<s_nm> RT @kanaka</s_total>")
Training Details
Training Set Metrics
| Training set | Min | Median | Max |
|---|---|---|---|
| Word count | 2 | 193.4045 | 1530 |
| Label | Training Sample Count |
|---|---|
| 3 | 38 |
| 4 | 45 |
| 5 | 54 |
| 6 | 41 |
Training Hyperparameters
- batch_size: (32, 32)
- num_epochs: (2, 2)
- max_steps: -1
- sampling_strategy: oversampling
- body_learning_rate: (2e-05, 1e-05)
- head_learning_rate: 0.01
- loss: CosineSimilarityLoss
- distance_metric: cosine_distance
- margin: 0.25
- end_to_end: False
- use_amp: False
- warmup_proportion: 0.1
- seed: 42
- eval_max_steps: -1
- load_best_model_at_end: False
Training Results
| Epoch | Step | Training Loss | Validation Loss |
|---|---|---|---|
| 0.0014 | 1 | 0.2908 | - |
| 0.0677 | 50 | 0.1735 | - |
| 0.1353 | 100 | 0.0824 | - |
| 0.2030 | 150 | 0.0505 | - |
| 0.2706 | 200 | 0.014 | - |
| 0.3383 | 250 | 0.0066 | - |
| 0.4060 | 300 | 0.0035 | - |
| 0.4736 | 350 | 0.0018 | - |
| 0.5413 | 400 | 0.0022 | - |
| 0.6089 | 450 | 0.0019 | - |
| 0.6766 | 500 | 0.0015 | - |
| 0.7442 | 550 | 0.0014 | - |
| 0.8119 | 600 | 0.0012 | - |
| 0.8796 | 650 | 0.0013 | - |
| 0.9472 | 700 | 0.0014 | - |
| 1.0149 | 750 | 0.0012 | - |
| 1.0825 | 800 | 0.001 | - |
| 1.1502 | 850 | 0.0012 | - |
| 1.2179 | 900 | 0.001 | - |
| 1.2855 | 950 | 0.0009 | - |
| 1.3532 | 1000 | 0.0009 | - |
| 1.4208 | 1050 | 0.0008 | - |
| 1.4885 | 1100 | 0.001 | - |
| 1.5562 | 1150 | 0.0009 | - |
| 1.6238 | 1200 | 0.001 | - |
| 1.6915 | 1250 | 0.0009 | - |
| 1.7591 | 1300 | 0.0009 | - |
| 1.8268 | 1350 | 0.0008 | - |
| 1.8945 | 1400 | 0.0007 | - |
| 1.9621 | 1450 | 0.0008 | - |
Framework Versions
- Python: 3.10.12
- SetFit: 1.0.2
- Sentence Transformers: 2.2.2
- Transformers: 4.35.2
- PyTorch: 2.1.0+cu121
- Datasets: 2.16.1
- Tokenizers: 0.15.0
Citation
BibTeX
@article{https://doi.org/10.48550/arxiv.2209.11055,
doi = {10.48550/ARXIV.2209.11055},
url = {https://arxiv.org/abs/2209.11055},
author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
title = {Efficient Few-Shot Learning Without Prompts},
publisher = {arXiv},
year = {2022},
copyright = {Creative Commons Attribution 4.0 International}
}