Leo1212 commited on
Commit
db55639
·
verified ·
1 Parent(s): 0d4f5ba

Add SetFit model

Browse files
Files changed (1) hide show
  1. README.md +22 -27
README.md CHANGED
@@ -2,7 +2,7 @@
2
  base_model: HSLU-AICOMP-LearningAgencyLab/automated-essay-scoring-setfit-finetuned
3
  library_name: setfit
4
  metrics:
5
- - accuracy
6
  pipeline_tag: text-classification
7
  tags:
8
  - setfit
@@ -11,6 +11,20 @@ tags:
11
  - generated_from_setfit_trainer
12
  widget: []
13
  inference: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  ---
15
 
16
  # SetFit with HSLU-AICOMP-LearningAgencyLab/automated-essay-scoring-setfit-finetuned
@@ -40,6 +54,13 @@ The model has been trained using an efficient few-shot learning technique that i
40
  - **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
41
  - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
42
 
 
 
 
 
 
 
 
43
  ## Uses
44
 
45
  ### Direct Use for Inference
@@ -87,32 +108,6 @@ preds = model("I loved the spiderman movie!")
87
 
88
  ## Training Details
89
 
90
- ### Training Hyperparameters
91
- - batch_size: (2, 2)
92
- - num_epochs: (3, 3)
93
- - max_steps: -1
94
- - sampling_strategy: oversampling
95
- - body_learning_rate: (2e-05, 1e-05)
96
- - head_learning_rate: 0.01
97
- - loss: CosineSimilarityLoss
98
- - distance_metric: cosine_distance
99
- - margin: 0.25
100
- - end_to_end: False
101
- - use_amp: True
102
- - warmup_proportion: 0.1
103
- - l2_weight: 0.01
104
- - seed: 42
105
- - eval_max_steps: -1
106
- - load_best_model_at_end: True
107
-
108
- ### Training Results
109
- | Epoch | Step | Training Loss | Validation Loss |
110
- |:------:|:-----:|:-------------:|:---------------:|
111
- | 0.0001 | 1 | 0.0001 | - |
112
- | 1.0 | 17265 | 0.0525 | 0.0835 |
113
- | 2.0 | 34530 | 0.0342 | 0.1366 |
114
- | 3.0 | 51795 | 0.0084 | 0.1718 |
115
-
116
  ### Framework Versions
117
  - Python: 3.11.9
118
  - SetFit: 1.1.0
 
2
  base_model: HSLU-AICOMP-LearningAgencyLab/automated-essay-scoring-setfit-finetuned
3
  library_name: setfit
4
  metrics:
5
+ - qwk
6
  pipeline_tag: text-classification
7
  tags:
8
  - setfit
 
11
  - generated_from_setfit_trainer
12
  widget: []
13
  inference: true
14
+ model-index:
15
+ - name: SetFit with HSLU-AICOMP-LearningAgencyLab/automated-essay-scoring-setfit-finetuned
16
+ results:
17
+ - task:
18
+ type: text-classification
19
+ name: Text Classification
20
+ dataset:
21
+ name: Unknown
22
+ type: unknown
23
+ split: test
24
+ metrics:
25
+ - type: qwk
26
+ value: 0.9421066738139909
27
+ name: Qwk
28
  ---
29
 
30
  # SetFit with HSLU-AICOMP-LearningAgencyLab/automated-essay-scoring-setfit-finetuned
 
54
  - **Paper:** [Efficient Few-Shot Learning Without Prompts](https://arxiv.org/abs/2209.11055)
55
  - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
56
 
57
+ ## Evaluation
58
+
59
+ ### Metrics
60
+ | Label | Qwk |
61
+ |:--------|:-------|
62
+ | **all** | 0.9421 |
63
+
64
  ## Uses
65
 
66
  ### Direct Use for Inference
 
108
 
109
  ## Training Details
110
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
111
  ### Framework Versions
112
  - Python: 3.11.9
113
  - SetFit: 1.1.0