Update README.md
Browse files
README.md
CHANGED
|
@@ -1,6 +1,9 @@
|
|
| 1 |
---
|
| 2 |
tags:
|
| 3 |
- intent, topic-discovery
|
|
|
|
|
|
|
|
|
|
| 4 |
---
|
| 5 |
# Model Card for Model ID
|
| 6 |
|
|
@@ -116,10 +119,10 @@ Using HF trainer
|
|
| 116 |
## Evaluation
|
| 117 |
|
| 118 |
<!-- This section describes the evaluation protocols and provides the results. -->
|
| 119 |
-
The newest version of the model is finetuned on 2 synthetic datasets
|
| 120 |
-
All datasets have 10-20 samples per class.
|
| 121 |
|
| 122 |
-
Atis test set evaluation: weighted F1
|
| 123 |
Clinc test set is next.
|
| 124 |
|
| 125 |
|
|
|
|
| 1 |
---
|
| 2 |
tags:
|
| 3 |
- intent, topic-discovery
|
| 4 |
+
datasets:
|
| 5 |
+
- tuetschek/atis
|
| 6 |
+
- clinc/clinc_oos
|
| 7 |
---
|
| 8 |
# Model Card for Model ID
|
| 9 |
|
|
|
|
| 119 |
## Evaluation
|
| 120 |
|
| 121 |
<!-- This section describes the evaluation protocols and provides the results. -->
|
| 122 |
+
The newest version of the model is finetuned on 2 synthetic datasets and 41 first classes of clinc_oos in a few shot manner.
|
| 123 |
+
All datasets have 10-20 samples per class. Training data did not include Atis dataset.
|
| 124 |
|
| 125 |
+
Atis zero shot test set evaluation: weighted F1 87%
|
| 126 |
Clinc test set is next.
|
| 127 |
|
| 128 |
|