Transformers
PyTorch
I-SPIn
Lutech-admin commited on
Commit
0c2b60a
·
1 Parent(s): 0ff6910

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -1
README.md CHANGED
@@ -186,7 +186,17 @@ ISPIn(
186
  ```
187
 
188
  ## Evaluation results
189
- #TODO
 
 
 
 
 
 
 
 
 
 
190
 
191
  ## Next steps
192
  1. Create an open library called ISPIn that lets the user to run directly the model without adding any additional code to a project.
 
186
  ```
187
 
188
  ## Evaluation results
189
+ ```markdown
190
+ | Dataset | Metric | Performance |
191
+ |:--------------------------------------:|--------------|-------------|
192
+ | RTE3-ITA | Accuracy | 68% |
193
+ | RTE3-ITA | Min F1-Score | 60% |
194
+ | RTE-2009 | Accuracy | 59% |
195
+ | RTE-2009 | Min F1-Score | 31% |
196
+ | SNLI (IT) translated w/NLLB | Accuracy | 74% |
197
+ | MNLI-Matched (IT) translated w/NLLB | Accuracy | 72% |
198
+ | MNLI-Mismatched (IT) translated w/NLLB | Accuracy | 73% |
199
+ ```
200
 
201
  ## Next steps
202
  1. Create an open library called ISPIn that lets the user to run directly the model without adding any additional code to a project.