Add README
Browse files
README.md
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language: en
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+
# Sparse BERT base model fine tuned to MNLI (uncased)
|
| 6 |
+
|
| 7 |
+
Fine tuned sparse BERT base to MNLI (GLUE Benchmark) task from [bert-base-uncased-sparse-70-unstructured](https://huggingface.co/Intel/bert-base-uncased-sparse-70-unstructured).
|
| 8 |
+
<br><br>
|
| 9 |
+
Note: This model requires `transformers==2.10.0`
|
| 10 |
+
|
| 11 |
+
## Evaluation Results
|
| 12 |
+
Matched: 82.5%
|
| 13 |
+
Mismatched: 83.3%
|
| 14 |
+
|
| 15 |
+
This model can be further fine-tuned to other tasks and achieve the following evaluation results:
|
| 16 |
+
|
| 17 |
+
| Task | QQP (Acc/F1) | QNLI (Acc) | SST-2 (Acc) | STS-B (Pears/Spear) | SQuADv1.1 (Acc/F1) |
|
| 18 |
+
|------|--------------|------------|-------------|---------------------|--------------------|
|
| 19 |
+
| | 90.2/86.7 | 90.3 | 91.5 | 88.9/88.6 | 80.5/88.2 |
|