|
|
--- |
|
|
library_name: transformers |
|
|
license: apache-2.0 |
|
|
--- |
|
|
|
|
|
| Dataset | Metric | Score | |
|
|
|-----------------------|-----------|-----------| |
|
|
| **flores hin -> eng** | BLEU | 12.8242 | |
|
|
| | chrF | 28.8190 | |
|
|
| | chrF2 | 27.0066 | |
|
|
| | BLEURT | 0.3259 | |
|
|
| **flores eng -> hin** | BLEU | 9.3622 | |
|
|
| | chrF | 22.6860 | |
|
|
| | chrF2 | 21.6604 | |
|
|
| | BLEURT | 0.3374 | |
|
|
| **indicwikibio** | ROUGE-1 | 0.0444 | |
|
|
| | ROUGE-2 | 0.0088 | |
|
|
| | ROUGE-L | 0.0418 | |
|
|
| | BLEURT | 0.2538 | |
|
|
| **indiccopa** | Accuracy | 0.7372 | |
|
|
| | Precision | 0.6857 | |
|
|
| | Recall | 0.8649 | |
|
|
| | F1 | 0.7649 | |
|
|
| **indicsentiment** | Accuracy | 0.8707 | |
|
|
| | Precision | 0.7932 | |
|
|
| | Recall | 0.9980 | |
|
|
| | F1 | 0.8839 | |
|
|
| **indicxparaphrase** | Accuracy | 0.6029 | |
|
|
| | Precision | 0.9905 | |
|
|
| | Recall | 0.2078 | |
|
|
| | F1 | 0.3435 | |
|
|
| **indicxnli** | Accuracy | 0.3715 | |
|
|
| | Precision | 0.7205 | |
|
|
| | Recall | 0.3715 | |
|
|
| | F1 | 0.2437 | |
|
|
| **indicqa** | Exact_match | 3.8785 | |
|
|
| | F1 | 9.4917 | |
