---
library_name: transformers
license: apache-2.0
---

| Dataset               | Metric    | Score     |
|-----------------------|-----------|-----------|
| **flores hin -> eng** | BLEU      | 12.8242   |
|                       | chrF      | 28.8190   |
|                       | chrF2     | 27.0066   |
|                       | BLEURT    | 0.3259    |
| **flores eng -> hin** | BLEU      | 9.3622    |
|                       | chrF      | 22.6860   |
|                       | chrF2     | 21.6604   |
|                       | BLEURT    | 0.3374    |
| **indicwikibio**      | ROUGE-1   | 0.0444    |
|                       | ROUGE-2   | 0.0088    |
|                       | ROUGE-L   | 0.0418    |
|                       | BLEURT    | 0.2538    |
| **indiccopa**         | Accuracy  | 0.7372    |
|                       | Precision | 0.6857    |
|                       | Recall    | 0.8649    |
|                       | F1        | 0.7649    |
| **indicsentiment**    | Accuracy  | 0.8707    |
|                       | Precision | 0.7932    |
|                       | Recall    | 0.9980    |
|                       | F1        | 0.8839    |
| **indicxparaphrase**  | Accuracy  | 0.6029    |
|                       | Precision | 0.9905    |
|                       | Recall    | 0.2078    |
|                       | F1        | 0.3435    |
| **indicxnli**         | Accuracy  | 0.3715    |
|                       | Precision | 0.7205    |
|                       | Recall    | 0.3715    |
|                       | F1        | 0.2437    |
| **indicqa**           | Exact_match  | 3.8785    |
|                       | F1 | 9.4917    |