Update README.md
Browse files
README.md
CHANGED
|
@@ -77,14 +77,14 @@ print(generated_text)
|
|
| 77 |
|
| 78 |
## Results
|
| 79 |
|
| 80 |
-
Below, we present the performance of **LlamaLens** compared to existing SOTA (if available) and the Llama-Instruct baseline, The
|
| 81 |
calculated as **(LLamalens – SOTA)**.
|
| 82 |
|
| 83 |
---
|
| 84 |
|
| 85 |
## Arabic
|
| 86 |
|
| 87 |
-
| **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** |
|
| 88 |
|------------------------|---------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
|
| 89 |
| News Summarization | xlsum | R-2 | 0.137 | 0.034 | 0.075 | -0.062 |
|
| 90 |
| News Genre | ASND | Ma-F1 | 0.770 | 0.587 | 0.938 | 0.168 |
|
|
@@ -117,7 +117,7 @@ calculated as **(LLamalens – SOTA)**.
|
|
| 117 |
|
| 118 |
## English
|
| 119 |
|
| 120 |
-
| **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** |
|
| 121 |
|----------------------|---------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
|
| 122 |
| News Summarization | xlsum | R-2 | 0.152 | 0.074 | 0.141 | -0.011 |
|
| 123 |
| News Genre | CNN_News_Articles | Acc | 0.940 | 0.644 | 0.915 | -0.025 |
|
|
@@ -141,7 +141,7 @@ calculated as **(LLamalens – SOTA)**.
|
|
| 141 |
|
| 142 |
## Hindi
|
| 143 |
|
| 144 |
-
| **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** |
|
| 145 |
|------------------------|------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
|
| 146 |
| NLI | NLI_dataset | W-F1 | 0.646 | 0.633 | 0.655 | 0.009 |
|
| 147 |
| News Summarization | xlsum | R-2 | 0.136 | 0.078 | 0.117 | -0.019 |
|
|
|
|
| 77 |
|
| 78 |
## Results
|
| 79 |
|
| 80 |
+
Below, we present the performance of **LlamaLens** compared to existing SOTA (if available) and the Llama-Instruct baseline, The “Δ” (Delta) column here is
|
| 81 |
calculated as **(LLamalens – SOTA)**.
|
| 82 |
|
| 83 |
---
|
| 84 |
|
| 85 |
## Arabic
|
| 86 |
|
| 87 |
+
| **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** | **Δ** (LLamalens - SOTA) |
|
| 88 |
|------------------------|---------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
|
| 89 |
| News Summarization | xlsum | R-2 | 0.137 | 0.034 | 0.075 | -0.062 |
|
| 90 |
| News Genre | ASND | Ma-F1 | 0.770 | 0.587 | 0.938 | 0.168 |
|
|
|
|
| 117 |
|
| 118 |
## English
|
| 119 |
|
| 120 |
+
| **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** | **Δ** (LLamalens - SOTA) |
|
| 121 |
|----------------------|---------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
|
| 122 |
| News Summarization | xlsum | R-2 | 0.152 | 0.074 | 0.141 | -0.011 |
|
| 123 |
| News Genre | CNN_News_Articles | Acc | 0.940 | 0.644 | 0.915 | -0.025 |
|
|
|
|
| 141 |
|
| 142 |
## Hindi
|
| 143 |
|
| 144 |
+
| **Task** | **Dataset** | **Metric** | **SOTA** | **Llama-instruct** | **LLamalens** | **Δ** (LLamalens - SOTA) |
|
| 145 |
|------------------------|------------------------|-----------:|--------:|--------------------:|--------------:|------------------------------:|
|
| 146 |
| NLI | NLI_dataset | W-F1 | 0.646 | 0.633 | 0.655 | 0.009 |
|
| 147 |
| News Summarization | xlsum | R-2 | 0.136 | 0.078 | 0.117 | -0.019 |
|