Update README.md

README.md

@@ -14,33 +14,46 @@ datasets:
 Released August 11, 2023
 
 ## Model Description
-GodziLLa 2 70B is an experimental combination of various proprietary LoRAs from Maya Philippines and [Guanaco LLaMA 2 1K dataset](https://huggingface.co/datasets/mlabonne/guanaco-llama2-1k), with LLaMA 2 70B.  This model's primary purpose is to stress test the limitations of composite, instruction-following LLMs and observe its performance with respect to other LLMs available on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard). This model debuted in the leaderboard at rank #4 (August 17, 2023) and operates under the Llama 2 license.
+GodziLLa 2 70B is an experimental combination of various proprietary LoRAs from Maya Philippines and [Guanaco LLaMA 2 1K dataset](https://huggingface.co/datasets/mlabonne/guanaco-llama2-1k), with LLaMA 2 70B.  This model's primary purpose is to stress test the limitations of composite, instruction-following LLMs and observe its performance with respect to other LLMs available on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard). This model debuted in the leaderboard at rank #4 (August 17, 2023), debuted in the Fall 2023 update at rank #2 (November, 10, 2023), and operates under the Llama 2 license.
 ![Godzilla Happy GIF](https://i.pinimg.com/originals/81/3a/e0/813ae09a30f0bc44130cd2c834fe2eba.gif)
 
-## Open LLM Leaderboard Metrics
+## Open LLM Leaderboard Metrics (Fall 2023 update)
 | Metric                | Value |
 |-----------------------|-------|
 | MMLU (5-shot)         | 69.88  |
 | ARC (25-shot)         | 71.42  |
 | HellaSwag (10-shot)   | 87.53  |
 | TruthfulQA (0-shot)   | 61.54  |
-| Average               | 72.59  |
+| Winogrande (5-shot)   | 83.19  |
+| GSM8K (5-shot)        | 43.21  |
+| DROP (3-shot)         | 52.31  |
+| Average               | 67.01  |
 
 According to the leaderboard description, here are the benchmarks used for the evaluation:
 - [MMLU](https://arxiv.org/abs/2009.03300) (5-shot) - a test to measure a text model’s multitask accuracy. The test covers 57 tasks including elementary mathematics, US history, computer science, law, and more.
 - [AI2 Reasoning Challenge](https://arxiv.org/abs/1803.05457) -ARC- (25-shot) - a set of grade-school science questions.
 - [HellaSwag](https://arxiv.org/abs/1905.07830) (10-shot) - a test of commonsense inference, which is easy for humans (~95%) but challenging for SOTA models.
 - [TruthfulQA](https://arxiv.org/abs/2109.07958) (0-shot) - a test to measure a model’s propensity to reproduce falsehoods commonly found online.
+- [Winogrande](https://arxiv.org/abs/1907.10641) (5-shot) - an adversarial and difficult Winograd benchmark at scale, for commonsense reasoning.
+- [GSM8k](https://arxiv.org/abs/2110.14168) (5-shot) - diverse grade school math word problems to measure a model's ability to solve multi-step mathematical reasoning problems.
+- [DROP](https://arxiv.org/abs/1903.00161) (3-shot) - English reading comprehension benchmark requiring Discrete Reasoning Over the content of Paragraphs.
 
 A detailed breakdown of the evaluation can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_MayaPH__GodziLLa2-70B). Huge thanks to [@thomwolf](https://huggingface.co/thomwolf).
 
-## Leaderboard Highlights (as of August 17, 2023)
-- Godzilla 2 70B debuts at 4th place worldwide in the Open LLM Leaderboard.
-- Godzilla 2 70B ranks #3 in the ARC challenge.
-- Godzilla 2 70B ranks #5 in the TruthfulQA benchmark.
-- *Godzilla 2 70B beats GPT-3.5 (ChatGPT) in terms of average performance and the HellaSwag benchmark (87.53 > 85.5).
-- *Godzilla 2 70B outperforms GPT-3.5 (ChatGPT) and GPT-4 on the TruthfulQA benchmark (61.54 for G2-70B, 47 for GPT-3.5, 59 for GPT-4).
-- *Godzilla 2 70B is on par with GPT-3.5 (ChatGPT) on the MMLU benchmark (<0.12%).
+## Open LLM Leaderboard Metrics (before Fall 2023 update)
+| Metric                | Value |
+|-----------------------|-------|
+| MMLU (5-shot)         | 69.88  |
+| ARC (25-shot)         | 71.42  |
+| HellaSwag (10-shot)   | 87.53  |
+| TruthfulQA (0-shot)   | 61.54  |
+| Average               | 72.59  |
+
+## Leaderboard Highlights (Fall 2023 update, November 10, 2023)
+- Godzilla 2 70B debuts at 2nd place worldwide in the newly updated Open LLM Leaderboard.
+- Godzilla 2 70B beats GPT-3.5 (ChatGPT) in terms of average performance and the HellaSwag benchmark (87.53 > 85.5).
+- Godzilla 2 70B outperforms GPT-3.5 (ChatGPT) and GPT-4 on the TruthfulQA benchmark (61.54 for G2-70B, 47 for GPT-3.5, 59 for GPT-4).
+- Godzilla 2 70B is on par with GPT-3.5 (ChatGPT) on the MMLU benchmark (<0.12%).
   
 *Based on a [leaderboard clone](https://huggingface.co/spaces/gsaivinay/open_llm_leaderboard) with GPT-3.5 and GPT-4 included.