Upload folder using huggingface_hub

README.md

@@ -97,6 +97,38 @@ How may I assist you today?
 ## Evaluation
 ```
 
+hf (pretrained=fblgit/LUNA-SOLARkrautLM-Instruct), gen_kwargs: (), limit: None, num_fewshot: 5, batch_size: auto
+|Tasks|Version|  Filter  |n-shot|  Metric   |Value |   |Stderr|
+|-----|-------|----------|-----:|-----------|-----:|---|-----:|
+|gsm8k|Yaml   |get-answer|     5|exact_match|0.6467|±  |0.0132|
+
+hf (pretrained=fblgit/LUNA-SOLARkrautLM-Instruct), gen_kwargs: (), limit: None, num_fewshot: 0, batch_size: auto (64)
+|    Tasks     |Version|Filter|n-shot|Metric|Value |   |Stderr|
+|--------------|-------|------|-----:|------|-----:|---|-----:|
+|truthfulqa_mc2|Yaml   |none  |     0|acc   |0.7368|±  |0.0149|
+
+hf (pretrained=fblgit/LUNA-SOLARkrautLM-Instruct), gen_kwargs: (), limit: None, num_fewshot: 25, batch_size: auto (32)
+|    Tasks    |Version|Filter|n-shot| Metric |Value|   |Stderr|
+|-------------|-------|------|-----:|--------|----:|---|-----:|
+|arc_challenge|Yaml   |none  |    25|acc     |0.692|±  |0.0135|
+|             |       |none  |    25|acc_norm|0.715|±  |0.0132|
+
+hf (pretrained=fblgit/LUNA-SOLARkrautLM-Instruct), gen_kwargs: (), limit: None, num_fewshot: 0, batch_size: auto (64)
+|   Tasks   |Version|Filter|n-shot|Metric| Value |   |Stderr|
+|-----------|-------|------|-----:|------|------:|---|-----:|
+|paws_de    |Yaml   |none  |     0|acc   | 0.3965|±  |0.0109|
+|wmt16-en-de|Yaml   |none  |     0|bleu  | 3.5784|±  |0.1325|
+|           |       |none  |     0|ter   |64.5707|±  |0.4514|
+|           |       |none  |     0|chrf  |45.7068|±  |0.3861|
+|xnli_de    |Yaml   |none  |     0|acc   | 0.4129|±  |0.0099|
+
+hf (pretrained=fblgit/LUNA-SOLARkrautLM-Instruct), gen_kwargs: (), limit: None, num_fewshot: 10, batch_size: auto (32)
+|  Tasks  |Version|Filter|n-shot| Metric |Value |   |Stderr|
+|---------|-------|------|-----:|--------|-----:|---|-----:|
+|hellaswag|Yaml   |none  |    10|acc     |0.7131|±  |0.0045|
+|         |       |none  |    10|acc_norm|0.8815|±  |0.0032|
+
+```
 
 ## Disclaimer
 We must inform users that despite our best efforts in data cleansing, the possibility of uncensored content slipping through cannot be entirely ruled out.
@@ -109,5 +141,9 @@ If you are interested in customized LLMs for business applications, please get i
 ## Collaborations
 We are also keenly seeking support and investment for our startup, VAGO solutions, where we continuously advance the development of robust language models designed to address a diverse range of purposes and requirements. If the prospect of collaboratively navigating future challenges excites you, we warmly invite you to reach out to us.
 
+Juanako.AI is also seeking support and investment for our startup, we also are open for collaborating with other labs to make awesome models like this one.
+
 ## Acknowledgement
+Big Hug to VAGO Solutions, we merely used our transformers library on their code and dataset, nothing else. This won't be possible without them, thanks!
+
 Many thanks to [argilla](https://huggingface.co/datasets/argilla) and [Huggingface](https://huggingface.co) for providing such valuable datasets to the Open-Source community. And of course a big thanks to [upstage](https://huggingface.co/upstage) for providing the open source community with their latest technology!